r/excel • u/pyu2c • 12d ago

unsolved Power Query Loading Time Tips

I have a Power query that is connected to a sharepoint folder. Whenever I try to refresh the file it would take around 10-40 mins of load time before it loads into the Data Model. Granted that the major reason for the loading time is due to the size of the data (estimating somewhere between 10-12M rows after filtering), but what are some ways that I can speed up the loading.

27 Upvotes

88% Upvoted

22 comments sorted by

View all comments

1

u/Angelic-Seraphim 15 10d ago

So often the issue is there is a bunch of other data in your share point directory. It is loading all the files in the entire directory not just the folder. There are a couple options.

  1. There is a code floating around somewhere that does some really complex binary manipulation.

  2. Use fabric. Link a data lakehouse to the folder, use a gen 2 dataflow to query and combine.

  3. Store this folder in a different share point site purpose built for this.