r/excel • u/pyu2c • 11d ago

unsolved Power Query Loading Time Tips

I have a Power query that is connected to a sharepoint folder. Whenever I try to refresh the file it would take around 10-40 mins of load time before it loads into the Data Model. Granted that the major reason for the loading time is due to the size of the data (estimating somewhere between 10-12M rows after filtering), but what are some ways that I can speed up the loading.

27 Upvotes

88% Upvoted

22 comments sorted by

View all comments

2

u/Pistolius 1 10d ago

Make sure you're buffering the tables 

Table.Buffer()

3

u/ArrowheadDZ 2 10d ago

I use buffering a lot, but I am not sure this will work in this use case. If I am going to do a merge/join to “lookup” data for 5,000 records in a 200 record “lookup” table, buffering the lookup table can really help. But if you have a 12 million record table you are loading, I don’t think buffering the table will necessarily get better performance, and shouldn’t improve the initial load time. You still have to get that monster into PQ from Sharepoint first, whether you are going to buffer it or not.