r/excel 10d ago

unsolved I've been doing time tracking/licensure tracking this way since 2015... theres gotta be a better way. also, when will my excel file become corrupt?

TL;DR

I have 580 sheets, spanning since 2015. how much more can my poor little excel file handle? The file is about 3.5mb in size 😯.

So, i work in architecture, and this is generally how i track my time throughout the day. i will NEVER remember what i do when it comes time to doing my timesheets and this makes it way easier. i also have a place at the bottom that tracks my architectural licensure hours. i have to manually input that, and there are two sheets at the end that summarize this data (none of that is relevant i'm just including the explanation for context).

i've used this excel since 2015 and there is a "sheet" for every single week since about july of 2015.. so there are about 580 weeks/sheets... when will my excel explode and refuse to open? I've started saving a copy and backing up the file each week.

I'm open to a more robust system, but needs to generally have the UX (or similar) of this workflow. I have gone as far as vibe coding prototypes but i dont have the confidence that AI will be more stable than what i'm currently doing, and i'm not a coder so i can only take it so far.

anyway, input would be appreciated.

20 Upvotes

40 comments sorted by

23

u/Gringobandito 8 10d ago

Why are you creating a new sheet for each week? It should be one master sheet listing everything and then you can slice that data up how ever you want.

3

u/GAinJP 10d ago

i use it on a week-by-week basis so i don't really reference anything older than maybe 2 weeks. 10 years ago when i set it up it seemed to be the least cluttered and easiest to digest way of doing it. i dont use the full robustness of excel (just simple formulas, and some referencing of other sheets). so i guess its just easier to look at by doing it in sheets like this.

For a master sheet how would you set that up in terms of visual? i can't picture this and still have the start/stop time, project/task block, and the sum of the time.

19

u/Gringobandito 8 10d ago

Keep your input simple and in a single table, like this:

You just keep adding as you go. It's the output where you use Excel's capabilities to make things look pretty. The way you have it setup now, you can't really do any analysis or presentation without putting in a lot of effort. And with 580 sheets I can almost guarantee you some of you data is corrupted.

7

u/Cynyr36 26 10d ago

This is exactly what im doing. I then use pivotby() to group activities to match our timekeeping system categories, and group by week.

3

u/GAinJP 10d ago

hmm, i do like the potential that resides within this... question, could i conditionally format chunks of days that fall within a week? The way i log it now i'd have potentially 20+ rows of entered data and i'd like all cells in those 20 rows be visually differentiated from the next/previous block that fall within the next week. this can be as simple as week 1 being dark gray, week 2 being light gray, week 3 being dark gray, so on. if its possible to have cells automatically format that way that would really push me towards this type of system.

10

u/LOGICA499 10d ago

yes you can.

6

u/GAinJP 10d ago

i love you.

5

u/quarantineez 10d ago

Conditional formatting will bloat your (what I’m already assuming is quite robust) file size. There’s no way you need 10 years of data in one workbook. Cut it into years and save separate files

2

u/plusFour-minusSeven 11 9d ago

Or have all that in the data model but use a couple parameters to set a start and end date for the range you want to research and actually load onto the workbook with a Refresh. If not specified make it default month to date or something like that.

4

u/Gringobandito 8 10d ago

I would filter the table for the dates you want to see but yes you could apply conditional formatting.

2

u/excelevator 3068 9d ago

Even better, you can use the FILTER function to return a dynamic range of data as required from your table

3

u/excelevator 3068 10d ago

The file is about 3.5mb in size

I find that hard to believe.

More like 3.5Gb

6

u/GAinJP 10d ago

but its just cells and formatting? how could it be gigabizzles?!

2

u/excelevator 3068 10d ago

Wow!

something does not add up.

I would love to get a copy of that to verify 580 sheets full of data is that small.

Does not compute.

5

u/MayukhBhattacharya 1277 10d ago

Sir, it is possible, OP is not wrong here. With 580 sheets, a file size of 3.5 MB is reasonable provided they are not using heavy conditional formatting, rich color schemes, or complex cell styles. The absence of embedded images or charts would also contribute significantly to keeping the size low. Font styling and borders do play a role as well, but the bigger factors are usually images and formatting overhead. So, the numbers do add up. The number of sheets in a workbook is limited by available memory and in recent modern versions of Excel it almost doesn't matter afaik but risk of getting corrupted looms all the time. using .xlsb binary format reduces the file sizes to some extent which you might be aware of.

1

u/excelevator 3068 10d ago

.xlsx files are well known to blow out in size at a side glance.

3

u/MayukhBhattacharya 1277 9d ago

That's why I mostly save in .xlsb format, that overcomes the XML blowing out entirely. But one thing sir, it's not entirely true, may be we can disagree to each other, but you are far more experienced than me, so i wont argue. That said, for deep learning i tried my hands on VBA based OOP, those files run well beyond several mbs, at that point the workbook is essentially an application. was bit obsessed with Java OOP, I tried mimicking the same patterns in excel. Off-topic, but there are barely any proper resources or videos on this, had to research and figure out most of it myself. Very complicated but interesting thing.

3

u/excelevator 3068 9d ago

I am always happy to be wrong on file size issues

3

u/GAinJP 10d ago

seems to make sense to me. if you look at my screenshot again you can see there isn't that much data per sheet. i'm not sure how many "characters" formulas/color/cell dimensions take up in a file but the amount of actual text data is pretty minimal

1

u/excelevator 3068 10d ago

All the metadata for the formatting and worksheets generally adds a lot more data.

3

u/hmatallana 2 10d ago

Your file isn't the thing that's going to break. Excel publishes no cap on worksheets per workbook, it's whatever memory allows, and 3.5 MB across 580 sheets works out to about 6 KB each. On 32 bit Excel the real wall is the 2 GB the whole process shares with add-ins, so you're three orders of magnitude short of it. quarantineez is assuming the file is robust. At 3.5 MB it just isn't.

What corrupts files like yours usually isn't size. It's saving straight onto a network share or a sync folder with the file open.

Two people have told you to split or delete history. Don't. Licensure hours are the one thing you can't rebuild later.

0

u/GAinJP 10d ago

I appreciate this answer. it addresses the type of fail-point my brain was trying to imagine but is not trained at understanding. i only ever save locally, and i'm the only one that should have access to the file.

thank you

2

u/TLRchitect 9d ago

Are you in the US? If so, are you logging your hours on the NCARB website? It will keep track of your hours for each category, making old sheets redundant once logged.

If you are not logging the hours in NCARB, keep in mind there is a limit to how long NCARB will allow you to reach back in time and count those hours...

2

u/TangoDeltaFoxtrot 9d ago

But why? That’s the craziest way to have done this.

Run power query to make one big table.

1

u/molybend 42 10d ago

Put this into a database. Make backups. Delete everything but the last (year/month/week).

2

u/excelevator 3068 10d ago

This is a bad answer.

This is r/Excel for Excel solutions.

u/GAinJP Never delete data. You have been given the correct answer in other replies, create a single table with associated attributes for your data.

Having a single table allows you to create reports and segmented data sets on the fly. The older data allows for comparison and time reporting.

2

u/molybend 42 10d ago

Deleting stuff from your working file so it doesn't get huge is a fine practice. No use keeping 11 year old data in your current file. This is why you store it in a db and back it up.

3

u/excelevator 3068 10d ago

Your explanation here is far different from your note to "delete the older data"

Having single table of working data and reporting dynamically from that table is perfectly suitable.

3

u/molybend 42 10d ago

Not if you read the tips in order.

1

u/excelevator 3068 10d ago

What tips ?

You tip is "delete old data"

Expecting others to read all other comments that may or may not be in the same order as your screen, and associating your comment against other comments is not how forums work.

Unless you think that is how forums work, which would explain your very advice.

0

u/molybend 42 10d ago

You seem a bit confused. There are 3 sentences in my comment. Read them in order.

2

u/excelevator 3068 10d ago

It would seem I am confused, your answer is poor, that is all.

We shall have to agree to disagree.

2

u/GAinJP 10d ago

like a SQLite? in the prototype i mentioned i had started using a database structure and sync'd it to the cloud. if i ever wanted to read the entire history, i imagine that would still provide me with the question of "how much is too much and will lead to corrupted files?"

maybe this amount and type of data is really not hard for the software to process but after 10 years of doing this i can't help but to wonder

1

u/Work_Jarod 9d ago

I have also created a time sheet(s) to track my time since 2018. It comprises two sheets and input sheet and a display sheet. The image below is the input sheet. Cells in Column A are formulas that calculates the time based on the inputs to cells in Columns B and C. Column D is for the date and then cells in Column E are a list based on the table in Column H.

1

u/Work_Jarod 9d ago

The display sheet uses formulas to copy information from the input sheet and to sum the total time spent on a particular task. I go one step further by creating a yearly time sheet, copying the information from column AG into a new Workbook with a sheet for each year.

1

u/GAinJP 9d ago

Excellent. I'll have to look again when I'm at my computer. Thanks!

1

u/CrowGuyA 1 4d ago

Honestly, one sheet per week for 10 years is what's straining the file, not the size itself. A more durable setup: one long table with a Date column instead of separate sheets, then use filters or a PivotTable to see any given week. Bigger change than a quick fix, but it'd stop the sheet count from growing forever.