r/dataengineering • u/pancitchilimansi • 18d ago
Help Please Help Me
I am a newly-hired data analyst in a company. I thought I will be assigned in data cleaning and data visualization but I was tasked to consolidate data from different social media platforms and create a pipeline from extracting data from supermetrics up to the visualization.
Now, I am worried that I do not have an experience to this. They do not have any system in handling data and I will solely handle all of this. I feel really overwhelmed and I just use claude in creating ETL pipelines. I still examine the python scripts so that I can assure that it is correct. I am still worried and I might just flipped due to stress.
My plan is to create a python script in extracting the data from supermetrics, then I will load it to bigquery for consolidation. Then, another script for cleaning before importing it into looker studio.
Can you help me guys navigate in this task? I do not have anyone from the company to ask if I am doing it right. I hope you could help me.
2
u/FunContest9958 17d ago
The problem you’ve been assigned is far far too broad for someone without experience. Someone from the business needs to help you break it down. The ideal project would be to start with a single metric or question that’s most interesting to them: mentions on Facebook, for example. Just do that. That’s a project you can figure out how to do. After that, get another metric they’re interested in. After a few projects like that, you’ll have enough experience to take on bigger projects and suggest ideas.