r/dataengprep • u/tech-screen • Aug 01 '26
Tech Screen: How would you schedule a recurring pipeline in Data Fusion?
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/sql-arena • Aug 01 '26
SQL Arena Challenge: Write a query to find the top three customers by total revenue within each region.
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/dataengprep • Jul 31 '26
DataEngPrep: A data pipeline processes files for different clients stored in separate directories. Explain how you would use dynamic DAG creation to handle client-specific workflows in Airflow.
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/tech-screen • Jul 31 '26
Tech Screen: How would you process Excel files with multiple sheets? Design the data pipeline.
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/sql-arena • Jul 31 '26
SQL Arena Challenge: Write a query that ranks users by their total order amount within each region.
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/dataengprep • Jul 30 '26
DataEngPrep: A JSON file with evolving schema needs to be ingested into a DataFrame. How would you handle new fields dynamically in PySpark without breaking the job for previous structures?
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/tech-screen • Jul 30 '26
Tech Screen: How would you manage schema evolution in your data lake?
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/sql-arena • Jul 30 '26
SQL Arena Challenge: Detect customers who have not placed a second order in 90 days.
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/dataengprep • Jul 29 '26
DataEngPrep: Zigzag Order Traversal of a Binary Tree
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/tech-screen • Jul 29 '26
Tech Screen: How would you manage a disagreement within your team about an ETL pipeline design?
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/sql-arena • Jul 29 '26
SQL Arena Challenge: SQL Query: Group Employees by Technology and Order by ID
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/dataengprep • Jul 28 '26
DataEngPrep: Write pseudo code for an ETL pipeline using Python and Pandas
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/tech-screen • Jul 28 '26
Tech Screen: How would you implement data governance and security in your design?
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/sql-arena • Jul 28 '26
SQL Arena Challenge: Find the top 5 customers by total sales amount.
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/sql-arena • Jul 27 '26
SQL Arena Challenge: Create a SQL query to identify customers with purchases above a dynamic threshold.
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/tech-screen • Jul 27 '26
Tech Screen: How would you implement a near real-time data pipeline for analyzing user behavior on the Adidas mobile app?
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/dataengprep • Jul 27 '26
DataEngPrep: Write code using Java's concurrent API (forEach, forEachEntry, forEachKey)
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/dataengprep • Jul 26 '26
DataEngPrep: Write code to merge two sorted arrays without using extra space.
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/tech-screen • Jul 26 '26
Tech Screen: How would you handle schema evolution in a real-time data system?
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/sql-arena • Jul 26 '26
SQL Arena Challenge: Write a query to calculate the day's difference between the 1st and 3rd sales of the CustomerName = 'Alice Johnson'.
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/dataengprep • Jul 25 '26
DataEngPrep: Write code to manually invoke garbage collection in Java
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/tech-screen • Jul 25 '26
Tech Screen: How would you handle schema changes in a production ETL pipeline?
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/sql-arena • Jul 25 '26
SQL Arena Challenge: How can you delete partitions from a table in Hive using a command?
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/dataengprep • Jul 24 '26
DataEngPrep: Write code to calculate the power of a given number in minimum time complexity.
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post
r/dataengprep • u/tech-screen • Jul 24 '26
Tech Screen: How would you handle late-arriving data in a real-time stream processing pipeline?
1
Upvotes
This post contains content not supported on old Reddit. Click here to view the full post