Master Graduation Assignment: Data pipeline optimization in cloud environment
Improve PACCAR Parts Europe’s data pipeline structure, leading to a high performing, efficient, and future proof data sourcing
-
Location Eindhoven
-
Organisation Unit Internships Eindhoven
-
Fulltime Fulltime
-
Education level Master
-
Contract type Internship contract
Job description
For our Data Analytics Team, we are looking for a graduate student who will conduct research on how to improve PACCAR Parts Europe’s data pipeline.
The current logic of data processing in our cloud environment (AWS/Snowflake) is complex and requires revision and modernization.
The data pipeline consists of a large number of transformation layers and processing steps, resulting in long processing times and a high load on available resources.
The current setup of the pipeline is primarily focused on achieving results. With future expansion in mind -including the growing integration of multiple (live) data sources- it is crucial to optimize the effectiveness, maintainability and future-proof scalability of the pipeline.
During this internship, the focus will be on analyzing the existing architecture, identifying bottlenecks, and defining measures to improve the performance, efficiency, maintainability and scalability of the data pipeline. Stretch target is to implement the improved method.
Your profile
We are looking for an enthusiastic and ambitious Masters student who is pursuing a degree in the field of Data Engineering.
Your profile:
- Profound experience with SQL
- Good experience with Python
- Preferred experience with Snowflake and AWS
- Understanding of warehouse a/o logistics processes would be a plus
- You can easily deal with large amounts of data, in understanding, structuring and analysis
- You can demonstrate technical creativity and think beyond existing structures
- You can work independently, you are proactive and you are curious
- You feel comfortable communicating in English, native Dutch speaking is preferred
Department
PACCAR Parts Europe (PPE) is responsible for distribution of truck parts to over 1.000 DAF Trucks dealers all over Europe for truck maintenance and repairs. PPE operates 5 state-of-the-art distribution centers (Parts Distribution Centers) in Eindhoven, Leyland, Madrid, Budapest and Massbach.
Within PACCAR Parts Europe Operation, the Data Analytics team is responsible for developing, maintaining and innovating the data warehouse (cloud) in which all operational data is being stored real time. The data in the data warehouse is used for analysis, reporting and intelligent data solutions for daily operation. All in order to contribute to PACCAR Parts key objective to maximize the speed of delivery to our customers, and meanwhile ensure maximum internal efficiency and productivity. Efficient retrieval of data from the data warehouse is essential for a sustainable, effective and future ready data performance.
We offer
- A view behind the scenes at a large international corporation;
- You will get a lot of freedom and responsibility. We are open to your initiatives and depending on the assignment you see your results back in the workplace;
- An experienced coach and supervisor who can teach you a lot and is willing to help you with your assignment;
- After your graduation, you will have the opportunity to start your career at DAF;
- An internship wage of €375,- (Bachelor) or € 450,- (Master) per month on full-time base
- A travel allowance, if you don’t have a student travel product (provided by the Dutch government);
- A housing allowance, if you temporarily rent a room near DAF.
Would you like to know more about the experiences of other students? Here you can read stories of our former interns.