Senior Data Engineer

Main Objective:

Ensure the leverage of data effectively for analytics, reporting, and decision-making by building and maintaining a robust data infrastructure for enterprise-grade IT solutions of BASF Agricultural Solutions.

Main Tasks:

• Design, build, and maintain data pipelines to extract, transform, and load (ETL) data from various sources into data storage systems such as data warehouses or data lakes.
• Integrate data from different databases, applications, and external sources, ensuring data consistency, integrity and accuracy.
• Create and maintain data models, schemas, and structures that facilitate efficient data storage and retrieval.
• Transform and clean raw data to prepare it for analysis, including handling missing values, data normalization, and aggregation.
• Implement data quality checks, validation processes, and error handling to maintain high data quality standards.
• Administer and optimize databases, including performance tuning, indexing, and ensuring data security.
• Automate ETL processes and routine tasks to improve efficiency and reduce manual intervention.
• Continuously monitor data pipelines and infrastructure for performance issues, errors, and data anomalies. Troubleshoot and resolve issues promptly.
• Stay updated with the latest data engineering tools and technologies and evaluate their suitability for the organization's needs.

Requirements:

• Education: Graduates or advanced students of Software Engineering, bachelor's degree in computer science, Telematics Engineering, Information Technology Analyst (or related careers).
• Working Experience:

• 3-5 years of experience in IT Consulting or related fields.

• Language skills: Advanced level of English (spoken and written).

• Technical skills:

• Advanced skills in understanding data requirements
• Advanced skills in design and implementation of ETL / ELT Data Pipelines
• Advanced skills in understanding data integrity requirements
• Advanced skills in Python, SQL, Open Source R, and Azure Cloud (must)
• Intermediate skills in Hadoop, Spark, AWS, Java, and Scala (nice to have)

• Soft skills:

• Advanced skills in effective communication
• Basic skills in project management

What we offer:

• A hybrid and flexible working model
• A professional development program tailored to your interests and needs
• Private health insurance for you and your family from your first day in the company and life insurance
• Flexible leave days in addition to your statutory leave
• The possibility of remote work from abroad for up to 6 weeks a year
• A free day on your birthday
• Wellness benefits, such as nutrition services and in-company massages.