Data Engineer

About us

Engineering Software Lab is a member of Engineering Group, one of the main players in the field of digital transformation of public and private companies and organizations around the world. With around 12,000 professionals in 65 locations (in Italy, Belgium, Germany, Norway, Serbia, Spain, Sweden, Switzerland, Argentina, Brazil, and the USA), the Engineering Group designs, develops and manages innovative solutions for the business areas where digitalization is having the biggest impact, including Digital Finance, Smart Government & E-Health, Augmented City, Digital Industry, Smart Energy & Utilities, Digital Media & Communication.

Job description

You will be part of an international team working as a Data Engineer on Data Lakehouse projects, designing ETL jobs using enterprise-grade vendor data management tools and building, managing, and optimizing data pipelines using big data processing cloud platforms like Spark, Databricks, and Azure.

Responsibilities:

• Design, create, and manage scalable ETL (extract, transform, load) systems, and pipelines for various data sources;
• Model data management solutions on Lakehouse architectures;
• Build data processing pipelines via Spark and Delta Lake API;
• Managing and optimizing data pipelines for performance, security, and governance best practices;
• Monitoring and logging production integration jobs.
• Reference: 4V-rHheIPiGG6MdrQHkr72yI06VAkvq4tvbI-XfD23JmBMFmHgNF65pufM_yLbD1

Requirements and Skills:

• Proficiency in SQL;
• Strong Experience in Design, Development, Implementation, Unit Testing, Troubleshooting, and Support of ETL Processes;
• Ability to build and optimize data sets, ‘big data’ data pipelines, and architectures;
• Experience with Spark programming (Scala or PySpark, Spark SQL);
• Experience with Databricks is an advantage;
• Experience with Azure Data Factory (ADF) dataflow and pipeline development;
• Good knowledge of relational databases or NoSQL databases like MongoDB or Cassandra.

Qualifications:

• Bachelor’s degree in computer science, Software Engineering, or related field (or equivalent work experience);
• Organizational and time management skills;
• Strong problem-solving, analytical, and debugging skills;
• Effective communication and collaboration skills;
• Ability to work independently and in a team environment;
• English language Professional Working proficiency.

Seniority:

• 3+ years of relevant experience

We offer:

• Competitive compensation depending on experience and skills;
• Hybrid work model, the option to choose/combine work from home/office;
• Private health insurance;
• Fit Pass;
• Opportunity to learn 7 different languages using our E-learning platform;
• Great colleagues, open informal, and fun atmosphere;
• Chance to be part of a professional and highly dynamic international environment.