my itForte - Job Detail

 
Data Engineer - Scala/Python/Java/Hadoop/Spark/Kafka/Azkaban/Luigi for Europe (Full-Time onsite)
Job ID IT JOBS#341
Location: Lisbon, Portugal
Required Skills:
Our client headquartered in Germany is one of the largest and most reputed Automobile company owning some of the top luxury car brands in the world and with 100+ plants worldwide in 27 countries Europe, North & South America and Asia.
The company is looking for experienced Data Engineer for Portugal, Europe for its captive Digital Services Solutions subsidiary.

Key Responsibilities
- Create and maintain data pipeline architecture.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
- Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

Qualification/Key Skiils
- Bachelor's degree in IT and/or comparable job expertise (min. 3 years)
- Programming with functional programming and object-oriented script languages: Scala, Python, Java
- Experience with big data tools and distributed clusters such as Hadoop, Spark, Kafka, Kinesis.
- Experience with data pipeline and workflow management tools such as Azkaban, Luigi, Airflow, Glue Workflow
- Experience in building and optimizing ‘big data’ data pipelines, architectures and data sets.
- Experience in building processes supporting data transformation, data structures, metadata, dependency and workload management.

What’s in for you…
- Be part of our amazing startup atmosphere and help of our local company culture, with the support of a solid international group;
- An Agile environment where your ideas are welcome;
- A very talented international team just as passionate and goal-oriented as you;
- Flexible working hours and the possibility to work from home if needed;
- The opportunity to evolve with continuous training and constant feedback;
- Access to Udemy;
- Health insurance for you and your family;
- Smartphone with voice/data plan;
- Fresh fruit, coffee and tea every day so you can be healthy and stay fueled for the day;
- Hakuna Matata Sessions aka our weekly knowledge sharing session with snacks and beer to kick-off the weekend.

Location: Lisbon, Portugal (Full-time, Onsite)

Compensation: Best in the industry