Key Responsibilities
- Create and maintain data pipeline architecture.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
- Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Qualification/Key Skiils
- Bachelor's degree in IT and/or comparable job expertise (min. 3 years)
- Programming with functional programming and object-oriented script languages: Scala, Python, Java
- Experience with big data tools and distributed clusters such as Hadoop, Spark, Kafka, Kinesis.
- Experience with data pipeline and workflow management tools such as Azkaban, Luigi, Airflow, Glue Workflow
- Experience in building and optimizing ‘big data’ data pipelines, architectures and data sets.
- Experience in building processes supporting data transformation, data structures, metadata, dependency and workload management.
What’s in for you…
- Be part of our amazing startup atmosphere and help of our local company culture, with the support of a solid international group;
- An Agile environment where your ideas are welcome;
- A very talented international team just as passionate and goal-oriented as you;
- Flexible working hours and the possibility to work from home if needed;
- The opportunity to evolve with continuous training and constant feedback;
- Access to Udemy;
- Health insurance for you and your family;
- Smartphone with voice/data plan;
- Fresh fruit, coffee and tea every day so you can be healthy and stay fueled for the day;
- Hakuna Matata Sessions aka our weekly knowledge sharing session with snacks and beer to kick-off the weekend.
Location: Lisbon, Portugal (Full-time, Onsite)
Compensation: Best in the industry
