AWS Data Engineer
Il y a 2 jours
Tunis, 11, Tunisie
Scope Merge
Temps plein
Gratuit avec email ou Google
Enregistrez cette offre et organisez votre recherche
Créez un compte gratuit pour enregistrer des offres d'emploi, créer des alertes et revenir à cette liste depuis votre tableau de bord.
Gratuit avec email ou Google
The role
We are looking for an experienced AWS Data Engineer to join a European enterprise client building an IoT Data Platform. You will design, implement and optimize scalable data pipelines and shared data platform services. The work is cloud-native data engineering on AWS, and it supports analytics, data products and machine learning use cases in an industrial IoT context.
What you will do
- Design, implement and operate cloud-native data pipelines on AWS for the IoT Data Platform
- Build and maintain scalable ETL workflows, data lakes and data mesh components using modern data formats and processing frameworks
- Develop and optimize distributed data processing jobs in PySpark for large-scale and time-series workloads
- Design and manage data schemas, tables and metadata using AWS Glue Data Catalog and Lake Formation Must-have skills
- Hands-on AWS: Glue, Lambda, S3, Athena, Lake Formation, Step Functions, DynamoDB, IAM, Terraform, API Gateway
- Data engineering: ETL pipeline development, data lakes and/or data mesh architectures, schema and metadata management, Python
- Data processing: PySpark for distributed processing and performance optimization
- Data formats: Apache Iceberg and Parquet
- Experience in cross-functional agile teams and Scrum ceremonies Nice to have
- Practical experience with time-series data, ideally from industrial machines or similar IoT sources
- Basic understanding of ML/AI concepts, governance principles and MLOps (lifecycle management, pipelines, CI/CD)
- AWS API Gateway, data exchange and integration APIs
- CI/CD pipelines, containerization, automated deployment and testing Setup Full-time, based in Tunis, embedded with the client's engineering team.
- Design, implement and operate cloud-native data pipelines on AWS for the IoT Data Platform
- Build and maintain scalable ETL workflows, data lakes and data mesh components using modern data formats and processing frameworks
- Develop and optimize distributed data processing jobs in PySpark for large-scale and time-series workloads
- Design and manage data schemas, tables and metadata using AWS Glue Data Catalog and Lake Formation Must-have skills
- Hands-on AWS: Glue, Lambda, S3, Athena, Lake Formation, Step Functions, DynamoDB, IAM, Terraform, API Gateway
- Data engineering: ETL pipeline development, data lakes and/or data mesh architectures, schema and metadata management, Python
- Data processing: PySpark for distributed processing and performance optimization
- Data formats: Apache Iceberg and Parquet
- Experience in cross-functional agile teams and Scrum ceremonies Nice to have
- Practical experience with time-series data, ideally from industrial machines or similar IoT sources
- Basic understanding of ML/AI concepts, governance principles and MLOps (lifecycle management, pipelines, CI/CD)
- AWS API Gateway, data exchange and integration APIs
- CI/CD pipelines, containerization, automated deployment and testing Setup Full-time, based in Tunis, embedded with the client's engineering team.