AWS Data Engineer

Il y a 2 jours

Tunis, 11, Tunisie Scope Merge Temps plein
The role We are looking for an experienced AWS Data Engineer to join a European enterprise client building an IoT Data Platform. You will design, implement and optimize scalable data pipelines and shared data platform services. The work is cloud-native data engineering on AWS, and it supports analytics, data products and machine learning use cases in an industrial IoT context. What you will do
- Design, implement and operate cloud-native data pipelines on AWS for the IoT Data Platform
- Build and maintain scalable ETL workflows, data lakes and data mesh components using modern data formats and processing frameworks
- Develop and optimize distributed data processing jobs in PySpark for large-scale and time-series workloads
- Design and manage data schemas, tables and metadata using AWS Glue Data Catalog and Lake Formation Must-have skills
- Hands-on AWS: Glue, Lambda, S3, Athena, Lake Formation, Step Functions, DynamoDB, IAM, Terraform, API Gateway
- Data engineering: ETL pipeline development, data lakes and/or data mesh architectures, schema and metadata management, Python
- Data processing: PySpark for distributed processing and performance optimization
- Data formats: Apache Iceberg and Parquet
- Experience in cross-functional agile teams and Scrum ceremonies Nice to have
- Practical experience with time-series data, ideally from industrial machines or similar IoT sources
- Basic understanding of ML/AI concepts, governance principles and MLOps (lifecycle management, pipelines, CI/CD)
- AWS API Gateway, data exchange and integration APIs
- CI/CD pipelines, containerization, automated deployment and testing Setup Full-time, based in Tunis, embedded with the client's engineering team.