Job Details
Data Engineer
DESS001
Posted: 19/11/2024
- up to 40K€
- Madrid
- Permanent
Location: Madrid-Spain
Permanent role
Required Spanish & English professional level speaking
Location: Madrid, Spain
4+ years experience
1. Design, implement, and manage data pipelines on Google Cloud using Apache Nifi, Dataproc, BigQuery, Dataflow, and other GCP services.
2. Develop Spark and Hadoop workflows to process large datasets in Dataproc, ensuring data reliability and efficiency.
3. Integrate Dataproc workflows with other GCP data services like Cloud Storage, BigQuery, and Pub/Sub.
4. Troubleshoot data quality issues and optimize pipeline performance in Dataproc clusters.
5. Advanced proficiency with SQL and Python/Spark/Scala for data processing.
6.Document data pipelines, ETL processes, and data architecture.
7. Datahub knowledge is additional benefit.
1. Spanish native with English secondary
2. Hybrid mode of working (Remote + Office both)
3. 8hours*5days, on call mode of working (24 Hrs support kind of role)
4. Experience working with Telecom will be preferred
Sally Sanaie
Senior Consultant