Descripción de la oferta
Databricks Data Engineer
Location: Madrid, Spain - HybridContract: Initial 6 monthsDay Rate: €275-€300 per day
I'm currently recruiting for a Databricks Data Engineer to join a data-focused team in Madrid.
This is a hands-on engineering role for someone with strong experience in Databricks, PySpark and Python, who can independently design, build and optimise scalable data pipelines.
Key Responsibilities
Design and develop end-to-end data pipelines from source systems through to Gold-layer datasets
Build scalable data processing solutions using Databricks and PySpark
Develop robust Python-based data engineering solutions
Implement data ingestion from multiple sources, including APIs, databases and files
Work with Medallion Architecture - Bronze, Silver and Gold layers
Perform data transformation using PySpark and SQL
Process and manage large-scale datasets
Optimise pipeline performance and Databricks workloads
Ensure data quality, reliability and maintainability
Required Skills
Strong hands-on experience with Databricks
Advanced PySpark development
Strong Python programming skills
Strong SQL and data transformation experience
Proven experience building end-to-end data pipelines
Experience with data ingestion from APIs, databases, files and other sources
Experience implementing Medallion Architecture
Experience handling large-scale data processing
Strong understanding of pipeline performance and optimisation
Strong spoken and written English and Spanish language skills
Working Environment
Hybrid working environment in Madrid
Availability to attend the Madrid office on specific days and for important collaborative meetings
The Ideal Profile
The client is specifically looking for a hands-on Data Engineer who is comfortable writing PySpark and Python code and can independently implement pipelines from source systems through to the Gold layer.
Square One embraces diversity and will treat everyone equally. Please see our website for our full diversity statement.
#J-18808-Ljbffr
