In Cyclad we work with top international IT companies in order to boost their potential in delivering outstanding, cutting-edge technologies that shape the world of the future. We are seeking an enthusiastic and experienced Data Engineer with Azure stack. You will play a key role in designing, developing, and maintaining data pipelines using Azure Databricks and Delta Lake.

Project information:

• Type of project: IT services
• Office location: Wroclaw and Poznan
• Work mode: hybrid - 1 office day /4 days remotely
• Budget: b2b 100 - 140 PLN/day net
• Project length: long-term
• Only candidates with citizenship in the European Union and residence in Poland
• Start date: ASAP (depending on candidate's availability)

Project scope:

• Designing, developing, and maintaining data pipelines using Azure Databricks and Delta Lake

• Implement data application in Python with transformations and aggregations using PySpark: ingestion, data historization, integration, filtering

• Developing a data quality framework, observability, and monitoring tools

• Collaborate with stakeholders to understand data requirements and ensure data quality

• Optimize performance and cost-efficiency of data workflows in Azure Databricks