Senior Data Engineer, Azure Databricks
Build scalable data platforms with Azure and Databricks, turning fragmented data into trusted performance insights in a global retail environment.
About the Company
Avaron AB is a growing consultancy that matches your expertise with the market's most interesting assignments, offering a platform where your professional development is central.
About the Assignment
You will join a team building the data foundation for two performance evaluation products in a global retail environment. The assignment focuses on creating a unified and reliable data platform that consolidates information from multiple operational systems and supports faster decision-making across a complex omnichannel business. You will help replace fragmented and manually managed data flows with scalable pipelines, automated validation, and robust data models that improve quality, consistency, and timeliness.
Job Description
- Design, build, and maintain data pipelines that connect, collect, organize, version, and consolidate data from multiple operational sources.
- Develop scalable data models and ingestion frameworks for a unified data platform.
- Create resilient batch and streaming pipelines across ingestion, transformation, and serving layers.
- Implement automated validation checks to improve data accuracy and reduce reporting time.
- Optimize data workflows for performance, scalability, maintainability, and cost efficiency.
- Monitor and troubleshoot pipelines in production environments.
- Contribute across the full data engineering lifecycle, including solution design, architecture, estimation, sprint planning, development, testing, documentation, deployment, and operational follow-up.
- Work hands-on with Databricks, Apache Spark, Delta Lake, Azure services, and DevOps practices to deliver reusable and high-quality data solutions.
Requirements
- Proven experience designing and implementing end-to-end data pipelines for both batch and streaming workloads.
- Hands-on expertise with Databricks, including Apache Spark, Delta Lake, job orchestration, performance tuning, and environment management.
- Strong knowledge of Microsoft Azure, particularly services used in data platforms such as Azure Data Lake Storage.
- Solid experience with DevOps practices, including source control such as Git, CI/CD pipelines, automated testing, environment promotion, and infrastructure as code.
- Strong understanding of data engineering guidelines, release processes, data validation, performance optimization, monitoring, and troubleshooting in production environments.
- Experience contributing in early solution design and throughout the full data engineering lifecycle.
- Ability to explain data architectures, pipelines, and technical trade-offs clearly to non-technical stakeholders.
- Fluent English.
Application
Selections are made on an ongoing basis, so we recommend that you apply as soon as possible.
- Platser
- Malmö
- Distansarbete
- Hybridarbete
Malmö
Om Avaron AB
Avaron grundades med visionen om att skapa ett konsultbolag där kompetens och livskvalitet går hand i hand. Vi är ett nischat team som idag verkar inom komplexa miljöer såsom bank, finans och storskalig industri.
Som konsult hos oss får du det bästa av två världar: tryggheten och de spännande uppdragen hos stora, etablerade uppdragsgivare, kombinerat med det lilla bolagets snabbhet, transparens och personliga kontakt.
Vi tror inte på krångliga hierarkier eller onödig administration. Istället lägger vi kraften på det som faktiskt betyder något – att leverera värde i våra projekt och att se till att våra medarbetare trivs, utvecklas och har en balans i livet som fungerar på riktigt.