Senior Databricks Platform Engineer
Drive Databricks platform development in a complex automotive data environment with real impact on governance, scalability, and production-ready data products.
About the Company
At Avaron, you get the security of permanent employment combined with the variety of working at different customers. We place specialists across everything from tech, IT and industry to project management and business support – and whatever the assignment, you have a consultant manager who is there for you and your development.
About the Role
You will join a team that develops and maintains a data platform for large-scale operational data in the automotive industry. The focus is on making data accessible, reliable, and valuable for analytics, data science, and development.
In this role, you will take a key part in evolving the Databricks setup, strengthening governance across the platform, and building secure, scalable data products that work in production. You will work close to developers, Data Scientists, Machine Learning Engineers, and business stakeholders to turn complex needs into practical technical solutions. This is an exciting opportunity if you want to influence both platform architecture and data governance in a modern data environment.
Job Description
- You will design, develop, and maintain scalable data platforms and data pipelines with a strong focus on Databricks.
- You will drive improvements to the existing Databricks platform setup, architecture, and capabilities.
- You will build and maintain robust ETL/data pipelines for large-scale operational data.
- You will design and implement governance models, data catalogues, and metadata management capabilities.
- You will help ensure strong standards for data quality, discoverability, security, compliance, and maintainability.
- You will implement and manage Infrastructure as Code solutions for Databricks and related cloud services.
- You will create automated, reliable, and reproducible platform and infrastructure environments.
- You will solve complex data and platform challenges and contribute to the continuous development and operation of the team's data platform.
- You will collaborate with technical and business stakeholders to translate requirements into governed, secure, and production-ready data products.
Requirements
- Degree in Computer Science, IT, Engineering, or equivalent relevant experience.
- Several years of professional experience as a Data Engineer, Platform Engineer, or in a similar senior data engineering role.
- Strong hands-on experience with Databricks and Spark.
- Proven hands-on experience working with Databricks in production environments.
- Strong experience with cloud-based data platforms, preferably AWS.
- Strong programming skills in Python and SQL.
- Experience designing and developing ETL/data pipelines.
- Experience designing, developing, and maintaining medium- to large-scale data platforms.
- Experience with Infrastructure as Code for Databricks and related cloud infrastructure.
- Strong understanding of data platform architecture and modern data engineering practices.
- Strong understanding of data governance, data quality, metadata management, and data discoverability.
- Experience implementing governance capabilities within complex data environments.
- Ability to independently drive technical improvements and solve complex platform and data challenges.
- Experience collaborating with both technical and business stakeholders.
- Ability to translate requirements into scalable and production-ready technical solutions.
- Professional working proficiency in English.
Nice to have
- AWS certification.
- Databricks certification.
What We Offer
- Permanent employment at Avaron AB
- Occupational pension
- Wellness allowance of SEK 5,000 per year
Application
Selections are made on an ongoing basis – apply as soon as you can.
- Platser
- Södertälje
Södertälje
Om Avaron AB
Avaron förser företag i hela Sverige med tekniska konsulter och specialister. Vi fokuserar på IT, mjukvaruutveckling, teknik, projektledning och andra tekniska domäner. Grundat 2018 av en mjukvaruingenjör som tröttnade på bemanningsföretag som inte förstod rollerna de rekryterade till.