Expert Data Engineer (Hadoop/Spark)
Build and evolve big data pipelines for risk and recovery data in a banking environment using Hadoop, Spark and Python/Java.
About the Company
Avaron AB is a growing consultancy focused on technology, finance, and business support. We match your expertise with the market's most interesting assignments, offering a platform where your professional development is central.
About the Assignment
For a client in the banking sector, we are looking for an Expert Data Engineer to support the delivery and movement of risk- and recovery-related data across platforms. You will work in a big data environment where reliable pipelines, integrations and transformations are key to enabling downstream analytics and data marts.
Job Description
- Deliver requested data elements for risk models
- Change the target for recovery data to the Recoveries Datamart
- Transfer application scorecard data from legacy systems
- Design, build and maintain data pipelines, integrations and transformations
- Test, build and deploy data engineering solutions
Requirements
- Expert-level experience with the Hadoop stack (YARN, EMR, Sqoop, Hive, Oozie)
- Expert-level experience with Spark (PySpark)
- Strong skills in Python and Java
- Strong SQL skills, including query writing and package creation
- Hands-on experience with data pipelines, integrations and transformations
- Experience with testing, building and deploying
- Clear credit record
Nice to have
- Kafka
- Experience automating data collection from source systems
- Data warehousing
- Deployment and release planning
Application
Selections are made on an ongoing basis, so we recommend that you apply as soon as possible.
- Platser
- Stockholm
- Distansarbete
- Hybridarbete
Stockholm
Om Avaron AB
Avaron grundades med visionen om att skapa ett konsultbolag där kompetens och livskvalitet går hand i hand. Vi är ett nischat team som idag verkar inom komplexa miljöer såsom bank, finans och storskalig industri.
Som konsult hos oss får du det bästa av två världar: tryggheten och de spännande uppdragen hos stora, etablerade uppdragsgivare, kombinerat med det lilla bolagets snabbhet, transparens och personliga kontakt.
Vi tror inte på krångliga hierarkier eller onödig administration. Istället lägger vi kraften på det som faktiskt betyder något – att leverera värde i våra projekt och att se till att våra medarbetare trivs, utvecklas och har en balans i livet som fungerar på riktigt.