Data Engineer (Apache Spark – Python / Scala)
ARHS Group Part of AccentureBelvaux, LuxembourgIl y a plus de 30 jours
Description de posteBachelor’s or Master’s degree in Computer Science, Engineering, or a related field 2 to 5 years of experience as a Data Engineer in Big Data environments Strong skills in Apache Spark (Python and / or Scala), SQL, and data integration Comfortable with Git, Airflow, and CI / CD pipelines Experience with REST APIs and object storage (S3 / MinIO) Previous work in on-premises environments (not cloud-based) is appreciated Awareness of data governance topics : data lineage, metadata, PII, data contracts… Fluent in French and English (minimum B2 level) Proactive, detail-oriented, and a strong communicator
We are looking for a Data Engineer (m / f) with solid experience in Big Data environments, particularly using Apache Spark. You will be involved in the design and implementation of robust data pipelines and storage solutions, supporting the data needs of business and technical stakeholders.
Responsibilities :
- Build and optimize data pipelines with Apache Spark (Python and / or Scala)
- Process large-scale batch and streaming datasets
- Work with REST APIs to retrieve and integrate external data
- Collaborate with data scientists and engineers in Agile teams
- Ensure data quality, testing, and monitoring
- Contribute to CI / CD and automation best practices
- Organize and manage data in on-prem object storage
- Promote data governance awareness : data lineage, metadata, PII, data contracts…
Profile :
Créer une alerte emploi pour cette recherche
Data Engineer • Belvaux, Luxembourg
Emplois reliés
![Consultant BI (Tableau) - Asset Management - Luxembourg (CDI) [FR / EN]](https://cdn-logos.talent.com/v1/logo/image?feedcode=jobs-lu&company_name=Adveez%20S%C3%A0rl)
- Offre sponsorisée
ESG - Data Engineer (m|w|d)
DZ PRIVATBANKStrassen, Luxembourg Ihr zukünftiges Aufgabenportfolio : .Ansprechpartner zu internen und externen Fragen im Themenbereich Nachhaltigkeit und ESG.
Identifikation von Potentialen zur technischen Prozessoptimierung, sowie d...Voir plusDernière mise à jour : il y a plus de 30 jours
- Offre sponsorisée
Data Engineer Microsoft (m / f)
BDO LuxembourgLuxembourg, Luxembourg Data Engineer Microsoft (m / f) BDO in Luxembourg is looking for a Data Engineer Microsoft ! Who are we? BDO is present in over 166 countries, and we offer an extensive range of services in the areas...Voir plusDernière mise à jour : il y a plus de 30 jours
- Offre sponsorisée
Hays - Python Developer
HaysLuxembourg Are you looking forward to taking on a new role as a Python Developer? A client located in Luxembourg is currently looking for a Python developer (CDI).
Today, the company has an SME culture, with 2...Voir plusDernière mise à jour : il y a plus de 30 jours
- Offre sponsorisée
Consultant BI (Tableau) - Asset Management - Luxembourg (CDI) [FR / EN]
Adveez SàrlLuxembourg, Luxembourg, Luxembourg A propos de vous Vous etes passionne(e) par la data visualisation et souhaitez evoluer dans le secteur dynamique de la gestion d'actifs ? Rejoignez notre equipe en tant que Consultant Junior Data V...Voir plusDernière mise à jour : il y a 20 jours
- Offre sponsorisée
Senior Software Systems Architect
Thales Alenia Space Luxembourg SàrlBelval, LUXEMBOURG, Luxembourg Who we are You just found your job destination! At Thales Alenia Space, we believe in space as a new horizon to build a more sustainable Life on Earth.
Space-based solutions contribute to connecti...Voir plusDernière mise à jour : il y a 18 jours
- Offre sponsorisée
Data Engineer
Sogeti, part of CapgeminiBertrange, Luxembourg At Sogeti, we believe the best is inside every one of us.Whether you are early in your career or at the top of your game, we’ll encourage you to fulfill your potential to be better.Through our shar...Voir plusDernière mise à jour : il y a plus de 30 jours
- Offre sponsorisée
DEEP - Senior System Engineer (Consultant Field Services)
POST LuxembourgLuxembourg, Luxembourg, Luxembourg Afin de renforcer les équipes de DEEP au sein de Business Line Consulting, nous recherchons actuellement un(e) DEEP - Senior System Engineer (Consultant Field Services) (m / f / n) à temps plein, en qu...Voir plusDernière mise à jour : il y a 18 jours
- Offre sponsorisée
DevOps Engineer / Operator (m / w / d)
Hauck Aufhäuser LampeMunsbach, Luxembourg CHALLENGE YOURSELF : Du möchtest Deine persönliche Entwicklung und berufliche Laufbahn aktiv mitgestalten? Dann bist Du bei uns richtig! Hauck Aufhäuser Lampe ist eine innovative und unabhängige Pri...Voir plusDernière mise à jour : il y a plus de 30 jours
- Offre sponsorisée
Data Engineer (m / f / n)
EnovosEsch-sur-Alzette, Luxembourg At Enovos, we're on a mission to innovate and navigate the fast-moving energy sector, placing data and analysis at the forefront of understanding and anticipating customer behaviours and needs.As a...Voir plusDernière mise à jour : il y a plus de 30 jours
- Offre sponsorisée
IT Database Engineer
Lombard International Assurance S.A.Findel, Grand Duchy of Luxembourg, Luxembourg, Luxembourg About Utmost International Utmost International is a leading provider of insurance-based wealth solutions.Utmost international operates across the UK, Europe Latin America; Asia, and the Middle Eas...Voir plusDernière mise à jour : il y a plus de 30 jours
- Offre sponsorisée
Senior Python Developer (m / f)
ARHS Group Part of AccentureBelvaux, Luxembourg ARHS Group, part of Accenture, you will play a key role in developing and enhancing statistical models for our business clients.
With a focus on clean code, testing, and continuous integration, you’...Voir plusDernière mise à jour : il y a plus de 30 jours
- Offre sponsorisée
System Administrator (m / f) - Weiswampach
ConfiaRH SàrlWeiswampach, Luxembourg Tu as envie de concrétiser des idées digitales dans un environnement créatif et de garantir le bon fonctionnement des systèmes IT ? Alors tu es au bon endroit ! Notre client situé à Weiswampach (LU...Voir plusDernière mise à jour : il y a 15 jours
- Offre sponsorisée
Python Developer (H / F)
Harry Hope.Luxembourg, Luxembourg Harry Hope, cabinet de recrutement accompagne candidats et entreprises dans leurs recherches des meilleures opportunités au Luxembourg et à l'international.
Afin de mieux répondre à vos enjeux, tous...Voir plusDernière mise à jour : il y a plus de 30 jours
- Offre sponsorisée
Python developer M / F
Hays LuxembourgLuxembourg, Luxembourg Are you looking forward to taking on a new role as a Python Developer M / F? A client located in Luxembourg is currently looking for a Python developer (CDI).
Today, the company has an SME culture, wi...Voir plusDernière mise à jour : il y a 26 jours
- Offre sponsorisée
Data Engineer - GenAI Specialist (m / f / n)
EnovosEsch-sur-Alzette, Luxembourg Data Engineer - GenAI Specialist (m / f / n).We are looking for a Generative AI Engineer to join our AI solutions team and deliver production-grade services that combine backend development and secure ...Voir plusDernière mise à jour : il y a plus de 30 jours
- Offre sponsorisée
Business Central Consultant (m / f) - Weiswampach
ConfiaRH SàrlWeiswampach, Luxembourg Tu as envie de donner vie à des idées digitales dans un environnement créatif et de rendre les processus d'entreprise plus intelligents ? Alors ce poste est fait pour toi ! Un client situé à Weis...Voir plusDernière mise à jour : il y a 15 jours
- Offre sponsorisée
Data Engineer - GenAI Specialist (m / f / n)
Enovos Luxembourg S.A.Esch-sur-Alzette (LU), Luxembourg Data Engineer - GenAI Specialist (m / f / n) Department : Energy Business IT| Location : Esch-sur-Alzette| Contract : Permanent | Job Requisitions N°19721 We are looking for a Generative AI Engi...Voir plusDernière mise à jour : il y a plus de 30 jours
- Offre sponsorisée
Treasury Sales Developer (M / F)
Banque Internationale à Luxembourg BILLuxembourg, Luxembourg, Luxembourg Founded in 1856, Banque Internationale à Luxembourg is the oldest multi-business bank in the Grand Duchy.From its foundation, the BIL has always played an active role in the development of the Luxe...Voir plusDernière mise à jour : il y a 17 jours