Data Engineer
Neurons Lab —Madrid, Madrid provincia
- Jornada completa
- Teletrabajo
- Inglés
- SQL
- AWS
8d
Expert Manager, Software Engineering (Full Stack)
Bain & Co. —Madrid, Madrid provincia
- Jornada completa
- Español
- Azure
- Informática
Solicitud rápida
JAVA Software engineer for Defense Projects
GMV —Tres Cantos, Madrid provincia
- Trabajo híbrido
- Azure
- DevOps
- Java
- Seguro dental
Senior EmbeddedSoftware Engineer
TechBiz Global GmbH —Madrid, Madrid provincia
- Jornada completa
- Informática
- Máster
- C++
Solicitud rápida
Expert Consultant, Coro, AI Engineer
Bain & Co. —Madrid, Madrid provincia
- Jornada completa
- Azure
- Doctorado
- Informática
- Seguro dental
- Vacaciones pagadas
Solicitud rápida
9d
Python DevOps Security Platform Engineer (m/f/d)
Siemens —Tres Cantos, Madrid provincia
- Jornada completa
- Trabajo híbrido
- DevOps
- Scripting
- APIs
14d
Content Automation Engineer (d/f/m)
Taxfix —Madrid, Madrid provincia
- Horas extra
- Español
- Inglés
- Oficina
Solicitud rápida
Administrador de Amazon Web Services
Sygris —San Sebastián de los Reyes, Madrid provincia
- Jornada completa
- Teletrabajo
- DevOps
- Inglés
- Bases de datos
- Formación continua
- Seguro médico privado
User Enablement Engineer
Roche —Madrid, Madrid provincia
- Jornada completa
- Informática
- DevOps
- Investigación
2d
Staff Software Engineer
Equinix —Madrid, Madrid provincia
- Jornada completa
- DevOps
- Inteligencia artificial
- Python
AWS Data Engineer (IoT & Data)
Galeo Tech —Madrid, Madrid provincia
- Azure
- Máster
- SQL
Principal Performance Engineer (Database & AI Benchmarking)
EDB —Madrid, Madrid provincia
- Teletrabajo
- Scripting
- Linux
- Inteligencia artificial
Solicitud rápida
Content Engineer (d/f/m)
Taxfix —Madrid, Madrid provincia
- Horas extra
- Español
- Inglés
- Oficina
Solicitud rápida
Senior AI Product Engineer
TechBiz Global GmbH —Madrid, Madrid provincia
- Jornada completa
- Teletrabajo
- Azure
- AWS
- Grado
Solicitud rápida
9d
Marketing Operations & Data Specialist
Siemens —Madrid, Madrid provincia
- Jornada completa
- Trabajo híbrido
- JavaScript
- Scripting
- APIs
Software Engineering Manager
Pluxee —Madrid, Madrid provincia
- Jornada completa
- Trabajo híbrido
- Azure
- Informática
- DevOps
Forward Deployed Engineer
InteractiveAI —Madrid, Madrid provincia
- Jornada completa
- Azure
- Salesforce
- Máster
Solicitud rápida
Senior Fullstack Engineer - Lending Team
Ebury —Madrid, Madrid provincia
- Informática
- Inglés
- Oficina
Solicitud rápida
Senior Backend Engineer - AI SaaS
Landbot —Madrid, Madrid provincia
- Jornada completa
- Teletrabajo
- Español
- Azure
- Inglés
- Vacaciones pagadas
- Programa de recomendación
Solicitud rápida
12d
DATA SCIENTIST AND AI ENGINEER WITH DATABRICKS
BIP - Business Integration Partners —Madrid, Madrid provincia
- Jornada completa
- Trabajo híbrido
- Español
- Azure
- Informática
10d

Quiero recibir la alerta de empleo más reciente de stack engineer (python) en madrid, md

Al iniciar sesión en tu cuenta, aceptas las Condiciones del servicio de SimplyHired, nuestra Política sobre cookies y nuestra Política de privacidad.

Data Engineer

Neurons Lab
Madrid, Madrid provincia

Solicitar ahora

Detalles del empleo

Jornada completa
Hace 8 días

Cualificaciones

Data lake
Estructura de datos
Spark
Inglés
SQL
AWS
S3
Redshift
Python

Descripción completa del empleo

About the project (description, duration, stage)

Join Neurons Lab as a Data Engineer on a new engagement with a regulated UK & Ireland credit and lending company. The client has lifted data from multiple business entities into a newly centralized, anonymized data lake, but lacks the data-engineering depth to make it trustworthy and analytics-ready: current pipelines were assembled quickly (partly AI-assisted), and the descriptive statistics cannot yet be validated or reproduced.

You put that foundation on solid ground so the Data Science Lead can model on it with confidence — validate and re-engineer the pipelines, build the harmonization / semantic layer across entities, enforce data quality and lineage, and prepare clean, feature-ready datasets.

This is a foundational data-engineering role on a regulated data estate; data protection and reproducibility are the primary constraints on every decision.

Full-time engagement preferable.

What you'll actually do (example tasks)

Reproduce a descriptive-statistics report end-to-end so any figure traces back to raw source — closing the gap the client admitted (numbers they can't currently defend).
Profile and reconcile differing source schemas across acquired entities: map differing field names, types, encodings and business definitions for the same concept into one conformed model.
Build dbt staging intermediate mart models with tests; codify the harmonized definitions the Data Science Lead specifies.
Write Great Expectations suites (null / range / uniqueness / referential checks) and wire them into the pipeline so bad data fails loudly rather than silently corrupting analysis.
Implement entity / identity resolution (deterministic + fuzzy matching) where there is no clean shared key for the same customer or account across sources.
Implement and verify anonymization / pseudonymization (hashing / tokenization / k-anonymity) and evidence that re-identification risk is controlled for the client's IT / compliance team.
Optimize Spark / Glue jobs over tens of millions of rows — partitioning, file formats (Parquet), incremental loads, cost control.
Orchestrate with Airflow / Step Functions; build repeatable, scheduled pipelines rather than one-off scripts.
Prepare clean, documented, feature-ready datasets for the PD / delinquency models.
Document runbooks so the offshore team can operate the pipelines and handover takes days, not weeks; help scope onboarding of the remaining (Ireland + additional) sources.

Skills

Strong SQL and Python for large-scale data processing
AWS data stack: S3, Glue, Lake Formation, Athena / Redshift, EMR / Spark, Step Functions / Airflow
Data modeling & semantic layer (dbt or equivalent); dimensional modeling
Entity resolution / record linkage across heterogeneous sources
Data-quality & testing frameworks (Great Expectations, dbt tests) and data lineage
Anonymization / pseudonymization techniques and their analytical trade-offs
Big-data processing (Spark) with performance and cost optimization at scale
Clear written / verbal English; documents for handover and works well with a distributed team

Knowledge

GDPR fundamentals as applied to anonymized / pseudonymized financial data and UK / EU data residency
AWS Well-Architected (Analytics, Security) for BFSI
Awareness of credit / risk data structures and what downstream modeling consumers need — a plus

Experience

4+ years in data engineering, with strong AWS + Spark / SQL at scale
Demonstrated experience harmonizing / integrating data across multiple source systems
Experience building validated, reproducible pipelines in a regulated environment (BFSI, healthcare, government) — strong plus
Comfortable stepping into a messy, partly-built data estate and bringing it up to standard
Comfortable as the sole or lead data engineer on a small (3–4 person) delivery pod

Solicitar ahora

Refina tu búsqueda

stack engineer (python) empleos en madrid, md

Data Engineer

Expert Manager, Software Engineering (Full Stack)

JAVA Software engineer for Defense Projects

Senior EmbeddedSoftware Engineer

Expert Consultant, Coro, AI Engineer

Python DevOps Security Platform Engineer (m/f/d)

Content Automation Engineer (d/f/m)

Administrador de Amazon Web Services

User Enablement Engineer

Staff Software Engineer

AWS Data Engineer (IoT & Data)

Principal Performance Engineer (Database & AI Benchmarking)

Content Engineer (d/f/m)

Senior AI Product Engineer

Marketing Operations & Data Specialist

Software Engineering Manager

Forward Deployed Engineer

Senior Fullstack Engineer - Lending Team

Senior Backend Engineer - AI SaaS

DATA SCIENTIST AND AI ENGINEER WITH DATABRICKS

Quiero recibir la alerta de empleo más reciente de stack engineer (python) en madrid, md

Related Searches

About the project (description, duration, stage)

What you'll actually do (example tasks)

Skills

Knowledge

Experience

Herramientas para candidatos

Herramientas para empresas

Buscar

Mantener la conexión