15 publicaciones de empleo destacadas en pyspark data engineer (¡Están contratando!)

Senior Data Engineer
Luxoft —En remoto
- Teletrabajo
- Azure
- Informática
- Inglés
2d
Lead Data Engineer (m/f/d)
Allianz —Barcelona, Barcelona provincia
- Jornada completa
- Trabajo híbrido
- Informática
- Azure
- Informática
- Plan de pensiones
5d
Senior Data Engineer (m/f/d)
Allianz —Barcelona, Barcelona provincia
- Jornada completa
- Trabajo híbrido
- Informática
- Azure
- Informática
- Plan de pensiones
5d
Senior Data Scientist I - QuantumBlack, AI by McKinsey
McKinsey & Company —Madrid, Madrid provincia
- Azure
- Doctorado
- Informática
4d
Cloud Data Solutions Engineer
SDG Group —Santiago de Compostela, A Coruña provincia
- Trabajo híbrido
- Azure
- Informática
- AWS
- Oportunidades de crecimiento y desarrollo profesional
Solicitud rápida
Data Scientist & AI - Senior Level
Moffatt & Nichol —Valencia, Valencia provincia
- Jornada completa
- Azure
- Oficina
- Machine learning
Solicitud rápida
Data Specialist Associate
BBVA —Madrid, Madrid provincia
- Jornada completa
- Microsoft Powerpoint
- Microsoft Excel
- Microsoft Access
3d
Lead DevOps Engineer, Madrid
WayOps —Madrid, Madrid provincia
- DevOps
- AWS
- Scripting
Senior Site Reliability Engineer
Prima —Madrid, Madrid provincia
- Teletrabajo
- AWS
- Desarrollo de software
- Python
- Teletrabajo opcional
- Abono gimnasio
Solicitud rápida
Internal Models Portfolio Strategist - Credit Risk
BNP Paribas —Madrid, Madrid provincia
- Jornada completa
- Microsoft Excel
- Inglés
- Máster
AI Architect, Madrid
WayOps —Madrid, Madrid provincia
- Incorporación inmediata
- Teletrabajo
- Azure
- DevOps
- SQL
Senior Machine Learning Site Reliability Engineer
Prima —Madrid, Madrid provincia
- Teletrabajo
- AWS
- Machine learning
- Desarrollo de software
- Abono gimnasio
Solicitud rápida
PySpark Data Engineer
Bluetab Solutions Group —España
- Jornada completa
- Teletrabajo
- Azure
- AWS
- Formación continua
- Seguro médico privado
QA Engineer / Sr. QA Engineer - Machine Learning Platform for E-Commerce
AppIQ Technologies —España
- Jornada completa
- Teletrabajo
- SQL
- AWS
- Grado
- Vacaciones pagadas
Solicitud rápida
Ingeniero/a de Datos (Databricks) - Líder Técnico
Kenos Technology —España
- Jornada completa
- Teletrabajo
- SQL
- Liderazgo
- Python
- Formación continua

Quiero recibir la alerta de empleo más reciente de pyspark data engineer

Al iniciar sesión en tu cuenta, aceptas las Condiciones del servicio de SimplyHired, nuestra Política sobre cookies y nuestra Política de privacidad.

Senior Data Engineer

Luxoft -
En remoto

Solicitar ahora

Detalles del empleo

Hace 2 días

Cualificaciones

Optimización del rendimiento
Elasticsearch
Azure
Informática
Data lake
Big data
Inglés
Sistema operativo Windows
Bash
Arquitectura de microservicios
SQL
Docker
PostgreSQL
Scripting
APIs
ETL
Cloud
Python
Shell Scripting

Descripción completa del empleo

Project description

The primary goal of the project is the modernization, maintenance and development of an eCommerce platform for a big US-based retail company, serving millions of omnichannel customers each week.

Solutions are delivered by several Product Teams focused on different domains - Customer, Loyalty, Search and Browse, Data Integration, Cart.

Current overriding priorities are new brands onboarding, re-architecture, database migrations, migration of microservices to a unified cloud-native solution without any disruption to business.

Responsibilities

We are looking for Data Engineer who will be responsible for designing a solution for a big retail company. The main focus is to support processing of big data volumes and integrate solution to current architecture.

Skills

Must have

Readiness to work until 8.00 pm CET (no need to do overtimes)

Overall years of experience required 8+ (at least 1+ year in a Lead/Architect position)

Strong, recent hands-on expertise with Azure Data Factory and Synapse is a must (3+ years).

Strong expertise in designing and implementing data models, including conceptual, logical, and physical data models, to support efficient data storage and retrieval.

Strong knowledge of Microsoft Azure, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks, pySpark for building scalable and reliable data solutions.

Extensive experience with building robust and scalable ETL/ELT pipelines to extract, transform, and load data from various sources into data lakes or data warehouses.

Ability to integrate data from disparate sources, including databases, APIs, and external data providers, using appropriate techniques such as API integration or message queuing.

Proficiency in designing and implementing data warehousing solutions (dimensional modeling, star schemas, Data Mesh, Data/Delta Lakehouse, Data Vault)

Proficiency in SQL to perform complex queries, data transformations, and performance tuning on cloud-based data storages.

Experience integrating metadata and governance processes into cloud-based data platforms

Certification in Azure, Databricks, or other relevant technologies is an added advantage

Experience with cloud-based analytical databases.

Experience with Azure MI, Azure Database for Postgres, Azure Cosmos DB, Azure Analysis Services, and Informix.

Experience with Python and Python-based ETL tools.

Experience with shell scripting in Bash, Unix or windows shell is preferable.

Demonstrated ability to lead cross-functional engineering teams, define technical strategy and architecture, drive delivery of complex data platforms, mentor engineers, and effectively communicate with stakeholders at all organizational levels.

Nice to have

Experience with Elasticsearch

Familiarity with containerization and orchestration technologies (Docker, Kubernetes).

Troubleshooting and Performance Tuning: Ability to identify and resolve performance bottlenecks in data processing workflows and optimize data pipelines for efficient data ingestion and analysis.

Collaboration and Communication: Strong interpersonal skills to collaborate effectively with stakeholders, data engineers, data scientists, and other cross-functional teams.

Ability to plan, estimate and track progress of implementing features

Computer Science and data science academic and education credentials

Other

Languages

English: B2 Upper Intermediate

Seniority

Lead

Remote Spain, Spain

Req. VR-110316

DWH Development

Cross Industry Solutions

12/06/2026

Req. VR-110316

Solicitar ahora

Refina tu búsqueda

pyspark data engineer empleos

Senior Data Engineer

Lead Data Engineer (m/f/d)

Senior Data Engineer (m/f/d)

Senior Data Scientist I - QuantumBlack, AI by McKinsey

Cloud Data Solutions Engineer

Data Scientist & AI - Senior Level

Data Specialist Associate

Lead DevOps Engineer, Madrid

Senior Site Reliability Engineer

Internal Models Portfolio Strategist - Credit Risk

AI Architect, Madrid

Senior Machine Learning Site Reliability Engineer

PySpark Data Engineer

QA Engineer / Sr. QA Engineer - Machine Learning Platform for E-Commerce

Ingeniero/a de Datos (Databricks) - Líder Técnico

Quiero recibir la alerta de empleo más reciente de pyspark data engineer

Related Searches

Project description

Responsibilities

Skills

Other

Herramientas para candidatos

Herramientas para empresas

Buscar

Mantener la conexión