76 to 100 of 554 ETL Jobs in London

that blends data engineering, data analysis, and stakeholder engagement to mature Sony’s enterprise-wide security risk intelligence capabilities.Key Responsibilities:Build, refine, and maintain ETL pipelines that integrate data from multiple sources while ensuring quality, consistency, and trustworthiness.Develop tools, scripts, and automation to streamline data processing, risk measurement, and platform ...

DBT.Design and code modular data services and APIs that unify campaign, conversion, and audience datasets across 20+ marketing platforms.Build and optimize schemas, transformations, and ETL logic for high-performance, reusable data workflows.Contribute directly to the DFP codebase (Python, SQL, Spark) — developing pipelines and infrastructure alongside the engineering team.Establish data versioning ...

full data lifecycle, delivering enterprise-grade data pipelines and BI solutions using Azure Databricks, Microsoft Fabric, and Power BI. You will design ETL/ELT pipelines, build data products with Delta Lake, and create comprehensive Power BI reports. Strong SQL, Python, and CI/CD experience are essential for this ...

outcomes and value of their work, and have working experience in some of the following:End-to-end development experience with data pipelines, ETL processes, workflow orchestration - using core concepts that apply across tech stacks.Working with diverse data sources and types - batch, streaming, real-time, and unstructured.Systems thinking and architectural ...

teams. You'll also mentor two junior Data Engineers while owning day-to-day technical delivery.Key ResponsibilitiesDesign, build and optimise scalable data pipelines and ETL processesIntegrate internal and external data sources using APIs and scriptingBuild and enhance cloud-based data infrastructure using AWS/GCP and SQLDrive automation and continuous ...

with Azure cloud technologies including Azure OpenAI and Azure AI Foundry. Knowledge of Spark Structured Streaming, Autoloader and modern data engineering practices. Experience with ETL/ELT, data modelling and scalable data architectures. Familiarity with Azure Data Factory, Qlik Replicate and data ingestion pipelines. Does this sound like your next ...

with Azure cloud technologies including Azure OpenAI and Azure AI Foundry. Knowledge of Spark Structured Streaming, Autoloader and modern data engineering practices. Experience with ETL/ELT, data modelling and scalable data architectures. Familiarity with Azure Data Factory, Qlik Replicate and data ingestion pipelines. Does this sound like your next ...

with Azure cloud technologies including Azure OpenAI and Azure AI Foundry. Knowledge of Spark Structured Streaming, Autoloader and modern data engineering practices. Experience with ETL/ELT, data modelling and scalable data architectures. Familiarity with Azure Data Factory, Qlik Replicate and data ingestion pipelines. Does this sound like your next ...

with Azure cloud technologies including Azure OpenAI and Azure AI Foundry. Knowledge of Spark Structured Streaming, Autoloader and modern data engineering practices. Experience with ETL/ELT, data modelling and scalable data architectures. Familiarity with Azure Data Factory, Qlik Replicate and data ingestion pipelines. Does this sound like your next ...

knowledge and collaborate with colleagues in an agile engineering setting. Essential Skills & Experience Strong experience in data engineering, including Python. Experience working with AWS ETL services. Experience querying and managing data held within AWS S3 Experience managing API integrations and database connectivity. Familiarity with GitLab or similar source control and ...

looking for someone who has a passion for realtime data, The Data Scientist must have: • Experience in building complex data pipelines/ETL/ELT scripts • Python/PySpark as our Data pipelines will be built in PySpark • SQL • Knowledge of AWS and components such as S3, Glue, Athena ...

and governance standards are maintained Required experience We're looking for candidates with strong hands-on experience across: Databricks Python SQL Data engineering and ETL/ELT development Data validation and UAT support Code review and quality assurance practices Working within complex data environments Stakeholder management and business-facing communication ...

analytics and forecasting tools. Work on data architecture and data management projects for both new and existing data sources. Design and implement ETL processes to clean, normalize, and store structured and semi-structured data in Snowflake, our core relational data warehouse. Analyze data pipeline performance and implement optimizations to improve ...

Azure Data Factory and Azure Synapse Analytics Microsoft Purview (or a comparable cataloguing and lineage tool) Dimensional modelling, Data Vault, warehouse and lakehouse architecture ETL and data pipeline design and build CoPilot, Claude and OpenAI in day-to-day delivery Nice to Haves: Agentic architecture, putting LLMs to work ...

organisation.QualificationsTechnical Expectations:Proficient in Python, with experience in automation and building data pipelines.Strong expertise in working with tools like DBT and Airflow for ETL processes.Skilled in using REST APIs to develop and manage data integrations.Proficient in SQL and familiar with data visualization tools such as Looker, Superset, PowerBI, or Tableau.Bonus ...

becomes the trusted source for all business reporting. Data Engineering Remain hands-on with the technical implementation of the data platform. Responsibilities include: Designing ETL and ELT pipelines Change Data Capture (CDC) AWS Database Migration Service (DMS) Amazon Redshift optimisation SQL performance tuning Data pipeline monitoring Automation Data lifecycle management ...

experience in enterprise software, with strongexperience in data analytics, business intelligence, dataengineering, data science, or automation.Experience across two or more relevant domains such asanalytics, ETL/ELT, cloud data platforms, AI/ML workflows,automation, or enterprise data architecture.Knowledge of public cloud platforms such as AWS, Azure,or GCP, and ...

your impact and unlock incredible career growth opportunities, join us, and build real world value. What you'll do Design, build, and operate production ETL pipelines on Databricks using Delta Live Tables and Spark, applying medallion architecture patterns across Finance, Payments, Product, and GTM domains. Own data modeling in different ...

functional data initiatives and bring sound judgment to tradeoffs around performance, cost, reliability, and maintainability. What you'll do Design, build, and operate production ETL pipelines on Databricks using Delta Live Tables and Spark, applying medallion architecture patterns across Finance, Payments, Product, and GTM domains. Own data modeling in different ...

warehouses like Google Cloud, Amazon Redshift, Microsoft Azure, etc. Familiar with product analytics implementation methods like SDKs, Customer Data Platforms (CDPs), Event Streaming, Reverse ETL, etc. Familiar with analytics best practices across business segments and verticals Can manage complex projects with assorted client stakeholders, working across teams and departments ...

Experience: 2+ years as a Data Engineer working on data platforms, ideally in product-led or high-growth environments.Technical Skills:Experience building and operating ETL/ELT pipelines.Hands-on experience with modern data stacks — our tech includes Python, SQL, Snowflake, Apache Iceberg, AWS S3, PostgresDB, Airflow, dbt, and Apache Spark ...

Demonstrate excellent communication skills across all channels and levels of recipients including team members, colleagues, clients at all levels including C suite.Experienced hands-on ETL, Snowflake, CI/CD Pipelines, SQL, Data Quality rules and Data-Readiness design and implementation of data platformsExperience in designing and implementing relational data models ...

with the ability to make sound design decisions around agent structure, tool calling, and prompt management.Working knowledge of data pipeline architecture, including SQL schemas, extract-transform-load pipelines, analytical data stores, and data quality frameworks.Deep experience in either developing AI agents—including long-running or workflow-based agents—or data ...

Snowflake, dbt, GitHub, and Airflow in a production environment. Demonstrable experience delivering data engineering or analytics platform programmes. Solid understanding of modern data stacks, ETL pipelines, and cloud‐based data platforms. Experience working within Agile delivery environments. Strong communication skills with the ability to engage engineering teams and senior stakeholders. ...

language (such as R or Python)Bonus skills & attributes Experience with BI/Visualization tools like Tableau, Superset and LookerExperience with data modeling and ETL pipelinesExperience working with product teamsExperience leveraging AI tools to boost efficiency and creativity across the data science workflow — from ideation and coding to analysis and ...