76 to 100 of 619 ETL Jobs in London

used in business or production contexts. Technical Skills Programming: Python, SQL, PySpark Data Platforms: Leading data analytics platforms (e.g., data lakehouses) Data Engineering: ETL/ELT, Data Modeling, Data Quality, Performance Optimization AI Development: Agent workflows, prompt engineering, context engineering, validation patterns Development Tools: Git, GitHub Core Competencies Critical thinking ...

engineering in production environments, with strong, idiomatic Python used for reliable, well-tested systems (not exploratory notebooks).• Design and operation of large-scale ETL/ELT pipelines, including orchestration (Airflow, Prefect, or similar) and reliability patterns such as retries, backfills, and exactly-once semantics.• Deep experience with Azure, including ...

with AWS services including S3, Redshift, Sagemaker, EMR, Kinesis, Lambda, and EC2- Knowledge of general AI tools- Knowledge of data engineering pipelines, cloud solutions, ETL management, databases, visualizations and analytical platforms- Experience with data analytics platforms (Power BI, Python, SQL, Tableau), or experience working with large-scale data mining and ...

structure.)Full-stack data platform judgement. Comfortable across ingestion (CDC/replication from operational databases, event pipelines), transformation (dbt), and consumption (BI tools, reverse ETL, AI/agent access) — even where you're not the one writing every layer.Strong architecture and code review. You set technical direction through sound data ...

highest levels. Job Responsibilities Data Engineering Own the architecture, quality, and scalability of Proximie’s data platform. Lead the team building and maintaining ETL/ELT pipelines, data warehousing, and analytics infrastructure. Set engineering standards, tooling decisions, and technical direction across the data stack (Python, SQL, DBT, AWS: S3, Glue ...

technical stakeholdersStrong problem-solving and analytical skillsExperience with Oracle, SQL Server, Postgres, MySQL, and NoSQL databasesHands on experience with other data replication or ETL toolsExperience with self-hosted software applications and supporting infrastructureHands on networking experience both in the cloud and on-premiseBonus SkillsExperience developing partner relationshipsSpecialized expertise in security ...

database technologies e.g. Azure SQL or SQL Server, PostgreSQL, Snowflake, MySQL, Cosmos DB or Mongo DB Databricks and Azure DevOps ELT/ETL tools such as Azure Data Factory and Databricks Over time you will help to build and configure data ingestion methods from APIs, flat files, streaming, public data ...

priorities, translating technical concepts into business insightsOperational Excellence & Standards: Ensure scalable, stable data operations using best practices in automation, observability, and continuous improvementRequirementsAdvanced SQL, ETL/ELT frameworks, and cloud data platforms such as Azure, AWS, or GCPData modelling and pipeline orchestration using tools such as Airflow, Data Factory ...

that blends data engineering, data analysis, and stakeholder engagement to mature Sony’s enterprise-wide security risk intelligence capabilities.Key Responsibilities:Build, refine, and maintain ETL pipelines that integrate data from multiple sources while ensuring quality, consistency, and trustworthiness.Develop tools, scripts, and automation to streamline data processing, risk measurement, and platform ...

language (such as R or Python)Bonus skills & attributes Experience with BI/Visualization tools like Tableau, Superset and LookerExperience with data modeling and ETL pipelinesExperience working with product teamsExperience leveraging AI tools to boost efficiency and creativity across the data science workflow — from ideation and coding to analysis and ...

outcomes and value of their work, and have working experience in some of the following:End-to-end development experience with data pipelines, ETL processes, workflow orchestration - using core concepts that apply across tech stacks.Working with diverse data sources and types - batch, streaming, real-time, and unstructured.Systems thinking and architectural ...

with Azure cloud technologies including Azure OpenAI and Azure AI Foundry. Knowledge of Spark Structured Streaming, Autoloader and modern data engineering practices. Experience with ETL/ELT, data modelling and scalable data architectures. Familiarity with Azure Data Factory, Qlik Replicate and data ingestion pipelines. Does this sound like your next ...

with Azure cloud technologies including Azure OpenAI and Azure AI Foundry. Knowledge of Spark Structured Streaming, Autoloader and modern data engineering practices. Experience with ETL/ELT, data modelling and scalable data architectures. Familiarity with Azure Data Factory, Qlik Replicate and data ingestion pipelines. Does this sound like your next ...

with Azure cloud technologies including Azure OpenAI and Azure AI Foundry. Knowledge of Spark Structured Streaming, Autoloader and modern data engineering practices. Experience with ETL/ELT, data modelling and scalable data architectures. Familiarity with Azure Data Factory, Qlik Replicate and data ingestion pipelines. Does this sound like your next ...

with Azure cloud technologies including Azure OpenAI and Azure AI Foundry. Knowledge of Spark Structured Streaming, Autoloader and modern data engineering practices. Experience with ETL/ELT, data modelling and scalable data architectures. Familiarity with Azure Data Factory, Qlik Replicate and data ingestion pipelines. Does this sound like your next ...

knowledge and collaborate with colleagues in an agile engineering setting. Essential Skills & Experience Strong experience in data engineering, including Python. Experience working with AWS ETL services. Experience querying and managing data held within AWS S3 Experience managing API integrations and database connectivity. Familiarity with GitLab or similar source control and ...

looking for someone who has a passion for realtime data, The Data Scientist must have: • Experience in building complex data pipelines/ETL/ELT scripts • Python/PySpark as our Data pipelines will be built in PySpark • SQL • Knowledge of AWS and components such as S3, Glue, Athena ...

and governance standards are maintained Required experience We're looking for candidates with strong hands-on experience across: Databricks Python SQL Data engineering and ETL/ELT development Data validation and UAT support Code review and quality assurance practices Working within complex data environments Stakeholder management and business-facing communication ...

Data Engineer within production environments. Strong hands-on experience with Databricks, Apache Spark, Delta Lake, Python and SQL. Experience building and supporting scalable ETL/ELT pipelines. Strong understanding of distributed data processing and data modelling. Cloud platform experience across Azure, AWS or GCP. Experience implementing data quality frameworks and ...

Azure Data Factory and Azure Synapse Analytics Microsoft Purview (or a comparable cataloguing and lineage tool) Dimensional modelling, Data Vault, warehouse and lakehouse architecture ETL and data pipeline design and build CoPilot, Claude and OpenAI in day-to-day delivery Nice to Haves: Agentic architecture, putting LLMs to work ...

Responsibilities: Design, build and test data products from multiple source system feeds using a range of storage technologies and access methods. Develop and maintain ETL processes and data models, including reverse engineering data models from live systems. Undertake data profiling and source system analysis, presenting clear insights to colleagues ...

technical skills and experience:Extensive expertise in modern cloud data platforms (Azure preferred).Strong experience designing and building enterprise-grade Data Lakes/Lakehouses, ETL/ELT, streaming, and distributed compute.Expertise in SQL, Python, data modelling, metadata management, data cataloguing and lineage.Strong understanding of governance, security, compliance and data quality ...

organisation.QualificationsTechnical Expectations:Proficient in Python, with experience in automation and building data pipelines.Strong expertise in working with tools like DBT and Airflow for ETL processes.Skilled in using REST APIs to develop and manage data integrations.Proficient in SQL and familiar with data visualization tools such as Looker, Superset, PowerBI, or Tableau.Bonus ...

becomes the trusted source for all business reporting. Data Engineering Remain hands-on with the technical implementation of the data platform. Responsibilities include: Designing ETL and ELT pipelines Change Data Capture (CDC) AWS Database Migration Service (DMS) Amazon Redshift optimisation SQL performance tuning Data pipeline monitoring Automation Data lifecycle management ...

QualificationsTechnical Expectations: Proficient in Python, with experience in automation and building data pipelines. Strong expertise in working with tools like DBT and Airflow for ETL processes. Skilled in using REST APIs to develop and manage data integrations. Proficient in SQL and familiar with data visualization tools such as Looker, Superset ...