401 to 425 of 628 ETL Jobs in London

QUALIFICATIONHands-on experience with cloud platforms (AWS, Azure, GCP)Well versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow)Practical experience with NLP and/or Search techniquesPrompt engineering, and LLMs for enterprise-scale applications. You have team lead ...

Hands-on experience with cloud platforms (AWS, Azure, GCP) Well-versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have ...

Hands-on experience with cloud platforms (AWS, Azure, GCP) Well versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team ...

automation that measurably reduces manual effort. Experience integrating Salesforce with HubSpot, DealHub, Gainsight, Looker, BigQuery, Ordway, and similar software. Experience leading data migration and ETL efforts (e.g., de-duplication, data cleansing, large-scale imports) as part of platform implementations or system consolidations. Strong business analysis and project management skills: comfortable ...

code generation patterns and the development or use of code generators. Familiarity with data management technologies such as relational or columnar databases, data integration (ETL), or API development Familiarity with data formats such as JSON, XML, Avro, or Google Protocol Buffers Comfort engaging with the algorithms and mathematics behind languages ...

modern application security. Exposure to CI/CD, monitoring or observability tools such as Grafana or ELK is advantageous but not essential. Exposure to ETL concepts, data pipelines, vector stores or AI infrastructure is advantageous but not expected. Strong problem‐solving skills, curiosity and a proactive approach to learning. Comfortable ...

and can audit platform integrations and attribution data. Proficient with JSON or SQL/data modeling best practices. Experience in data activation using reverse ETL tools like Hightouch or Census. Proficient with scripting languages and lambda functions. Has the ability to clearly articulate/present technical topics ...

on. Comfortable with infrastructure as code , ideally Terraform, and hands-on with AWS, for example Lambda, ECS, Glue, S3, RDS. A good grasp of ETL/ELT and orchestration . Experience building or running data integrations and connectors , especially ones that other companies or customers depend on, is a real ...

transformation, and automation scripts and tooling Familiarity with common Python libraries, such as Pandas and Requests. Exposure to workflow automation platforms, data pipelines and ETL processes, security tooling, and either audit or compliance tooling Experience building demo environments or reusable technical tools Experience supporting enterprise or regulated customers Comfortable engaging ...

responsibilities will include: Data Acquisition and Management: Collaborate with internal stakeholders to identify and understand business needs and translate them into actionable data requests. Extract and transform data from various insurance-specific sources (policy systems, claims databases, and market research) using AWS Redshift and ETL tools. Ensure data quality and ...

designers, and product stakeholders to translate ambitious, pioneering ideas into production‐ready platforms. What You Will Do Design, build, and maintain reliable Azure-based ETL/ELT pipelines that deliver clean, documented data to models, APIs, internal applications, dashboards, and Gensler IP. Own the production ML lifecycle on Azure — deployment … including Azure ML, Databricks, Azure Data Factory or Fabric pipelines, Blob/Data Lake storage, and MLflow or similar tooling. Experience building production‐grade ETL/ELT pipelines and supporting ML workloads from ingestion through deployment. Comfort moving between data engineering, machine learning, cloud architecture, infrastructure, and hands‐on data ...

Design and architect end-to-end data solutions , from ingestion and processing through to analytics and visualisation. Design and oversee scalable data pipelines and ETL processes supporting BI, analytics and data science. Develop conceptual, logical and physical data models , including dimensional, relational and Data Vault approaches. Design solutions integrating modern … looking for an experienced Data Architect who can demonstrate: 5+ years' experience in Data Engineering/Data Architecture , with strong experience designing ETL processes, data pipelines and data storage solutions. Previous experience working within a technology, data or management consultancy in a client-facing capacity. Experience leading data engineering projects ...

strong focus on performance, scalability, and data accessibility Engineering Excellence & AutomationEnhance data engineering processes through automation, implementing CI/CD pipelines, and optimizing ETL/ELT flows to improve efficiency and maintainability Be a champion of best development practices on existing and new technologies Collaborate with cross-functional teams … modern data lake/lakehouse architectures (e.g., Apache Iceberg) in cloud environments Strong knowledge of AWS (S3, Redshift) or Azure data services Experience with ETL/ELT processes and data ingestion Proven expertise using transformation tools such as dbt Experience with data pipeline orchestration tools (such as Apache Airflow) Experience ...

data models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with … and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development ...

Redshift/BigQuery/Azure SQL database. Experience with any on-premise SQL database like MS SQL Server, Teradata etc. Clear understanding of one ETL tool (For eg: Matillion, SNP Glue, Fivetran, Informatica). Azure DevOps experience is a plus. Clear understanding of data modeling, data curation, and orchestration Experience … interaction and collaboration with all stakeholders. Knowledge of reinsurance or insurance industry concepts is a plus. Technologies DWH (On-premise or cloud – Snowflake preferable) ETL DBT Nice to haves Azure Devops PowerBI/Tableau SNP Glue/Matillion/FiveTran SAP Key Skills & Behaviours Demonstrates an appropriate level of technical ...

data platforms, governance controls, or shared agent services, with monitoring, support, change control, and lifecycle management.· Set and enforce technical standards for data modelling, ETL or ELT, APIs, testing, deployment, observability, lineage, access, retention, auditability, resilience, and production support, as relevant to the assigned portfolio.· Provide architecture assurance and engineering … frameworks, or AI-enabling infrastructure in production.Deep expertise in at least one of the following areas:Data engineering and pipelines, including cloud data platforms, ETL or ELT, APIs, orchestration, data modelling, automated testing, deployment, observability, incident management, and operational reliability.Data governance and agent infrastructure, including data classification, identity and access ...

and data discovery as well as high proficiency in MS Excel Must have development and definitional knowledge of VBA and PL/SQL and ETL (the fundamental concepts, rather than actual scripting or development, although experience developing is a plus) Exposure to BREs and data mapping exercises Experience in functional ...

stringent business requirements and align with industry best practices, maintaining data integrity and reliability. Design, implement, automate, and maintain large-scale enterprise data ETL (Extract, Transform, Load) processes to streamline data flow and accessibility. Build high-performance algorithms, prototypes, predictive models, and proof of concepts, driving innovation and exploring ...

design and implement a cloud-based data platform. The role requires expertise in Azure data tools and a strong understanding of data modeling and ETL processes. The position is fully remote and offers a competitive salary along with opportunities for professional certification and training. Join a motivated team dedicated ...

team, you will deliver robust, scalable data pipelines and contribute to the modernisation of 7IM’s data platform, tools and processes. You will apply ETL/ELT techniques, develop data models, and implement governance and security standards while collaborating with stakeholders to meet regulatory requirements #J-18808-Ljbffr ...

Data Engineer in London for a 4-month hybrid engagement, with 3 days onsite. You will design, test and maintain scalable data architectures and ETL pipelines, collaborating with data teams to deliver robust data solutions. The role requires strong SQL, Python and experience with distributed data tools like Presto/ ...

reporting and self-service analytics, interfacing with developers and business stakeholders to translate requirements into reliable data pipelines. The role focuses on building ETL/ELT pipelines, optimising datasets for reporting, and applying data quality controls while contributing to data architecture and tooling improvements. #J-18808-Ljbffr ...

Specialist Works is seeking a data engineer to join our fast-moving data activation team. You will own ETL pipelines, ensure data integrity across Azure and Adverity, and write SQL queries to generate reporting outputs. You will collaborate with head of digital delivery, clients, suppliers to deliver bespoke marketing intelligence. ...

determine complex data relationships and requirements. You will also support the wider analytics/ML/assurance team and business by building and supporting ETL pipelines and processes. This is with a Google Cloud Premier Partner that provides services in cloud strategy and migration, cloud hosting, big data, machine learning ...

and transformation solutions, as well as CMOD document migration solutions from OpenText Livelink and other legacy repositories. The successful candidate will build and support ETL, integration, and document ingestion pipelines, while designing, optimising, and troubleshooting complex SQL queries and data processing jobs. They will investigate and resolve data quality, reconciliation ...