126 to 150 of 159 ETL Jobs in London

coordinate and manage own workload support project delivery. Basic understanding of reporting and audit functions, including viewing activity logs and document histories. Familiarity with ETL tools like FME and GIS integrations. Excellent communication and engagement skills Minimum Qualifications Needed for Role Degree in BIM/Design/Architecture/Civil ...

and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to integrate data from various sources into our data warehouse or data lake. Data Transformation with Python: Write, optimize, and maintain production … and performing performance tuning. Big Data Concepts Foundational understanding of Big Data architecture (Data Lakes, Data Warehouses) and distributed processing concepts (e.g., MapReduce). ETL/ELT Basic knowledge of ETL principles and data modeling (star schema, snowflake schema). Version Control Practical experience with Git (branching, merging, pull requests ...

after-sales service operations, or transportation management. Familiarity with ERP systems like SAP and Oracle and their integration with Kinaxis. Expertise in systems integration, ETL tools, data mapping, and end-to-end implementation processes. Strong organizational skills, with the ability to manage competing priorities in a fast-paced environment. Certifications ...

languages (including Python), and commonly used IDE's Experience with developing, scheduling, maintaining and resolving issues with batch or micro-batch jobs on AWS ETL or Azure ETL services Experience querying data stored on AWS S3 or Azure ADLSv2, or through a Lakehouse capability Experience in managing API-level and ...

Data Analysis & Reporting: Extract, clean, and integrate data from a variety of systems (AWS, procurement systems, etc, Hardware Asset and Software Asset Management) to create accurate and insightful reports. Develop and maintain dashboards and visualisations in Tableau for use by the procurement category manager, stakeholders and the executive team. Ensure … data quality, accuracy, and consistency across all reports and analyses. AWS Reporting Integration: Utilize AWS reporting tools (such as Athena and Cost Explorer) to extract and manipulate data. Combine AWS data with other financial and procurement datasets to create holistic insights across the organisation. Automate data pipelines where possible ...

design of innovative solutions using Palantir software, ensuring scalability and long-term impact. Engineer Data at Scale: Build, optimise, and maintain complex pipelines and ETL processes powering mission-critical decision models. Strategic Workflows: Develop enterprise-grade workflows and decision-support tools that reshape operations across industries. AI Leadership: Guide … with proven expertise in Python, SQL, and TypeScript. Ideally experience with Palantir technologies (Foundry, Gotham, or similar platforms). Advanced knowledge of data engineering, ETL pipelines, and workflow design at enterprise scale. Track record of leading teams, mentoring engineers, and delivering complex projects in client-facing environments. Passion ...

engineering excellence. Key Responsibilities: Break down complex client problem sets and design innovative solutions using Palantir technologies. Build and maintain robust data pipelines and ETL processes. Develop operational workflows and decision-support tools that transform client operations. Collaborate with colleagues to implement AI and machine learning models. Apply strong software … role. Strong skills in Python, SQL, and TypeScript. Experience with Palantir Foundry, Gotham, or comparable data platforms (preferred). Solid understanding of data engineering, ETL pipelines, and workflow orchestration. Interest in AI, machine learning, and emerging technologies. Strong communication skills and a collaborative, consulting mindset. Curiosity, adaptability, and a desire ...

pipelines for a new Data Lake Work with Python, SQL, Spark, AWS, Docker, CI/CD Orchestrate workflows using Airflow, Prefect, or Dagster Support ETL, API integrations, and high-quality data validation Translate business needs into technical solutions with full ownership What You Need STEM degree (Computer Science, Engineering, Maths … etc.) 2+ years in data engineering/analytics/software Strong Python + SQL 2+ years ETL, APIs, CI/CD, Docker, AWS Ideally but not essential experience with Airflow/Prefect/Dagster Background in Financial Services, FinTech, Insurance, PE/VC, or Banking Package & Benefits High performance bonus ...

Description Looking for L3 Data Engineer | Support | Key Skills & Expertise AWS Core Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing ETL pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python) Working with structured/semi-structured telecom datasets (CDRs, network logs … styles, sort keys Workload management (WLM) Performance optimization & troubleshooting Python: Automation scripts Data processing workflows Monitoring, debugging, validation scripts AWS Support/Operations: Troubleshooting ETL failures, performance bottlenecks, pipeline issues Monitoring cloud workloads (CloudWatch, CloudTrail) Handling incidents, root-cause analysis (RCA), patching & releases Cost optimization and resource usage tracking Data ...

Data Engineer - £350PD - Remote Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality frameworks, and reconciliation checks Strong error handling, monitoring, and retry ...

Data Engineer - £350PD - Remote Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality frameworks, and reconciliation checks Strong error handling, monitoring, and retry ...

models. Key Responsibilities Design & Solve: Break down client problem sets and design innovative solutions using Palantir software. Engineer Data: Build and maintain pipelines and ETL processes to power decision-making models. Create Workflows: Develop operational workflows and decision-support tools that transform enterprise operations. Apply AI: Collaborate with colleagues … Engineer with proven expertise in Python, SQL, and TypeScript. Experience with Palantir technologies: Foundry, Gotham, or similar platforms (preferred) Strong understanding of data engineering, ETL pipelines, and workflow design. Passion for AI, machine learning, and emerging technologies. Excellent problem-solving, collaboration, and communication skills. Curiosity, adaptability, and a drive ...

Venture) Information Management Team (IM), where your responsibilities will include ensuring systems integration, designing data modelling processes, and developing algorithms and predictive models to extract the data required by the project. You will also collaborate with teams across the project to support data analysis and share insights. Candidates need … checks. Use FME to support information sharing and provide basic training on FME to project teams. Ensure project team members receive essential instruction on ETL tools (FME). Drive digital transformation by identifying and implementing process and workflow efficiency improvements. Support the integration of project systems with internal and client ...

from the ground up, working directly from Databricks data sources Deliver dashboards covering: Campaign performance Customer health metrics Marketing impact and effectiveness Perform simple ETL and data shaping tasks (circa 20-40% engineering, remainder Power BI) Gather requirements directly from client stakeholders via regular calls Provide clear updates … Power BI experience, including building dashboards from scratch Experience working with Databricks SQL or Python for data extraction and transformation Ability to perform light ETL and data modelling tasks Strong stakeholder communication skills Previous experience delivering new dashboard builds, not just maintaining existing reports Experience working with marketing or customer ...

Agile development using a range of technology to create data pipelines with a focus on Python and Spark; you'll be working with Azure, ETL pipelines and CI/CD, ingesting and analysing terabytes of data with varying structures from a range of sources. You'll be continually learning and … automating wherever possible You're a collaborative problem solver with great communication skills Other technology in the stack includes: FastAPI, Django, Airflow, Kafka, ETL, CI/CD, experience with some or all would be beneficial but you'll pick it up on the job What ...

focused on building and optimising data infrastructure that powers quantitative research, trading strategies, and risk management. Key Responsibilities Develop and maintain scalable Python-based ETL pipelines for ingesting and transforming market data from multiple sources. Design and manage cloud-based data lake solutions (AWS, Databricks) for large volumes of structured … tailored data solutions for modeling and strategy development. Contribute to the design and implementation of the firm's security master database. Analyse datasets to extract actionable insights for trading and risk management. Document system architecture, data flows, and technical processes for transparency and reproducibility. Requirements Strong proficiency in Python (pandas ...

Design & Solve: Break down client challenges and design innovative, data-driven solutions. Engineer Data: Build and maintain robust data pipelines and ETL processes. Create Workflows: Develop operational workflows and decision-support tools that transform enterprise operations. Apply AI: Collaborate on AI and machine learning models applied to real-world challenges. … Python, SQL, and TypeScript . Experience with Palantir technologies (Foundry, Gotham, or similar) is preferred but not essential . Solid understanding of data engineering, ETL pipelines, and workflow design. Passion for AI, machine learning, and emerging technologies. Excellent problem-solving, collaboration, and communication skills. Curiosity, adaptability, and a drive ...

will: Build production-ready, pythonic data pipelines Create data models to organise raw behavioural data Support feature engineering for machine learning workflows Handle ETL processes and data ingestion across clients Identify and resolve data quality issues Work closely with senior technical leadership What we're looking for Outstanding Python skills … 4+ years in data engineering Experience with data cleansing and ETL pipelines Strong event-level/behavioural data experience Able to work independently and make smart technical decisions Nice to have: pandas/polars dbt Django or backend exposure DevOps or data science familiarity Why join Founding-level ownership High ...

building robust data pipelines and integrating complex data sources. This is an outside IR35 engagement, offering flexibility and autonomy. Key Responsibilities Design and implement ETL/ELT pipelines with strong error handling and retry logic. Develop incremental data processing patterns for large-scale datasets. Work with AWS services including Glue … extraction). Integrate data from REST APIs , PIM systems, and potentially SAP. Ensure data quality, governance, and lineage tracking throughout the project. Required Skills ETL/ELT pipeline design and data validation frameworks. Advanced Python (pandas, numpy, boto3) and SQL (complex queries, optimisation). Experience with AWS Glue , Step Functions ...

building robust data pipelines and integrating complex data sources. This is an outside IR35 engagement, offering flexibility and autonomy. Key Responsibilities Design and implement ETL/ELT pipelines with strong error handling and retry logic. Develop incremental data processing patterns for large-scale datasets. Work with AWS services including Glue … extraction). Integrate data from REST APIs , PIM systems, and potentially SAP. Ensure data quality, governance, and lineage tracking throughout the project. Required Skills ETL/ELT pipeline design and data validation frameworks. Advanced Python (pandas, numpy, boto3) and SQL (complex queries, optimisation). Experience with AWS Glue , Step Functions ...

enabling high-quality, accessible data for downstream users. The Role As a Data Engineer, you will: Design, build, and maintain scalable data pipelines and ETL processes Integrate structured and unstructured data from multiple internal and external sources Ensure data quality, consistency, performance, and security across platforms Collaborate with analytics engineers … Responsibilities Build and manage robust data infrastructure for large-scale data ingestion and processing Develop automated, reliable data pipelines aligned to best practices Optimise ETL workflows for performance and scalability Implement data governance, access controls, and security standards Support self-service analytics by enabling clean, well-structured datasets Proactively identify ...

strategies Cloud Migration & Hosting: Lead PostgreSQL migration from on-premises/mainframe to cloud platforms (AWS Aurora preferred), ensuring performance, security, and scalability Integration & ETL Pipelines: Build robust pipelines using CDC Kafka/S3 Aurora with UPSERT/MERGE patterns; guarantee idempotency, ordering, and reliable delivery Data Encoding & Validation: Manage … data modelling Expertise in CDC tools (IBM CDC or similar) and data migration strategies Proven experience in PostgreSQL cloud hosting and migration Proficiency in ETL/ELT pipelines, Kafka, and AWS ecosystem Solid understanding of data encoding, transformation, and validation techniques Familiarity with IaC, CI/CD, and observability frameworks ...

Collibra and data governance practises. Proficiency in data lineage, technical metadata, and data mapping. Excellent stakeholder analysis skills. A solid understanding of data quality, ETL processes, and database administration (DBA). Exceptional communication and collaboration skills, with the ability to work across diverse teams. What You'll Be Doing … Data Governance Analysts and IT teams to capture and maintain technical assets within Collibra. Liaise with various functions including the Data Office, Application Teams, ETL Teams, and DBAs to manage prerequisites for data sources. Design and implement advanced data governance solutions using the Collibra DIP/CDQ platform. analyse stakeholder ...

quality, maintainable code Experience with database backup, replication, recovery, and high-availability strategies Exposure to NoSQL technologies such as MongoDB Experience building or supporting ETL processes and REST API integrations Strong understanding of testing, monitoring, and alerting practices Clear communication skills and the ability to work effectively in a distributed … submit (subject to required skills) your application to our client in conjunction with this vacancy only. KEY SKILLS PostgreSQL, Python, Database Engineering, Data Infrastructure, ETL, REST APIs, MongoDB, Cloud, GCP, Docker, Kubernetes, AI Platforms, Remote Engineering ...

Engineer) Employment Type: Full-Time UK based candidates only. Essential skills required : Designing and implementing the systems of the software. Load operations by using Extract Transform (ETL Process). Developing systems for collecting and processing the data. Should have the ability to research new methods for gaining valuable data and ...