526 to 550 of 588 ETL Jobs in the UK excluding London

will involve building data pipelines and models, integrating diverse data sources, and supporting applications across the Palantir stack. Key responsibilities include: Building and optimising ETL/data pipelines within Palantir Foundry Ingesting, transforming and enriching batch, streaming, real-time and unstructured data Developing logical and physical data models and Foundry … version control and CI/CD Key Skills and Requirements Strong commercial experience with Palantir Foundry Experience with Palantir Gotham Data engineering experience across ETL, pipelines and workflow orchestration Strong understanding of data modelling, Ontology design and database optimisation Experience working with varied data sources and formats Proficiency in Python ...

impact products and customers, this represents an excellent opportunity to make a meaningful contribution. What You'll Be Doing Designing, building and maintaining scalable ETL/ELT pipelines and data processing workflows Developing and optimising data products that transform complex datasets into trusted, consumable assets Building Python-based services and … based data platforms. Strong commercial experience as a Data Engineer, Data Platform Engineer or Python Engineer working with large-scale datasets Designing and developing ETL/ELT pipelines and modern data platforms Experience with AWS-based data platforms AWS services including Glue, Step Functions, Athena, S3 and serverless architectures Data ...

and delivering scalable cloud-based data integration and analytics solutions. Key Responsibilities Design, develop, and maintain Azure-based data integration solutions. Build and support ETL processes, data pipelines, and application interfaces. Develop cloud-native integrations using Azure services including ADF, Synapse, Logic Apps, and Function Apps. Support real-time, batch … and compliance standards are met. Essential Skills Strong experience with Azure services including ADF, Synapse, Logic Apps, and Function Apps. Proficiency in SQL, Python, ETL development, APIs, JSON, and XML. Experience with SQL Server, PostgreSQL, MySQL, and NoSQL databases such as Cosmos DB. Knowledge of REST, SOAP, and messaging technologies. ...

data pipelines powering AI models, machine learning workflows, and intelligent product capabilities Own the reliability, performance, and operational excellence of production data platforms Develop ETL/ELT solutions using Python, SQL, AWS, and modern cloud-based data technologies Implement monitoring, alerting, testing, and data quality processes for trusted datasets Drive … Development AWS Services (S3, Lambda, Glue, Athena) Data Governance and Quality MLOps and AI Solutions ATS Optimization Keywords Hard Skills Data Pipeline Development ETL/ELT Solutions Cloud-Based Data Technologies Data Lineage Dataset Versioning Soft Skills Mentoring Collaboration Influencing Technical Decisions Industry Keywords Data Governance Machine Learning AI Models ...

growing digital and data function based in central Leeds. This exciting opportunity will suit a talented data professional with strong experience across SQL Server, ETL, Data warehousing and modern data platform technologies. You will be joining an established data function of 18 professionals supporting a £650 million revenue organisation with … and professional development, including fully subsidised Microsoft certifications (DP-600/700 etc) Lead SQL Developer Key skills SQL Server/SQL Data Warehousing ETL/ELT Processes Queries, stored procedures, scripts and database objects Data Reporting Microsoft Fabric Azure Data Factory Dataflows Data Lakehouse or Warehouse solutions Python Source ...

growing digital and data function based in central Leeds. This exciting opportunity will suit a talented data professional with strong experience across SQL Server, ETL, Data warehousing and modern data platform technologies. You will be joining an established data function of 18 professionals supporting a £650 million revenue organisation with … and professional development, including fully subsidised Microsoft certifications (DP-600/700 etc) Lead SQL Developer Key skills: * SQL Server/SQL * Data Warehousing * ETL/ELT Processes * Queries, stored procedures, scripts and database objects * Data Reporting * Microsoft Fabric * Azure Data Factory * Dataflows * Data Lakehouse or Warehouse solutions * Python * Source ...

Data Architect - Leading Investment Bank - London/Hybrid (Tech stack: Data Architecture, Enterprise Data Strategy, Data Warehouse, Master Data Management, ERP, CRM, BI, ETL/ELT, Azure Data Factory, Data Lakes, RDBMS, NoSQL, AWS Glue, EMR, Capital Markets Data) Our client is a leading global investment bank with a strong … RDBMS, NoSQL, Data Lakes, AWS Glue, EMR and Azure Data Factory particularly valuable. You will also have a good understanding of data warehousing, ETL/ELT, data integration, data lineage and the wider data engineering landscape. Our client puts people first, giving talented, self-driven professionals the flexibility, rewards and ...

processing (NLP) techniques, and the optimization of large language models for enterprise deployment. **Data Engineering & Cloud Computing:** Strong proficiency in designing optimized ELT/ETL pipelines and managing data lake/data warehouse architectures. Hands‐on experience with Google Cloud Platform (GCP) services including Vertex AI, BigQuery, Cloud SQL, and … Cloud Computing Team Leadership & Mentorship Artificial Intelligence & Machine Learning ATS Optimization Keywords Hard Skills Python SQL Machine Learning Algorithms Natural Language Processing ELT/ETL Pipeline Design Containerization Model Deployment Performance Tracking Hyperparameter Tuning Architecting Complex Systems Soft Skills Autonomy Influence Complex Problem Solving Creativity Ethical Decision Making Certifications & Qualifications ...

At 1st Central, everything starts with our people. As one of the UK’s leading motor and home insurers, we use smart technology, data and great service to make insurance fast, fair and simple for ...

builds the data backbone of our mobile EDR platform. You'll build the systems that ingest data at scale from mobile endpoints, run the ETL and detection pipelines that process it, and architect the extraction of complex data from mobile forensic artefacts. You'll work hand in hand with … Serverless. Key Responsibilities Data Ingestion at Scale: Design, build, and operate pipelines that ingest large volumes of telemetry from mobile endpoints reliably and efficiently. ETL & Detection Pipelines: Build and maintain the ETL processes that transform raw data, and implement the detection logic that runs across it to surface threats. Forensic ...

Develop and implement data migration strategies for SAP projects, ensuring data integrity and quality in line with Global Master Data Governance rules. Oversee the Extract, Transform, Load (ETL) processes, ensuring smooth data transfer from legacy systems to SAP S/4HANA. Ensure data quality and perform data cleansing activities … testing, and end-user training. Extensive experience in implementing SAP solutions, including system configuration, integration, and testing. Proficiency in SAP Data Services and other ETL tools like Syniti. Hands-on experience with SAP S/4HANA data migration and implementation projects. Experience with SAP Integration Suite and other integration tools. ...

and technical direction for a scalable, multi-tenant data integration platform on Google Cloud Platform (GCP). The platform uses Apache Airflow to orchestrate ETL pipelines and enables reliable movement of data from source systems through the platform into downstream vendor systems. You’ll guide the team in building high … observability, security) and ensure consistent adoption across the team. Provide hands‐on contribution where needed (critical ETLs, framework components, design spikes, performance fixes). ETL orchestration & data movement Design and develop robust ETL pipelines orchestrated in Apache Airflow , including scheduling strategies, dependency management, retries, backfills, and processing. Establish patterns ...

permanent role with active Enhanced DV clearance. Hybrid working when possible, on-site in Gloucester when required. You will design and manage data pipelines, ETL processes, and data integration for National Security clients using Apache tools including NiFi, Kafka, and SQL/NoSQL databases like MongoDB. Proficiency in Groovy, Python … Java for ETL, data modeling, and data governance is essential. #J-18808-Ljbffr ...

senior data engineering expert ready to make an impact at a global financial institution? Bring your deep expertise in Ab Initio and ETL development to Citi's Oracle Ledger Data Engineering team, where you'll design and build critical data solutions at the heart of our financial systems. Join … understand complex requirements and deliver robust, high-performance data solutions. This role offers the unique opportunity to not only build and support essential ETL processes but also to innovate by designing automated utilities and providing best-in-class solutions that directly impact Finance Technology operations. If you are a technical ...

future of the organisation’s data capabilities. Key Responsibilities Design and develop scalable AWS-based data lake and data warehouse solutions Build and optimise ETL/ELT pipelines using Python and SQL Migrate data from legacy SQL environments into a cloud-native architecture Essential Skills SQL and Python Hands … experience with: Amazon S3 AWS Glue Amazon Redshift AWS Lambda Athena Data warehouse and data lake design experience ETL/ELT development and optimisation Data migration and integration expertise #J-18808-Ljbffr ...

data infrastructure powering the company's core platform, working across data engineering, AI, data acquisition and product development.Key responsibilities include: Building and maintaining scalable ETL and ELT pipelines using Python and SQL. Developing robust data ingestion and acquisition processes across large and complex datasets. Leveraging LLMs and AI APIs … production deployment with full ownership. YOUR SKILLS AND EXPERIENCE: You will bring strong capability in: Python development. SQL and production data pipeline engineering. ETL/ELT development and large-scale data processing. End-to-end ownership of engineering projects. Working independently in a fast-paced startup environment. Strong problem-solving ...

scope technologies/products: • Google Cloud Platform (GCP) and comparable cloud-based data engineering services • dbt • Python • SQL • ETL/ELT tooling and methodologies • Data modelling and data product development • AI-enabled data development • Testing and validation frameworks • Master Data Management (MDM), including commercial off-the-shelf and bespoke solutions … required: • Expert-level GCP or cloud-based data engineering capability • Advanced practical experience of dbt, Python data engineering and SQL • Strong data modelling and ETL/ELT design skills • Proven end-to-end data product build experience • Experience applying AI-enabled approaches to data development • Strong testing, data validation and ...

scope technologies/products: Google Cloud Platform (GCP) and comparable cloud-based data engineering services dbt Python SQL ETL/ELT tooling and methodologies Data modelling and data product development AI-enabled data development Testing and validation frameworks Master Data Management (MDM), including commercial off-the-shelf and bespoke solutions … required: Expert-level GCP or cloud-based data engineering capability Advanced practical experience of dbt, Python data engineering and SQL Strong data modelling and ETL/ELT design skills Proven end-to-end data product build experience Experience applying AI-enabled approaches to data development Strong testing, data validation and ...

automation and supporting Real Time data streaming capabilities. Responsibilities: Design, develop and maintain scalable data pipelines using Python, Go and Azure Data Factory Develop ETL and ELT processes supporting structured, semi-structured and unstructured data Implement and manage hybrid data solutions across on-premises and Azure environments Build and maintain … technologies such as Keycloak Collaborate with technical teams to deliver resilient, secure and scalable data platforms Skills: Strong commercial Python development experience Experience developing ETL/ELT solutions within enterprise environments Azure Data Factory expertise Experience with Kafka and/or NATS event streaming technologies PostgreSQL administration and development experience ...

influence target-state architecture, data design, technical spikes and platform development from the outset. What you’ll be doing Design and develop scalable ETL/ELT data pipelines across multiple enterprise sources. Build enterprise data solutions using GCP, BigQuery, Google Spanner, Neo4j and Vector Databases. Develop Knowledge Graphs and data … solutions using Python and SQL. Collaborate with AI Engineers, Data Scientists, Architects and Governance teams. What we’re looking for Strong GCP experience. Strong ETL/ELT experience. Experience working with complex, cloud-native data environments. BigQuery experience. Kafka/event-driven architectures. Neo4j/Knowledge Graphs. AI/ ...

influence target-state architecture, data design, technical spikes and platform development from the outset. What you’ll be doing Design and develop scalable ETL/ELT data pipelines across multiple enterprise sources. Build enterprise data solutions using GCP, BigQuery, Google Spanner, Neo4j and Vector Databases. Develop Knowledge Graphs and data … solutions using Python and SQL. Collaborate with AI Engineers, Data Scientists, Architects and Governance teams. What we’re looking for Strong GCP experience. Strong ETL/ELT experience. Experience working with complex, cloud-native data environments. BigQuery experience. Kafka/event-driven architectures. Neo4j/Knowledge Graphs. AI/ ...

influence target-state architecture, data design, technical spikes and platform development from the outset. What you’ll be doing Design and develop scalable ETL/ELT data pipelines across multiple enterprise sources. Build enterprise data solutions using GCP, BigQuery, Google Spanner, Neo4j and Vector Databases. Develop Knowledge Graphs and data … solutions using Python and SQL. Collaborate with AI Engineers, Data Scientists, Architects and Governance teams. What we’re looking for Strong GCP experience. Strong ETL/ELT experience. Experience working with complex, cloud-native data environments. BigQuery experience. Kafka/event-driven architectures. Neo4j/Knowledge Graphs. AI/ ...

holder will be expected to work beyond technology to influence decisions and outcomes for the greater good. Job Details Data Platform Operations: Managing production ETL/ELT pipelines and data orchestration frameworks. Ensuring data platform security, compliance, and access controls. Implementing and governing data quality, lineage, observability, and metadata management. … measures and guarantee the achievement of high-quality outcomes. Skills We Would Love You To Have Proficiency with traditional database and cloud data platform ETL technologies Proficiency with Big Data integration technologies Significant experience of CI/CD, data platform engineering, testing and release principle/best practice Significant experience ...

throughout the full development lifecycle, from design and development through to testing, deployment, and production support. What You’ll Be Doing Developing and maintaining ETL solutions using Talend within established frameworks and standards. Building and supporting Oracle database objects, DDL scripts, and SQL solutions. Enhancing CI/CD processes through … with Lead Engineers and contributing to Agile ceremonies and technical discussions. Essential Skills & Experience Active SC Clearance (transferable within a UK Government environment) Strong ETL development experience, ideally with Talend Experience with alternative ETL tools such as Pentaho or Informatica considered Strong Oracle RDS and SQL development experience Experience creating ...

Voyage Care Ltd is recruiting a Data Engineer to design, build, and maintain scalable ETL/ELT pipelines on the Microsoft Azure platform. You will ensure governed data is available for reporting and analytics and work closely with data engineers, BI developers, and stakeholders to translate requirements into robust solutions. ...