376 to 400 of 588 ETL Jobs in the UK excluding London

cloud and on‐premises platforms while aligning with enterprise strategy. The role requires extensive hands‐on experience with Azure Data Factory, SQL, Python and ETL/ELT patterns, plus strong stakeholder engagement and governance. Hybrid working two days in the office weekly. #J-18808-Ljbffr ...

experience as a Technical Lead/Lead Engineer delivering data engineering or integration platforms in cloud environments. Strong hands-on experience building production-grade ETL/ELT pipelines and orchestration with Apache Airflow . Solid experience on Google Cloud Platform , such as: Data services (e.g., BigQuery, Cloud Storage, Pub/ ...

requirements; Proven hands-on website, mobile app support and development experience (ideally Angular or Big Commerce) Proven hands-on API development or support experience ETL tools experience Hands-on Azure ADF, logic app, function app, storage accounts development or support experience Hands-on Mobile middleware, IIS solution development, or support ...

skills and experience with SQL Server 2019+ Experience designing relational databases and data models Background working with high-volume transactional databases Experience with ETL processes (SSIS or similar) Strong knowledge of SQL performance tuning and execution plans Experience with SQL Server Agent, backups, disaster recovery, and security Exposure to Azure ...

audience, concisely, and with clarity An understanding of data-centric architectures and solutions that is both broad and in some depth. Data engineering skills - ETL/ELT Technical implementation skills - application of industry best practices & designs patterns Technical advisory skills - experience in researching technological products/services with the intent ...

real‐time data solutions using AWS and other public cloud platformsProviding technical leadership across cross‐functional teams and setting best practice standardsDesigning data models, ETL pipelines, warehousing solutions and distributed systemsBuilding and supporting real‐time streaming platforms using Apache Flink and related technologiesEnsuring compliance with industry standards and government regulationsTracking ...

related field, or equivalent experience. Experience supporting and transitioning legacy systems during major technology migrations. Good knowledge of enterprise architecture, system integrations, APIs, ETL and data governance. Proven ability to lead technical teams and manage multiple projects simultaneously. Benefits of ERP Applications Manager : Hybrid -4 days in office Healthcare Annual ...

data solutions using AWS and other public cloud platforms Providing technical leadership across cross-functional teams and setting best practice standards Designing data models, ETL pipelines, warehousing solutions and distributed systems Building and supporting real-time streaming platforms using Apache Flink and related technologies Ensuring compliance with industry standards and ...

requirements through collaboration with stakeholders, analysts and software developers Essential experience: 7+ years of experience with SQL Working with high-volume transactional database environments ETL development using SSIS or equivalent Database upgrades and migrations Excellent analytical and communication skills Demonstrates taking ownership and accountability when delivering projects to a high ...

skills and experience developing or maintaining scalable automation frameworks. Strong experience across frontend/backend testing, databases including MS SQL and DynamoDB, data validation, ETL and integration testing. Experience with AWS/serverless technologies and a good understanding of software releases, testing risks and QA best practice; ISTQB Foundation ...

lithology). Strong Python programming skills. Experience with Relational Databases. Familiarity of AI/ML and its potential to support geoscience interpretation. Experience with ETL pipelines and data cleaning. Excellent communication and teamwork skills in a collaborative R&D environment. Collaboration & Innovation Work closely with colleagues from multiple disciplines ...

readiness About You Essential Proven experience leading complex technology or transformation workstreams from planning through to cutover and stabilisation Strong expertise in data migration, ETL processes, reconciliation and validation techniques Knowledge of SAP ERP data models and cross-system integration challenges, with a strong understanding of ERP (ideally SAP Public ...

languages (including Python), and commonly used IDE’s Experience with developing, scheduling, maintaining and resolving issues with batch or micro‐batch jobs on AWS ETL or Azure ETL services Experience querying data stored on AWS S3, or through a Lakehouse capability Experience in managing API-level and Database connectivity Experience ...

this role, along with a mindset focused on scalability, reliability, and continuous improvement. What You’ll Do Design, build, and operate end-to-end ETL/ELT pipelines across ingestion, transformation, and serving layers. Architect scalable, reusable data pipelines and frameworks that balance performance, cost, and reliability. Implement incremental loads … governance into pipeline and data model design, including lineage, traceability, ownership, and data quality rules, while ensuring alignment with data classification and compliance requirements. ETL/Data Engineering: Designs, builds, and operates end-to-end ETL/ELT pipelines, including incremental processing, idempotent patterns, and schema evolution, with a focus ...

experience data professional with in-depth skills on AWS Cloud architecture, AWS data services, Data Pipeline automation (with AI integrations desirable) and ETL development (design, build, test and performance tune). Must have knowledge on data modelling techniques, including dimensional models and conformed datasets. As the role is to engage … stakeholders, the individual must have clear and adequate communication with different stakeholders at the various levels of seniority. Knowledge and Experience - essential - AWS Glue ETL - AWS Glue Data Quality - AWS Lambda - AWS Lake Formation - Medallion Architecture based ETL processes using S3, Iceberg and Athena - Azure DevOps/AWS CodeCommit/ ...

Design, develop, and maintain scalable batch and streaming data pipelines using Apache Spark, cloud-native technologies, and modern data platforms Build and optimize ETL/ELT frameworks to ingest, transform, validate, and curate data from diverse enterprise source systems Develop and implement data solutions leveraging Microsoft Fabric, OneLake, Lakehouse, Data … Experience with Microsoft Fabric, OneLake, Lakehouse Architecture, Data Warehouse, and building Semantic Models Strong SQL and data modeling skills Experience building and optimizing ETL/ELT pipelines Strong proficiency in Java and experience building distributed applications and services Experience with Kafka or similar event-streaming platforms Understanding of Data Governance ...

stack, so we’re looking for someone with strong experience across either Microsoft Fabric or Azure data services, alongside solid SQL, data modelling and ETL capabilities. What you’ll be doing Designing and building reliable data pipelines to ingest data from a range of internal and external sources Working with … APIs and other integration methods to establish and maintain data feeds Developing ETL/ELT processes to transform and model data for reporting and analytics Designing appropriate database structures, schemas and data models Ensuring data quality, integrity, security and performance across the data platform Working extensively with SQL and ...

development and optimisation of production-grade data solutions using Databricks, Apache Spark and Delta Lake. Your responsibilities will include: Designing, building and optimising scalable ETL/ELT data pipelines using Databricks, PySpark and Spark SQL Implementing Medallion Architecture patterns across data layers Developing robust data quality, monitoring and alerting processes … complex data solutions. You'll ideally have: Strong commercial experience with Databricks Excellent PySpark, Apache Spark and Spark SQL skills Experience building production-grade ETL/ELT pipelines Strong knowledge of Delta Lake and Lakehouse architecture Experience implementing Medallion/Bronze-Silver-Gold architectures Strong experience with Azure and/ ...

Cosmos DB models, including partitioning, indexing, performance, scalability, and cost. Define and implement data contracts, including schemas, versioning, and validation rules. Design and orchestrate ETL/ELT pipelines using Azure Data Factory. Support data migrations, including mapping, validation, reconciliation, and data quality. Develop and optimise SQL queries, stored procedures, and … NoSQL data modelling knowledge. Strong understanding of data modelling, including schema design, partitioning, indexing, and performance optimisation. Proven experience with Azure Data Factory for ETL/ELT pipeline design, orchestration, and monitoring. Strong SQL skills, including queries, stored procedures, views, and performance tuning. Practical experience supporting data migration projects, including ...

work directly with senior engineers, the Founder, and clients across FinTech, retail, manufacturing, and SaaS. Key Responsibilities Design, build, and maintain robust data pipelines (ETL/ELT) that ingest, clean, transform, and serve data for AI and analytics Model and manage data across data warehouses and lakes and operational databases … Python for data and ML work Advanced SQL and solid experience with relational and non‐relational databases Proven experience building and maintaining data pipelines (ETL/ELT) in production Hands‐on experience developing, training, or fine‐tuning ML models and deploying them into production Practical experience with LLM integration ...

What You'll Do Design, develop, and optimise Azure Databricks solutions using PySpark, Python, SQL, and Azure-native technologies. Build and maintain enterprise-grade ETL/ELT pipelines supporting ingestion, transformation, CDC, validation, and data delivery across multiple business functions. Develop and support Lakeflow pipelines, Delta Lake implementations, and modern … experience designing and delivering solutions within Azure Databricks environments. Strong Python, PySpark, SQL, and T-SQL development skills. Expertise building and supporting large-scale ETL/ELT pipelines and cloud-based data platforms. Strong understanding of Delta Lake, Unity Catalog, data governance principles, and medallion architecture. Experience integrating REST APIs ...

data models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with … and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development ...

Searchability NS&D is seeking a Data Engineer in Manchester to design and operate data pipelines and ETL workflows for national security projects. You will transform diverse data sources into actionable insights while ensuring strict data governance and security compliance. The role requires active eDV clearance (West), a willingness ...

Developer in central Leeds. The role is hybrid with 2 days in the office, and focuses on leading a team across SQL Server, ETL, and data warehousing. You will shape the data platform and drive data initiatives using Microsoft technologies. The successful candidate will combine hands-on engineering with leadership ...

Python and AWS, delivering reliable data, APIs, and ingestion pipelines while supporting frontend work when needed. The role focuses on practical delivery, building ETL/ELT pipelines, exposing data via APIs, and improving platform reliability for reporting and operational use cases. Hybrid working in Belfast is available. #J-18808-Ljbffr ...