376 to 400 of 450 ETL Jobs in the UK

Deve lop dbt models and SQL transformations for clean, reproducible datasets powering GenAI models. Build embedding pipelines, feature stores, and datasets for finetuning, retrieval, and evaluation. Ensure high-quality ETL/ELT workflows across AWS, Azure, and MongoDB environments. Evaluation & Quality Sy stems Develop automated evaluation frameworks to measure LLM quality, accuracy, hallucinations, tone, and behavioural consistency. Build benchmark datasets … Lambda, Step Function s) an d Azure (ADLS, Data Factory, Azure ML).Understanding of data lakehouse architectures and modern data warehousing. Experience bu ild ing dbt models and maintaining ETL/ELT workflows. Familiarity with embeddings, vector retrieval, evaluation frameworks, and model performance analysis. Experience building datasets and pipelines for LLM training, evaluation, or retrieval systems. Bonus PointsExperience with RAG More ❯

planning, supply planning, S&OP, after-sales service operations, or transportation management. Familiarity with ERP systems like SAP and Oracle and their integration with Kinaxis. Expertise in systems integration, ETL tools, data mapping, and end-to-end implementation processes. Strong organizational skills, with the ability to manage competing priorities in a fast-paced environment. Certifications in Kinaxis Author 3 and More ❯

planning, supply planning, S&OP, after-sales service operations, or transportation management. Familiarity with ERP systems like SAP and Oracle and their integration with Kinaxis. Expertise in systems integration, ETL tools, data mapping, and end-to-end implementation processes. Strong organizational skills, with the ability to manage competing priorities in a fast-paced environment. Certifications in Kinaxis Author 3 and More ❯

engineering across a number of languages (including Python), and commonly used IDE's Experience with developing, scheduling, maintaining and resolving issues with batch or micro-batch jobs on AWS ETL or Azure ETL services Experience querying data stored on AWS S3 or Azure ADLSv2, or through a Lakehouse capability Experience in managing API-level and Database connectivity Experience using source More ❯

engineering across a number of languages (including Python), and commonly used IDE's Experience with developing, scheduling, maintaining and resolving issues with batch or micro-batch jobs on AWS ETL or Azure ETL services Experience querying data stored on AWS S3 or Azure ADLSv2, or through a Lakehouse capability Experience in managing API-level and Database connectivity Experience using source More ❯

entire ecosystem. Key Responsibilities Integration Architecture Define the enterprise-wide integration strategy, including the governance of integration patterns (such as synchronous APIs, event-driven architecture, asynchronous messaging, and batch ETL). Lead the design and documentation of internal and external APIs, ensuring best practice in RESTful design, versioning, and OpenAPI standards. Work with Engineering and Data teams to standardise the … technical approach for messaging, data extraction, transformation, and load (ETL/ELT) processes across underwriting, finance, accounting, and data warehouse systems. Design secure, scalable, and auditable architectures for Generative AI, Agentic AI, and large language model (LLM) technologies. Collaborate with data scientists, engineers, and developers to integrate and deploy AI models from development through to production. Define security standards for More ❯

entire ecosystem. Key Responsibilities Integration Architecture Define the enterprise-wide integration strategy, including the governance of integration patterns (such as synchronous APIs, event-driven architecture, asynchronous messaging, and batch ETL). Lead the design and documentation of internal and external APIs, ensuring best practice in RESTful design, versioning, and OpenAPI standards. Work with Engineering and Data teams to standardise the … technical approach for messaging, data extraction, transformation, and load (ETL/ELT) processes across underwriting, finance, accounting, and data warehouse systems. Design secure, scalable, and auditable architectures for Generative AI, Agentic AI, and large language model (LLM) technologies. Collaborate with data scientists, engineers, and developers to integrate and deploy AI models from development through to production. Define security standards for More ❯

experienced Senior Data Engineer to join the business on a permanent basis and support a major data transformation. As a Senior Data Engineer, youll design and deliver robust, automated ETL pipelines and database solutions that power business-critical insights. Youll use your advanced SQL skills to build and optimise data structures, alongside tools such as Snowflake, Azure, and Python. This … across the data landscape. The role offers a base salary of £60,000 to £75,000 plus strong benefits and flexible working. Key Responsibilities: Design, build, and maintain automated ETL pipelines and high-performance database structures. Manage and enhance a Snowflake ecosystem for streaming and batch workflows. Support the adoption of Generative AI (GenAI) and lead platform innovation with Snowflake … and Microsoft technologies. Skills & Experience: Advanced SQL skills (DDL, DML, query optimisation) with a track record of building efficient, scalable database structures. Strong knowledge of automated ETL processes. Experience with Snowflake, Azure Data Factory, and Azure DevOps. Proficiency in Python for data engineering tasks. Agile delivery experience. Willingness to work with other modern data engineering toolsets. If youre an experienced More ❯

of all data systems and services to ensure best performance, and alignment with business requirements. This will include, but not be limited to enterprise data archiving, data platforming, data ETL, data analytics and reporting technologies and associated infrastructure involved in the provision of all data services across the estate. Currently Police Scotland have guidance in place that allows appropriate roles … Expert knowledge of the development and administration of relational and NoSQL database Systems and Data Warehousing, Business Intelligence concepts and best practices. Expert in architecting, designing, developing and testing ETL solutions. Good working knowledge with data governance principles, data privacy regulations (e.g. GDPR), and data security best practices. Special Aptitudes Desirable Experience with geospatial data preparation and related tools. Knowledge More ❯

analytics team WHAT YOU'LL BRING Essential: 1+ years hands-on Power BI experience Strong DAX skills (measures, calculated columns, complex calculations) SQL knowledge for querying and data structures ETL experience and data pipeline understanding Excellent communication and stakeholder engagement skills Requirements gathering with non-technical stakeholders Data storytelling ability Self-starter with proactive approach Strong interpersonal skills Desirable: PL … certification or equivalent Finance or retail experience Self-service analytics background Modern data architecture knowledge Mathematics or quantitative degree TECH STACK Power BI Desktop & Service, DAX, SQL, ETL tools, modern data architecture (medallion architecture) THE IDEAL CANDIDATE You're a communicator who loves working with business stakeholders. You're comfortable being the face of analytics to finance teams, translating requirements … build Competency interview Possible final discussion Timeline: 2-3 weeks HOW TO APPLY Send CV to Mohammed Buhariwala at Harnham: + Keywords: Power BI Developer, BI Developer, DAX, SQL, ETL, Data Visualisation, Finance, Leicester, Hybrid More ❯

and Project Management teams to scope and deliver projects. Contribute to technical delivery, designing scalable data solutions in Azure/Microsoft environments. Support cloud migrations, data lake builds, and ETL/ELT pipeline development. Ensure delivery follows best practices and internal standards. Skills & Experience Strong leadership and relationship-building skills. Experience guiding or managing technical teams. Deep hands-on experience … in Data Engineering using Microsoft Fabric, Azure Databricks, Synapse, Data Factory, and/or SQL Server. Expertise in SQL and Python for ETL/ELT development. Knowledge of data lakes, medallion lakehouse architecture, and large-scale dataset management. Solid understanding of BI, data warehousing, and database optimisation. To apply for this role please submit your CV or contact Dillon Blackburn More ❯

and Project Management teams to scope and deliver projects. Contribute to technical delivery, designing scalable data solutions in Azure/Microsoft environments. Support cloud migrations, data lake builds, and ETL/ELT pipeline development. Ensure delivery follows best practices and internal standards. Skills & Experience Strong leadership and relationship-building skills. Experience guiding or managing technical teams. Deep hands-on experience … in Data Engineering using Microsoft Fabric, Azure Databricks, Synapse, Data Factory, and/or SQL Server. Expertise in SQL and Python for ETL/ELT development. Knowledge of data lakes, medallion lakehouse architecture, and large-scale dataset management. Solid understanding of BI, data warehousing, and database optimisation. To apply for this role please submit your CV or contact Dillon Blackburn More ❯

a gold-standard medallion architecture. Key Responsibilities Develop and maintain Power BI reports and dashboards Build robust data models and perform data ingestion within Power BI Design and implement ETL processes to support reporting needs Create DAX measures and calculated columns for business intelligence solutions Enable self-service reporting for non-technical users Collaborate with finance and operational stakeholders Support … data science capabilities within the finance team Required Skills & Experience 2-3 years' experience in a Power BI/Data Analyst role Strong experience with: Power BI DAX SQL ETL processes Experience in data modelling and building scalable reporting solutions Excellent stakeholder engagement and communication skills Positive, proactive attitude and strong interpersonal skills Desirable Microsoft PL-300 certification (or working More ❯

/Head of Business Intelligence with some management experience Experience handling large datasets, complex data pipelines, big data processing frameworks and technologies Experience with data modelling, Databricks, data integration ETL processes and designing efficient data structures Strong programming skills in Python, Java, or Scala Data warehousing concepts and dimensional modelling experience Any data engineering skills in Azure Databricks and Microsoft … robust, scalable, and aligned data solutions for delivering high-quality care. The ideal candidate will lead the design and execution of cloud-based based scalable data storage solutions, oversee ETL pipeline development and optimisation, establish and manage data schemas and dictionaries, develop data integration solutions, and lead data cleansing, validation, and enrichment processes. Duties include: Working closely with analysts and … working (2 - 3 days per week in the office). To apply, press apply now or send your CV to Keywords: Head of Data Engineering/Azure Databricks/ETL/Python/data modelling Flexible working - Preston - Blackpool - Manchester - Warrington - Liverpool - Bolton - Blackburn Circle Recruitment is acting as an Employment Agency in relation to this vacancy. Earn yourself a More ❯

improvement and optimisation of integration architecture Administer and maintain robust integrations between enterprise systems (e.g., ERP, CRM, HRIS, data platforms, APIs). Develop and maintain middleware solutions, APIs, and ETL pipelines. Monitor integration performance and troubleshoot issues. Ensure integrations are secure, scalable, and compliant with data governance policies. Create and maintain technical documentation for integrations. Provide support and training to … Integration Architect (desired, but not essential) Familiarity with cloud platforms such as AWS, Azure, or GCP, and DevOps practices Solid understanding of data structures, SQL/NoSQL databases, and ETL processes Strong analytical, problem-solving, and communication skills Good working knowledge of Microsoft 365 tools including Office, Teams, SharePoint, and Outlook Embodies the Audley values: Be Positive, Be the Difference More ❯

analyse existing data structures and design robust migration strategies to move complex datasets to cloud environments. You will develop scripts and automated processes for data extraction, transformation, and loading (ETL), ensuring data quality and integrity throughout the migration process. Working closely with business users and IT teams, you will plan, coordinate, and execute migrations within strict timelines, troubleshoot issues promptly … development, performance tuning, and indexing strategies, enabling accurate and efficient migration from on-premises databases such as SQL Server, Oracle, MySQL, and NoSQL to AWS cloud. Strong knowledge of ETL processes is essential, including experience with tools such as Talend, Informatica, Matillion, Pentaho, MuleSoft, Boomi, or scripting languages like Python, PySpark, and SQL. A solid understanding of data warehousing and … and Snowflake schemas, is required. Ideally you will also have a comprehensive knowledge of AWS glue. To succeed, you will demonstrate proven experience in data engineering, data migration, and ETL development, as well as strong analytical skills to assess data quality, resolve inconsistencies, and manage end-to-end migration projects. Your ability to collaborate with technical and non-technical stakeholders More ❯

Gloucester location - hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation … clients to solve complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data from diverse sources, maintaining data … clearance (West) Willingness to work full time on site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply by clicking online or emailing me directly to . For further information please call me on More ❯

best practices and standards. Support technical delivery when needed, including designing scalable data solutions in Microsoft/Azure environments. Contribute to innovation through cloud migrations, data lakes, and robust ETL/ELT solutions. What We're Looking For Hands-on Data Engineering experience (not Data Analyst or Data Scientist roles). Strong background in Azure Synapse, Databricks, or Microsoft Fabric. … Expertise in ETL/ELT development using SQL and Python. Experience implementing data lakes and medallion lakehouse architecture. Skilled in managing large datasets and writing advanced SQL/Python queries. Solid understanding of BI and data warehousing concepts. Excellent communication skills and ability to build strong relationships. Ideally, experience in consulting environments and working within high-performing teams. The company More ❯

best practices and standards. Support technical delivery when needed, including designing scalable data solutions in Microsoft/Azure environments. Contribute to innovation through cloud migrations, data lakes, and robust ETL/ELT solutions. What We're Looking For Hands-on Data Engineering experience (not Data Analyst or Data Scientist roles). Strong background in Azure Synapse, Databricks, or Microsoft Fabric. … Expertise in ETL/ELT development using SQL and Python. Experience implementing data lakes and medallion lakehouse architecture. Skilled in managing large datasets and writing advanced SQL/Python queries. Solid understanding of BI and data warehousing concepts. Excellent communication skills and ability to build strong relationships. Ideally, experience in consulting environments and working within high-performing teams. The company More ❯

experience including cross-platform communication technologies such as Web API. 3+ years of experience with SQL Server, writing SQL queries, data matching/cleansing/enriching as well as ETL/data pipeline engineering. A demonstrable track record of building and launching successful products that leverage terabytes of data. Ability to analyse technical requirements and design new architectures, data models … and ETL strategies. Expertise in database design, complex T-SQL programming, performance tuning, and index analysis. Hands-on experience with cloud-based relational and non-relational databases. Facilitate discussions among developers to exchange ideas and introduce innovative technologies. Evaluate emerging technologies to identify opportunities, trends, and best practices that can be leveraged to strengthen CoStar’s technology platform and development More ❯

Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you … the following: - Team leadership and guidance - Data engineering and aligning of data to business needs - Cloud technologies (Azure/AWS) - Understanding of Agile methodology - Data warehousing and Data Lakes - ETL/ELT - DevOps understanding - API integrations More ❯

Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you … the following: - Team leadership and guidance - Data engineering and aligning of data to business needs - Cloud technologies (Azure/AWS) - Understanding of Agile methodology - Data warehousing and Data Lakes - ETL/ELT - DevOps understanding - API integrations More ❯

Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you … the following: - Team leadership and guidance - Data engineering and aligning of data to business needs - Cloud technologies (Azure/AWS) - Understanding of Agile methodology - Data warehousing and Data Lakes - ETL/ELT - DevOps understanding - API integrations More ❯

Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you … the following: - Team leadership and guidance - Data engineering and aligning of data to business needs - Cloud technologies (Azure/AWS) - Understanding of Agile methodology - Data warehousing and Data Lakes - ETL/ELT - DevOps understanding - API integrations More ❯

Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you … the following: - Team leadership and guidance - Data engineering and aligning of data to business needs - Cloud technologies (Azure/AWS) - Understanding of Agile methodology - Data warehousing and Data Lakes - ETL/ELT - DevOps understanding - API integrations More ❯