426 to 450 of 1,138 Data Pipeline Jobs in the UK excluding London

technology strategies with business objectives. Embedding architecture best practice and governance across multiple channels and product lines. Innovating with new technologies and driving continuous improvement across digital and data platforms. Coaching and supporting teams to adopt iterative, collaborative design approaches. Main Skills Needed: Minimum of … years of experience in solution architecture and design governance, ideally in financial services or Insurance. Strong understanding of AWS cloud architecture, data lakes, and data pipeline design. Proven experience commercially leveraging AI to drive business outcomes. Broad technical expertise across digital, security, data, and application architectures. Experience with Databricks or Snowflake would be More ❯

technology strategies with business objectives. Embedding architecture best practice and governance across multiple channels and product lines. Innovating with new technologies and driving continuous improvement across digital and data platforms. Coaching and supporting teams to adopt iterative, collaborative design approaches. Main Skills Needed: Minimum of … years of experience in solution architecture and design governance, ideally in financial services or Insurance. Strong understanding of AWS cloud architecture, data lakes, and data pipeline design. Proven experience commercially leveraging AI to drive business outcomes. Broad technical expertise across digital, security, data, and application architectures. Experience with Databricks or Snowflake would be More ❯

technology strategies with business objectives. Embedding architecture best practice and governance across multiple channels and product lines. Innovating with new technologies and driving continuous improvement across digital and data platforms. Coaching and supporting teams to adopt iterative, collaborative design approaches. Main Skills Needed: Minimum of … years of experience in solution architecture and design governance, ideally in financial services or Insurance. Strong understanding of AWS cloud architecture, data lakes, and data pipeline design. Proven experience commercially leveraging AI to drive business outcomes. Broad technical expertise across digital, security, data, and application architectures. Experience with Databricks or Snowflake would be More ❯

Data Engineer Leeds (hybrid, minimum three days per week on-site) Competitive, plus bonus and benefits Why Apply? We're looking for a skilled Data Engineer to help shape the future of data within a leading organisation. This is an exciting opportunity to contribute to building a product led engineering team that delivers lasting … impact. This is not an analytics focused role, it's about engineering excellence, Python first development, and operating data platforms in a production environment. If you're motivated by solving complex engineering problems, driving best practice, and working in a business cultivating a robust in-house team, this role could be the next step for you. Data Engineer Responsibilities: Design, build, and optimise data pipelines in Python, PySpark, SparkSQL, and Databricks. Ingest, transform, and enrich structured, semi structured, and unstructured data. Operate and support production grade data systems with strong observability and monitoring. Enable real time and batch data processing for analytics and business applications. Collaborate with Product Managers More ❯

Data Engineer Leeds (hybrid, minimum three days per week on-site) Competitive, plus bonus and benefits Why Apply? We're looking for a skilled Data Engineer to help shape the future of data within a leading organisation. This is an exciting opportunity to contribute to building a product led engineering team that delivers lasting … impact. This is not an analytics focused role, it's about engineering excellence, Python first development, and operating data platforms in a production environment. If you're motivated by solving complex engineering problems, driving best practice, and working in a business cultivating a robust in-house team, this role could be the next step for you. Data Engineer Responsibilities: Design, build, and optimise data pipelines in Python, PySpark, SparkSQL, and Databricks. Ingest, transform, and enrich structured, semi structured, and unstructured data. Operate and support production grade data systems with strong observability and monitoring. Enable real time and batch data processing for analytics and business applications. Collaborate with Product Managers More ❯

Data Analyst - Matillion £475 - 525 Inside IR via umbrella 6 months Gloucestershire - twice a week on site We're looking for a Data Analyst who can bridge the gap between technical detail and business insight. This role is perfect for someone who enjoys working with non-technical stakeholders, translating complex data requirements into clear … actionable outcomes that drive smarter decision-making. You'll play a hands on role in data analysis, transformation and root-cause investigation helping the business get to the "why" behind the numbers. We need someone who's confident navigating modern data stacks and comfortable turning raw data into meaningful intelligence. What you'll be … doing: Partnering closely with non-technical teams to understand and define data requirements Translating business questions into SQL queries, reports, and dashboards Performing root-cause analysis to identify data quality or process issues Working with Matillion ETL to design, optimise and maintain data pipelines Supporting the development and maintenance of Snowflake based data More ❯

What's the Opportunity Join our dynamic Digital Engineering team at Ridge as a Data Analyst/Engineer, where you'll play a pivotal role in transforming data into actionable insights that drive innovation across our projects. You'll work closely with multidisciplinary teams to develop and maintain robust data pipelines, implement advanced analytics … integration of digital tools that enhance design, delivery, and operational efficiency. This is a unique opportunity to contribute to cutting-edge engineering solutions while shaping the future of data-driven decision-making in the built environment. We operate an agile working policy, but please note this opportunity will require weekly attendance at a major project site on the … Bristol, Winchester, Reading, London, or Birmingham) subject to ability to travel to Oxford. What you need to do to be effective in this role Develop, maintain, and optimise data pipelines to support digital workflows across engineering and design projects. Collaborate with multidisciplinary teams to understand data requirements and deliver tailored analytical solutions. Clean, transform, and analyse More ❯

Fimador is currently recruiting for a Principal Data Engineer to join a team developing cutting-edge … data-driven products. This role is helping the firm pioneer AI and ML in the global environment. This role is central to designing and maintaining scalable pipelines, data platforms, and integrations, while ensuring solutions meet regulatory standards and align with architectural best practices. Key Responsibilities: Build and optimise scalable data pipelines using Databricks and … backlog refinement. Promote engineering best practices including CI/CD, code reviews, and testing. Research and introduce new tools, technologies, and methodologies. Ideal experience: Experience with efficient, reliable data pipelines that improve time-to-insight. Knowledge of secure, auditable, and compliant data workflows. Know how on optimising performance and reducing costs through Spark and Databricks tuning. More ❯

Fimador is currently recruiting for a Principal Data Engineer to join a team developing cutting-edge … data-driven products. This role is helping the firm pioneer AI and ML in the global environment. This role is central to designing and maintaining scalable pipelines, data platforms, and integrations, while ensuring solutions meet regulatory standards and align with architectural best practices. Key Responsibilities: Build and optimise scalable data pipelines using Databricks and … backlog refinement. Promote engineering best practices including CI/CD, code reviews, and testing. Research and introduce new tools, technologies, and methodologies. Ideal experience: Experience with efficient, reliable data pipelines that improve time-to-insight. Knowledge of secure, auditable, and compliant data workflows. Know how on optimising performance and reducing costs through Spark and Databricks tuning. More ❯

Fimador is currently recruiting for a Principal Data Engineer to join a team developing cutting-edge … data-driven products. This role is helping the firm pioneer AI and ML in the global environment. This role is central to designing and maintaining scalable pipelines, data platforms, and integrations, while ensuring solutions meet regulatory standards and align with architectural best practices. Key Responsibilities: Build and optimise scalable data pipelines using Databricks and … backlog refinement. Promote engineering best practices including CI/CD, code reviews, and testing. Research and introduce new tools, technologies, and methodologies. Ideal experience: Experience with efficient, reliable data pipelines that improve time-to-insight. Knowledge of secure, auditable, and compliant data workflows. Know how on optimising performance and reducing costs through Spark and Databricks tuning. More ❯

Senior Data & ML Engineer? Cardiff/London? £90,000 - £100,000 DOE What You'll Do: Take the lead on building and scaling large-scale web scraping and data ingestion systems that form the core of an AI-driven product suite used by major enterprise clients. From crawling hundreds of dynamic sources to powering downstream LLM … features, your work will be the foundation of everything the platform delivers. You'll own projects end-to-end - designing data pipelines, integrating with vector databases, and deploying intelligent features using Retrieval-Augmented Generation (RAG) and fine-tuned LLMs. What You'll Bring: Deep hands-on experience with web scraping tools and frameworks (Scrapy, Playwright, Puppeteer, etc.) 5+ … Strong Python skills and comfort working across complex ingestion workflows Experience managing NoSQL and vector databases at scale (MongoDB, Weaviate, Pinecone, etc.) Solid understanding of modern data pipeline tools (Airflow, Prefect, Dagster) Practical experience with LLM development, embeddings, and RAG architectures Familiarity with distributed systems and cloud platforms (AWS, GCP, or Azure) Self-motivated and capable of More ❯

Senior Data & ML Engineer ?? Cardiff/London ?? £90,000 - £100,000 DOE What You'll Do: Take the lead on building and scaling large-scale web scraping and data ingestion systems that form the core of an AI-driven product suite used by major enterprise clients. From crawling hundreds of dynamic sources to powering downstream LLM … features, your work will be the foundation of everything the platform delivers. You'll own projects end-to-end - designing data pipelines, integrating with vector databases, and deploying intelligent features using Retrieval-Augmented Generation (RAG) and fine-tuned LLMs. What You'll Bring: Deep hands-on experience with web scraping tools and frameworks (Scrapy, Playwright, Puppeteer, etc.) 5+ … Strong Python skills and comfort working across complex ingestion workflows Experience managing NoSQL and vector databases at scale (MongoDB, Weaviate, Pinecone, etc.) Solid understanding of modern data pipeline tools (Airflow, Prefect, Dagster) Practical experience with LLM development, embeddings, and RAG architectures Familiarity with distributed systems and cloud platforms (AWS, GCP, or Azure) Self-motivated and capable of More ❯

Job Title : Lead Data & Machine Learning Architect Location : Yate (On-Site 2 Days Per Week) Salary : Up to £60,000 (Depending on Experience) Overview of Business: This is a chance to join a team who are creating an Energy Management Solutions to minimise energy cost & increase higher returns from energy assets. We are seeking a highly skilled Lead … Data & Machine Learning Architect to design and lead the development of robust data and machine learning systems. You will take ownership of the data architecture, drive the development and deployment of machine learning models, and contribute to the strategic use of data across the organisation. Key Responsibilities: Data Architecture Schema … Model Ownership: Design, implement, and maintain logical and physical data models, primarily using PostgreSQL. Data Integration: Build and manage robust data pipelines to ingest, clean, and unify data from APIs, sensors, and other external sources, using tools like Dagster. System Design: Select appropriate storage and processing technologies tailored to system needs. Governance More ❯

Job Title : Lead Data & Machine Learning Architect Location : Yate (On-Site 2 Days Per Week) Salary : Up to £60,000 (Depending on Experience) Overview of Business: This is a chance to join a team who are creating an Energy Management Solutions to minimise energy cost & increase higher returns from energy assets. We are seeking a highly skilled Lead … Data & Machine Learning Architect to design and lead the development of robust data and machine learning systems. You will take ownership of the data architecture, drive the development and deployment of machine learning models, and contribute to the strategic use of data across the organisation. Key Responsibilities: Data Architecture Schema … Model Ownership: Design, implement, and maintain logical and physical data models, primarily using PostgreSQL. Data Integration: Build and manage robust data pipelines to ingest, clean, and unify data from APIs, sensors, and other external sources, using tools like Dagster. System Design: Select appropriate storage and processing technologies tailored to system needs. Governance More ❯

Job Title : Lead Data & Machine Learning Architect Location : Yate (On-Site 2 Days Per Week) Salary : Up to £60,000 (Depending on Experience) Overview of Business: This is a chance to join a team who are creating an Energy Management Solutions to minimise energy cost & increase higher returns from energy assets. We are seeking a highly skilled Lead … Data & Machine Learning Architect to design and lead the development of robust data and machine learning systems. You will take ownership of the data architecture, drive the development and deployment of machine learning models, and contribute to the strategic use of data across the organisation. Key Responsibilities: Data Architecture Schema … Model Ownership: Design, implement, and maintain logical and physical data models, primarily using PostgreSQL. Data Integration: Build and manage robust data pipelines to ingest, clean, and unify data from APIs, sensors, and other external sources, using tools like Dagster. System Design: Select appropriate storage and processing technologies tailored to system needs. Governance More ❯

Job Title : Lead Data & Machine Learning Architect Location : Yate (On-Site 2 Days Per Week) Salary : Up to £60,000 (Depending on Experience) Overview of Business: This is a chance to join a team who are creating an Energy Management Solutions to minimise energy cost & increase higher returns from energy assets. We are seeking a highly skilled Lead … Data & Machine Learning Architect to design and lead the development of robust data and machine learning systems. You will take ownership of the data architecture, drive the development and deployment of machine learning models, and contribute to the strategic use of data across the organisation. Key Responsibilities: Data Architecture Schema … Model Ownership: Design, implement, and maintain logical and physical data models, primarily using PostgreSQL. Data Integration: Build and manage robust data pipelines to ingest, clean, and unify data from APIs, sensors, and other external sources, using tools like Dagster. System Design: Select appropriate storage and processing technologies tailored to system needs. Governance More ❯

Job Title : Lead Data & Machine Learning Architect Location : Yate (On-Site 2 Days Per Week) Salary : Up to £60,000 (Depending on Experience) Overview of Business: This is a chance to join a team who are creating an Energy Management Solutions to minimise energy cost & increase higher returns from energy assets. We are seeking a highly skilled Lead … Data & Machine Learning Architect to design and lead the development of robust data and machine learning systems. You will take ownership of the data architecture, drive the development and deployment of machine learning models, and contribute to the strategic use of data across the organisation. Key Responsibilities: Data Architecture Schema … Model Ownership: Design, implement, and maintain logical and physical data models, primarily using PostgreSQL. Data Integration: Build and manage robust data pipelines to ingest, clean, and unify data from APIs, sensors, and other external sources, using tools like Dagster. System Design: Select appropriate storage and processing technologies tailored to system needs. Governance More ❯

Job Title : Lead Data & Machine Learning Architect Location : Yate (On-Site 2 Days Per Week) Salary : Up to £60,000 (Depending on Experience) Overview of Business: This is a chance to join a team who are creating an Energy Management Solutions to minimise energy cost & increase higher returns from energy assets. We are seeking a highly skilled Lead … Data & Machine Learning Architect to design and lead the development of robust data and machine learning systems. You will take ownership of the data architecture, drive the development and deployment of machine learning models, and contribute to the strategic use of data across the organisation. Key Responsibilities: Data Architecture Schema … Model Ownership: Design, implement, and maintain logical and physical data models, primarily using PostgreSQL. Data Integration: Build and manage robust data pipelines to ingest, clean, and unify data from APIs, sensors, and other external sources, using tools like Dagster. System Design: Select appropriate storage and processing technologies tailored to system needs. Governance More ❯

Job Title: Senior Data Manager Duration: long-term contract Location: UK Based Hybrid (x3 days from Birmingham) Overview: We’re looking for a hands-on Senior Data Manager to design, build, and optimize scalable data pipelines and infrastructure for global banking projects. You’ll lead a team, drive engineering best practices, and ensure data reliability, security, and compliance. Key Responsibilities: Lead and mentor a big team of data engineers, establishing best practices in data engineering. Design, build, and maintain scalable, secure , and reliable data pipelines and architectures. Develop and optimize ETL processes, integrating diverse data sources into unified platforms. Monitor, troubleshoot , and enhance data performance and infrastructure. Key Skills & Experience: Strong experience with SQL/NoSQL databases, data warehousing, and big data (Hadoop, Spark). Proficient in Python, Java, or Scala with solid OOP and design pattern understanding. Expertise in ETL tools and orchestration frameworks (Airflow, Apache NiFi). Hands-on experience with cloud platforms (AWS, Azure, or More ❯

Data & Technology Lead London (3 days in Office) | Up to £70,000 + Bonus I’m working with an employee-owned media agency that’s looking for a hands-on Data & Technology Lead to take ownership of their data engineering and automation capabilities. This role will focus on building and optimising data pipelines, shaping data architecture, and driving the use of AI and automation across the business. You’ll also mentor a small team and play a key part in developing the agency’s future data strategy. What you’ll bring: Strong background in data engineering – Python, SQL, and cloud platforms (GCP or Azure … . Experience designing or managing data pipelines and ETL processes . Exposure to orchestration tools such as dbt , Airflow , or Azure Data Factory . Good understanding of data architecture and automation . AdTech or MarTech experience would be a real plus. Confident mentoring and developing junior engineers/analysts. This is a great opportunity More ❯

Data & Technology Lead London (3 days in Office) | Up to £70,000 + Bonus I’m working with an employee-owned media agency that’s looking for a hands-on Data & Technology Lead to take ownership of their data engineering and automation capabilities. This role will focus on building and optimising data pipelines, shaping data architecture, and driving the use of AI and automation across the business. You’ll also mentor a small team and play a key part in developing the agency’s future data strategy. What you’ll bring: Strong background in data engineering – Python, SQL, and cloud platforms (GCP or Azure … . Experience designing or managing data pipelines and ETL processes . Exposure to orchestration tools such as dbt , Airflow , or Azure Data Factory . Good understanding of data architecture and automation . AdTech or MarTech experience would be a real plus. Confident mentoring and developing junior engineers/analysts. This is a great opportunity More ❯

Data & Technology Lead London (3 days in Office) | Up to £70,000 + Bonus I’m working with an employee-owned media agency that’s looking for a hands-on Data & Technology Lead to take ownership of their data engineering and automation capabilities. This role will focus on building and optimising data pipelines, shaping data architecture, and driving the use of AI and automation across the business. You’ll also mentor a small team and play a key part in developing the agency’s future data strategy. What you’ll bring: Strong background in data engineering – Python, SQL, and cloud platforms (GCP or Azure … . Experience designing or managing data pipelines and ETL processes . Exposure to orchestration tools such as dbt , Airflow , or Azure Data Factory . Good understanding of data architecture and automation . AdTech or MarTech experience would be a real plus. Confident mentoring and developing junior engineers/analysts. This is a great opportunity More ❯

around £500/day Starting ASAP for 6 months - likely to extend About the Role We’re partnering with a financial client that’s undertaking a large-scale data transformation, modernising legacy systems and building a unified analytics platform in the cloud. As part of this initiative, you’ll play a key role in developing and optimising a … Snowflake-based data warehouse and delivering high-quality visualisations and reporting through Power BI. The role offers the chance to work on greenfield architecture, migrate legacy SQL Server solutions and collaborate closely with senior stakeholders on complex, high-impact data initiatives. What You’ll Be Doing Design, develop and maintain data pipelines and models … using Snowflake, dbt and Python. Enhance and support Power BI dashboards and data models, ensuring performance, accuracy and user accessibility. Contribute to the migration of legacy SQL Server (SSIS/SSAS/SSRS) systems into a modern Snowflake/Power BI environment. Work collaboratively with business users to understand requirements, translate them into technical solutions and deliver robust More ❯

around £500/day Starting ASAP for 6 months - likely to extend About the Role We’re partnering with a financial client that’s undertaking a large-scale data transformation, modernising legacy systems and building a unified analytics platform in the cloud. As part of this initiative, you’ll play a key role in developing and optimising a … Snowflake-based data warehouse and delivering high-quality visualisations and reporting through Power BI. The role offers the chance to work on greenfield architecture, migrate legacy SQL Server solutions and collaborate closely with senior stakeholders on complex, high-impact data initiatives. What You’ll Be Doing Design, develop and maintain data pipelines and models … using Snowflake, dbt and Python. Enhance and support Power BI dashboards and data models, ensuring performance, accuracy and user accessibility. Contribute to the migration of legacy SQL Server (SSIS/SSAS/SSRS) systems into a modern Snowflake/Power BI environment. Work collaboratively with business users to understand requirements, translate them into technical solutions and deliver robust More ❯

around £500/day Starting ASAP for 6 months - likely to extend About the Role We’re partnering with a financial client that’s undertaking a large-scale data transformation, modernising legacy systems and building a unified analytics platform in the cloud. As part of this initiative, you’ll play a key role in developing and optimising a … Snowflake-based data warehouse and delivering high-quality visualisations and reporting through Power BI. The role offers the chance to work on greenfield architecture, migrate legacy SQL Server solutions and collaborate closely with senior stakeholders on complex, high-impact data initiatives. What You’ll Be Doing Design, develop and maintain data pipelines and models … using Snowflake, dbt and Python. Enhance and support Power BI dashboards and data models, ensuring performance, accuracy and user accessibility. Contribute to the migration of legacy SQL Server (SSIS/SSAS/SSRS) systems into a modern Snowflake/Power BI environment. Work collaboratively with business users to understand requirements, translate them into technical solutions and deliver robust More ❯