201 to 225 of 717 Data Pipeline Jobs in the UK

more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. Job Title: Senior Data Engineer Location: Solihull - Hybrid Contract: 3 months with possible extension. Rate: £550 - £650 inside umbrella Purpose Design, build and assure scalable, secure data products and pipelines across Azure, AWS and Databricks. Lead data integration design, technical decisions and best practices, while mentoring engineers and enabling high-quality analytics, BI and data science outcomes. Reporting & Collaboration Reports to Lead Data Engineer with oversight from Head ...

LGBTQ+ business community. Please do not contact the recruiter directly. About the job you’re considering To support the continued growth of our data led operations and insight capabilities, Capgemini is expanding its data engineering community. We are seeking a Data Engineer with … strong focus on the implementation, configuration, and use of Databricks to deliver scalable, secure data platforms and actionable insights. You will design and build data analytics solutions that enable both internal teams and clients to visualise, understand, and act on their data. The role is focused ...

logging, alerting, and output quality checks Define consumption interfaces for the extracted data Document architecture decisions, data model choices and pipeline behaviour so the system can be handed over, maintained and extended About You You are a Master's student with hands-on AI engineering … process of completing your Master), with practical AI engineering experience beyond coursework Solid Python skills and experience with cloud database and pipeline products Hands-on experience with LLM APIs and prompt engineering: you know how to design prompts for structured extraction, how to evaluate output quality ...

Were looking for a skilled Data Engineer to build, optimise and maintain high-performing data pipelines across Microsoft Fabric and GCP. Youll play a key role in ensuring reliable, production-ready data is delivered to support business-critical analytics. Working within a modern lakehouse … ingest data from multiple sources into Fabric/GCP Ensure pipelines follow medallion architecture (Bronze/Silver/Gold) standards Monitor pipeline performance, troubleshoot issues, and act as a key responder for incidents Embed data quality checks to ensure accuracy and integrity of data ...

About the Job you are considering: Results-driven Hadoop Data Engineer with experience designing, developing, and maintaining large-scale data processing solutions for financial services organizations. Skilled in building robust data pipelines, managing big data platforms, and transforming high-volume structured … unstructured financial data into actionable insights. Proficient in Hadoop ecosystem technologies including HDFS, Hive, Spark, Sqoop, Kafka, Oozie, and YARN , along with SQL and cloud-based data platforms Hybrid working: The places that you work from day to day will vary according to your role, your ...

Senior Data Engineer Ledbury/Malvern/Gloucester/Cheltenham Area On-site - 5 Days Per Week Up to £85,000 + Benefits Security Clearance: Active SC Clearance Required Methods Business and Digital Technology is a £100M+ IT Services Consultancy delivering complex digital transformation programmes across government … regulated sectors. We are seeking an experienced Senior Data Engineer to join a growing team supporting the delivery of secure, mission-critical data platforms. This role requires an individual who is comfortable operating across hybrid environments, combining on-premises infrastructure with Azure cloud technologies to deliver ...

impressive multinational firm is looking for an accomplished Azure Data Engineer to join its team. Please note the role is hybrid you will work from the office 3 days per week with 2 from home. In this role, you will be responsible for designing, developing, and maintaining scalable … data solutions that provide clean, structured, and accessible data to internal teams, stakeholders, and external partners. Working closely with developers, analysts, and business teams, you will help deliver cloud-based data platforms that support reporting, analytics, and data-driven innovation. In order ...

reaching the interview stage by reading the complete job description and applying promptly. \n JOB DESCRIPTION \n Are you passionate about transforming data into actionable insights? Join our Transformation & Innovation team, where you'll help shape the future of financial analysis at JPMorganChase. You'll have the opportunity … grow your career, collaborate with talented colleagues, and make a real impact by building data products that empower our Planning & Analysis community. We value your curiosity, creativity, and drive to deliver solutions that make data accessible and meaningful. \n As a Planning and Analysis Data ...

IMSERV is one of the UK’s leading data collection and energy metering experts, delivering award winning services to more customers in more places, meeting industry targets and becoming a benchmark for excellence. We offer a range of specialist metering technology for electricity, gas, and water along with … highly accurate energy data collection services. All this is wrapped up with an easy-to-view online data management analysis and reporting software. PURPOSE OF THE ROLE: The purpose of the role is to design, build, and manage scalable data solutions focusing ...

Data Manager - GCP We are looking for an experienced Data Manager to lead a high-performing Data Engineering team building scalable data and reporting platforms used by global stakeholders. In this role, you will guide the development of high-throughput, database-centric … applications that process and deliver critical operational data at scale. Working within a cloud-first architecture on Google Cloud Platform (GCP), you will play a key role in designing and delivering modern data solutions using BigQuery and distributed systems. You will lead a geographically distributed team ...

Data Manager - GCP We are looking for an experienced Data Manager to lead a high-performing Data Engineering team building scalable data and reporting platforms used by global stakeholders. In this role, you will guide the development of high-throughput, database-centric … applications that process and deliver critical operational data at scale. Working within a cloud-first architecture on Google Cloud Platform (GCP), you will play a key role in designing and delivering modern data solutions using BigQuery and distributed systems. You will lead a geographically distributed team ...

Senior Data Engineer Job Type: Full-time Salary Range: £45k - £60k Location: Hybrid working model with office days in Guildford or Lewes Join a leading public sector organisation as a Senior Data Engineer. This role offers the opportunity to significantly impact by leading the modernisation … data systems and ensuring community safety through high-quality data. Day-to-Day Responsibilities: Lead the modernisation of our client's data warehouse and implement Lakehouse architectures. Design, build, and optimise a secure, scalable cloud data platform within the Microsoft Fabric ecosystem. Architect ...

take the time to read all the elements of this job advert carefully Please make your application promptly. \n Sainsburys Tech - Delivery Manager – Data Ecosystem \n We can consider a London, Coventry or Manchester base location for this role. \n As a highly experienced Delivery Manager in Sainsbury … multi-team initiatives within a technical landscape bridging the gap between business strategy & engineering execution including:\n \n ETL/ELT & Data Pipeline knowledge \n \n Data Modelling & Architecture \n Data Quality & GovernanceData observabilityCloud data ecosystemsPrior experience of managing a team ...

tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose. Join our Data & AI Strategy team and be part of the future of AI consulting, where we’re not just advising clients, we’re actively disrupting traditional consulting … enabling the AI-empowered workforce of tomorrow, you’ll be working at the cutting edge of what’s next. We DESIGN next-generation data, analytics and AI platforms – You will lead the architecture and development of scalable, secure and cost-efficient platforms that power both operational and analytical ...

Senior Data Engineer Job Type: Full-time Salary Range: £45k - £60k Location: Hybrid working model with office days in Guildford or Lewes Join a leading public sector organisation as a Senior Data Engineer. This role offers the opportunity to significantly impact by leading the modernisation … data systems and ensuring community safety through high-quality data. Day-to-Day Responsibilities: Lead the modernisation of our client's data warehouse and implement Lakehouse architectures. Design, build, and optimise a secure, scalable cloud data platform within the Microsoft Fabric ecosystem. Architect ...

Data Scientist About the Opportunity Chi Square Group is currently partnering with a growing consulting firm in the search for a Data Scientist to join its expanding team. This firm delivers cutting-edge consulting and software solutions to organisations across the finance and defence sectors, helping … them solve complex challenges through data-driven decision-making and advanced analytics. This is a unique opportunity to work alongside exceptional researchers, data specialists, and quantitative professionals in a highly intellectual and collaborative environment where data-driven insights directly influence strategic decision-making. ...

Lead Data Engineer Up to £100,000 *Kafka or Kinesis required London (4 days onsite) This is a great opportunity to join a high-growth organisation where you can take ownership of building and architecting a greenfield data platform for an AI-driven product. THE COMPANY … EXPERIENCE: You will bring strong capability in: Python development and building scalable distributed data systems Data architecture design and pipeline development Batch and streaming data processing Relational databases (PostgreSQL or similar) NoSQL and modern vector databases (e.g., Qdrant, Milvus, pgvector) THE BENEFITS ...

most recognised and celebrated personal lines insurers. The successful candidate will be working alongside a talented team of Data & AI Engineers, Data Scientists, Analysts, Developers and Architects to design and deliver cutting-edge machine learning and AI-driven solutions. From enabling advanced analytics to supporting product … performance optimisation using tools such as DBT and distributed processing frameworks like SparkSQL. Experience with CI/CD, version control (e.g. Git, Jenkins) and pipeline orchestration tools such as Airflow. A collaborative mindset with excellent interpersonal skills, and a passion for building robust, scalable data platforms. ...

Data Engineering Lead - Value & Analytics Location: London or Edinburgh Working pattern: Hybrid working Start date: ASAP Employment type: Permanent Salary: £38,000 - £46,000 (+ £3,300 London Weighting) Level: Senior The Opportunity A leading international organisation specialising in education, cultural relations and global collaboration is looking … Data Engineering Lead to join its Value Management function. You will build the technical infrastructure that provides visibility of portfolio performance, strategic value and benefits realisation across a complex global organisation. Taking ownership of the data engineering and analytics capabilities behind the organisation's Value Dashboard ...

world's money. For everyone, everywhere. More about our mission and what we offer . THE ROLE We’re looking for a Lead Data Analyst who is passionate about our mission of Money Without Borders to partner with our operational teams to help drive data-driven … refining analytical models for strategic capacity planning. Take ownership of forecasting efforts to align with business growth and operational demands. Data Pipeline Ownership. Take ownership of data pipelines to maintain and improve data flow, ensuring reliability and accuracy of data that ...

everywhere. \n More about our mission and what we offer. \n Job Description \n THE ROLE \n We're looking for a Lead Data Analyst who is passionate about our mission of Money Without Borders to partner with our operational teams to help drive data-driven … refining analytical models for strategic capacity planning. Take ownership of forecasting efforts to align with business growth and operational demands. \n Data Pipeline Ownership. Take ownership of data pipelines to maintain and improve data flow, ensuring reliability and accuracy of data ...

SENIOR DATA ENGINEER £75,000 LONDON This is a brilliant opportunity to join a well-known, purpose-led organisation at the start of a major data transformation. You'll play a pivotal role in building a modern data platform from the ground up, working … arts and entertainment space, employing around 1,000 people across multiple iconic venues. They've recently brought in a new Director of Data & Insights to elevate their data capabilities, with a strong focus on innovation, AI, and unlocking value from their data.This is a greenfield opportunity ...

Data Architect - Contract 6 months initial Outside IR35 - £600-700pd South Coast - Hybrid 2 days This is a customer and rewards data initiative focused on data mapping and bringing together multiple data domains across points, partners, customer engagement, and redemption journeys. … work involves integrating and aligning data across a complex mix of legacy and modern systems to create a consistent end-to-end view of the platform. The environment includes strong engineering capability across microservices, cloud, AI, and data-driven services, alongside complex integration across an existing ...

firm serving customers in the Blockchain space, where technology enables greater efficiency and delivers solutions that arent feasible otherwise. While our team builds data pipelines and reporting tools that enable accountancy teams to work efficiently, this role spans cloud infrastructure, data platform engineering, and AI tooling. … support Pragmatic approach to balancing technical delivery with business needs Desirable Python experience for infrastructure automation and tooling Familiarity with data pipeline infrastructure (supporting ETL workloads, data warehousing) and experience with Snowflake or a comparable cloud data warehouse Experience with data ...

complex problems and building production-ready AI solutions that deliver measurable business value. Working alongside AI Technical Leads, Product Teams, Software Engineers and Data Scientists, you will design, develop and deploy cutting-edge AI applications using modern Machine Learning and Generative AI technologies. You will play … Learn LangChain LangGraph Hugging Face FastAPI REST APIs Data Technologies SQL NoSQL Databases Data Modelling ETL Development Data Pipeline Engineering Vector Databases such as Pinecone, Weaviate or ChromaDB Cloud & DevOps Experience with at least one major cloud platform: AWS (preferred) Bedrock SageMaker Lambda ...