251 to 275 of 517 Data Pipeline Jobs in the UK excluding London

Code Apply Docker, containers, and Kubernetes within development processes 10+ years' total experience, including 5+ years in Azure Cloud (IaaS, PaaS, SaaS) for data-intensive solutions Experience designing, implementing, and migrating data-intensive applications to Azure Cloud Experience designing, configuring, and optimising Azure data services - Databricks, Data Factory, Synapse, Data Lake, Database, and Batch services Ability to design, implement, and troubleshoot end-to-end data pipelines Experience configuring App Gateway, IaaS, Azure AD, Firewall, and Networking in a PaaS context Experience implementing SQL and NoSQL solutions ...

Title: Senior Python AI & Data Engineer Job Description This full-time role, based in Sheffield, focuses on designing and delivering intelligent data workflows that connect enterprise systems with large language models and agentic AI solutions. You will develop and evolve a Gen AI-powered case management … engineering practices, and ensure that AI-powered solutions are robust, scalable, and reliable. Responsibilities Design, develop and maintain Python-based services and data processing solutions that power AI-driven case management capabilities. Build, implement and optimise data pipelines that connect enterprise applications and systems with ...

Software Engineer (Python & AWS) - Data Science Focus Location: Derby - 1 day per week Salary: £60,000 - £75,000 About the Opportunity We're looking for a talented Software Engineer with a strong interest in data and data science to join an innovative technology team. … This is an opportunity to work on complex, data-driven products that combine software engineering, cloud technologies and machine learning. You'll be involved in designing and building applications, APIs and data pipelines that help transform large volumes of complex data into meaningful, actionable ...

Data Engineer - SC Cleared 6+ Month Contract | £400-£450 per day | Inside IR35 Remote | West Midlands/West Sussex | Twice a Month onsite We're looking for an experienced Data Engineer to join a major UK public sector programme, helping deliver secure, modern data … excellent opportunity to work on a large-scale, high-profile programme where you'll play a key role in building reliable data solutions and enabling high-quality data products. The Role You'll be responsible for: Building, enhancing and supporting robust data pipelines ...

client, a leading global SaaS organisation is looking for a Senior Data Analyst to work on exciting AI/ML user experience projects for a 12 month contract. Hybrid with 3 days on site. Responsibilities; Providing data sources that help build the AI/ML user … experience Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow. Provide observability and monitoring using Monte Carlo and Looker as well as operational tools such as NewRelic and Splunk, driving reliability, data quality, data quality and robustness. Scope and plan ...

client, a leading global SaaS organisation is looking for a Senior Data Analyst to work on exciting AI/ML user experience projects for a 12 month contract. Hybrid with 3 days on site. Responsibilities; Providing data sources that help build the AI/ML user … experience Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow. Provide observability and monitoring using Monte Carlo and Looker as well as operational tools such as NewRelic and Splunk, driving reliability, data quality, data quality and robustness. Scope and plan ...

client, a leading global SaaS organisation is looking for a Senior Data Analyst to work on exciting AI/ML user experience projects for a 12 month contract. Hybrid with 3 days on site. Responsibilities; Providing data sources that help build the AI/ML user … experience Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow. Provide observability and monitoring using Monte Carlo and Looker as well as operational tools such as NewRelic and Splunk, driving reliability, data quality, data quality and robustness. Scope and plan ...

Were looking for a proactive, solution-focused end to end developer to join a multidisciplinary reporting team within the National Data and Analytics (NDA) department. In this role, you will be responsible for designing, developing, and delivering high-quality national reporting solutions across one or more business areas. … Youll work alongside fellow developers and data engineers to create reporting products that empower decision-making and drive strategic outcomes. As an NDA developer, youll report directly to the NDA Executive Manager and play a key role in the full delivery lifecyclefrom understanding gathered requirements, data ...

responsible for supporting the development and maintenance of clinical information reporting solutions, including: Develop reports using Power BI Supporting the ePCR database The data flow into the database SQL Server Reporting Services reports Ad hoc reports System access and permissions using the Supplier Admin Tool Data … department, directorate and the Trust at internal and external meetings, ensuring that strategic projects and processes are conducted with due consideration to clinical data Engaging staff, senior Managers and Directors to identify and fix issues which affect the use and performance of Trust reports etc. Right to work ...

Lead Data Engineer Location: Solihull (Hybrid, 3 days onsite) Salary: Up to £110,000 + Bonus + Benefits This is an opportunity for a Lead Data Engineer to drive the design, development, and optimisation of a modern cloud-based data platform. This … hands-on leadership role, combining technical architecture, delivery, and team mentorship. Key Skills: Strong experience in a Lead/Senior Data Engineering role Expertise with GCP (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Airflow) Advanced Python and SQL Experience building scalable batch and real-time data ...

seeking a Senior Databricks Architect to design, implement, and optimize enterprise-scale data platforms using the Databricks Lakehouse Platform . The ideal candidate will have deep expertise in Databricks architecture, Apache Spark, Delta Lake, data engineering, cloud platforms, and enterprise data solutions. Key Responsibilities … Design and architect Databricks Lakehouse solutions for large-scaleenterprise data platforms. Lead end-to-end Databricks implementation, including architecture, development, deployment, and optimization. Define Databricks workspace architecture, clusterstrategies, security models, and operational standards. Design and developscalable data pipelinesusing Databricks, Apache Spark, PySpark, SQL, andDelta Lake . ...

team, the post holder will act as a trusted analytical partner, helping stakeholders understand their information requirements and translating these into high-quality data products, dashboards, reports, and insights. Main duties of the job The role combines advanced analytical and technical expertise with strong stakeholder engagement skills, requiring … post holder to build and maintain effective relationships across multiple organisations. They will lead on the development of complex datasets, reporting solutions, data pipelines, and automation processes, while ensuring high standards of data quality, governance, and information security. About us Here is a not-for-profit ...

exciting opportunity for a Data & ML Engineer to join a thriving technology and innovation hub where talented engineers, data specialists and industry experts come together to build solutions that make a real difference. Working across a diverse range of projects, youll have the opportunity to work … with cutting-edge technologies, solve challenging data problems and develop your expertise across the rapidly evolving world of AI. You will have the opportunity to: Design and implement robust data pipelines and ML workflows using Python, SQL, Spark and Databricks. Develop and deploy machine learning models ...

Senior Data Engineer - Remote We are looking for a Senior Data Engineer to take a key role in developing, modernising and improving the organisations data platform and data warehouse capability. This is a hands-on senior engineering position with genuine ownership. Youll … responsible for designing and building robust data pipelines, developing scalable data models and helping shape the future arch click apply for full job details ...

role is hybrid and would only require 1 day a week in the office. The Role You must have experience in leading data & analytics engineering platforms. In this role, you will play a pivotal role in driving the business-critical transformation of technology delivery and supporting the achievement … delivery teams at scale (30+ colleagues, multiple suppliers) Good grounding in technology and data software delivery including system design, data pipeline development, or delivery management Proven experience identifying and delivering continuous improvement through innovation, agile transformation and operational improvement initiatives Experience operating at senior stakeholder ...

LangGraph, LangChain, Haystack or similar frameworks. Proven ability to deploy AI/ML systems into production environments. Strong knowledge of inference, latency, performance, data pipelines, memory and tool/function calling. Experience with large-scale search and retrieval, including embeddings, indexing and querying multi-modal datasets. Confident with ...

About Prophecy The leader in AI-native data preparation and analysis, Prophecy is revolutionizing how the world’s top enterprises turn data chaos into reliable insights. We introduce the AI-native data lifecycle (generate, refine, deploy) where our industry leading AI agents and humans … work hand-in-hand in visual and document interfaces to analyze, transform and prepare data, to ship trusted insights at enterprise scale. To learn more, visit us on LinkedIn. About the Role As a Forward Deployed Solution Engineer, you will be a critical part ...

Data & Insight Analyst Location: Chertsey (Hybrid – 2 days onsite) At Foodbuy, we’re driving transformation through data. As the procurement and supply chain division of Compass Group UK & Ireland, we sit at the heart of a £2.6bn spend network—delivering insight-led solutions to some of the most … recognisable organisations across healthcare, education, hospitality and business. We’re now looking for a Data & Insight Analyst to join our growing Analytics team, playing a key role in shaping how data and insight drive decision-making across the business. The Role This is a hands ...

senior Python engineer who wants to work at the intersection of data platforms and applied AI? This is your opportunity to join a small, high-impact team building something new from the ground up - where your decisions shape the architecture, not just the backlog. At JPMorganChase, we invest … curious, pragmatic, and ready to grow into emerging technology stacks. As a Senior Lead Software Engineer at JPMorganChase within the Corporate Technology Data and Analytics Services team, you will be a founding contributor to the Context Plane - a greenfield platform that connects the firm's data ...

Data Engineer London - 4-5 Days per Week in Office £70,000-£90,000 + Equity + Benefits We're working with a rapidly growing, YC-backed healthcare AI startup building a market-leading data platform used by pharmaceutical, biotech and healthcare organisations. The Opportunity This … users or founders to shape solutions Shipped products that generated real business value The successful candidate will help build and scale the core data infrastructure powering the company's platform, taking ownership of projects from raw data acquisition all the way through to production-ready products. ...

Software and Data Engineer Location: West Midlands, office based Salary: £45,000 to £50,000 Contract: Permanent Hours: Monday to Thursday, 8am to 5pm. Friday, 8am to 1pm. I am working with an established manufacturing business that is investing in its internal technology capability. They are looking … Software and Data Engineer to take ownership of business critical applications, data pipelines and systems integrations. This is a varied, hands on role where you will solve live technical issues while delivering longer term improvements across the business. The role You will: * Develop and improve applications ...

Quotient is seeking a Senior Engineer in our Data Infrastructure team to design and evolve our cloud, data and AI infrastructure underpinning our genomics-first drug discovery platform. Working within the Data Infrastructure team, you will lead complex initiatives spanning AWS platform engineering, scientific … present in patients. Through our work in somatic genomics, we are forging a new status quo for biopharma research and development across a broad pipeline of internal and partnered programs. The company was founded by Flagship Pioneering, an innovative enterprise that conceives, creates, resources, and grows first-in-category ...

VanRath has partnered with a leading technology consultancy delivering cloud-based solutions for enterprise clients. This is an exciting opportunity for experienced Data Engineers to design scalable data pipelines and cloud data platforms using Snowflake, Databricks, and Azure Data Services. You will … work on complex ETL/ELT workflows, optimize data models, governance, and data quality, and collaborate directly with clients to deliver tailored solutions. #J-18808-Ljbffr ...

Data Scientist Consultant Fully Remote (Need right to work in UK) Inside IR35 £500 - £640 Per Day Start Immediately The Company They are a well-established organisation with a strong focus on data-driven innovation within financial services and credit analytics. Their teams develop sophisticated modelling … solutions, risk products, and decisioning tools powered by extensive commercial data assets. With continued investment in cloud technologies and advanced analytics, they are building the next generation of AI and machine learning capabilities. You will join a collaborative environment that values technical excellence, innovation, and commercial impact. ...

experience or strong demonstrable ability considered). Desirable (but not required) Experience with Kubernetes or container orchestration. Exposure to ML/AI projects, data pipelines, or research-driven engineering. Experience with observability tooling, CI/CD, and testing best practices. Degree in Computer Science, Engineering, or related technical ...