701 to 725 of 948 Data Pipeline Jobs in the UK excluding London

startups and internal teams to assess architectural designs, technical capabilities, and fit within existing systems and information architecture. Build scalable feature engineering and data pipelines on Databricks using data lake sources, leveraging Spark/Delta and Databricks workflows/jobs. Required Qualifications, Capabilities, And Skills Formal … tools such as Git/BitBucket, Jira, ServiceNow, and pre-commit hooks. Strong programming skills in Python and Java, including experience with distributed data processing. Leverage enterprise-authorized AI coding assistant tools to improve code quality and delivery speed (e.g., code generation/refactoring, unit tests, documentation), while ...

realized by automationRequired qualifications, capabilities, and skillsFormal training or certification on software engineering concepts and advanced applied experienceStrong software engineering fundamentals — system design, data structures, algorithms, and architectural thinking — with the ability to ramp up quickly across varied tech stacks and project typesHands-on practical experience in full … stack or cross-functional development, spanning frontend, backend, data pipelines, or mobile, with demonstrated ability to contribute across the length and breadth of a projectProficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude ...

Hippo in Manchester is seeking a Lead Data Engineer to guide data-centric delivery across client engagements and internal platforms. You will drive architecture, pipelines and best practices while mentoring a growing team of engineers. You will lead complex data projects using Python ...

defining strategy, shaping the roadmap, writing detailed specifications and driving measurable outcomes. You will work at the intersection of product management, financial accounting, data modelling and energy retail, partnering closely with engineering teams and senior finance stakeholders. This is a hands-on product role requiring strong analytical thinking … delivering valuable, scalable software solutions. Key responsibilities: Own the strategy, vision and roadmap for Financial Assurance, using customer insight, commercial input and product data to continuously evolve priorities. Write high-quality product specifications and requirements that engineering teams can build from with confidence and minimal clarification. Define, track ...

leading global consulting firm is seeking a Data Engineer in Birmingham to design and implement high-performance data pipelines and maintain secure data platforms. The role requires at least 10 years of relevant experience, expertise in cloud technologies like AWS and Azure, and strong ...

exciting media agency in London is looking for a Contract Data Engineer/BI Consultant to join the team on a short-term contract, supporting dashboard development and data infrastructure projects until a permanent hire joins in December. Based in London 4 days per week … until 7th December 2026 (with potential handover period) Start date: ASAP Up to £365 per day Outside Ir35 The Job As the Contract Data Engineer/BI Consultant , your responsibilities will include: Building and enhancing dashboards and data visualisation solutions for internal and client reporting. Developing ...

Overview: We are looking for an EDA Optimisation Engineer to support the data-driven optimisation, analysis and maintenance of Arm’s engineering platforms. This role will work as part of a team effort to improve system utilisation/efficiency/cost-performance and touch on forecasting accuracy … infrastructure strategy. Working within the Productivity Engineering group, there will be a focus on metrics, automation, data-engineering and problem-solving where applicable to efficiency topics, in a metrics-first/data-driven-decisions environment. We expect this work to drive scalability and vendor strategy across ...

FairPlay Sports Media is seeking a data scientist to translate complex data into actionable strategies. You will partner with Product, Engineering, Marketing, and Operations to build predictive frameworks and uncover growth opportunities. Responsibilities include experimentation, predictive analytics, EDA, feature definition, and cross-functional collaboration. The role … also involves designing autonomous AI agents and maintaining data pipelines with Data Engineering. #J-18808-Ljbffr ...

Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and advanced applied experience Strong software engineering fundamentals system design, data structures, algorithms, and architectural thinking with the ability to ramp up quickly across varied tech stacks and project types Hands-on practical experience … full-stack or cross-functional development, spanning frontend, backend, data pipelines, or mobile, with demonstrated ability to contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness ...

just where an artifact came from, but how it was built, what went into it, and exactly how it was used across every pipeline and deployment downstream. Cloudsmith already sits in the middle of how organisations store and distribute software artifacts. This role turns that position into something more … powerful: a source of truth. You will build the infrastructure that captures, stores, and surfaces build provenance and pipeline usage data — so that when a customer asks which of their services consumed a given artifact, and what build produced it, the answer is in Cloudsmith, complete ...

Position Senior Azure Data Engineer Location Thatcham (Hybrid, Minimum 2 Days Per Week Onsite) Commutable from Reading, Basingstoke, Newbury, Andover and surrounding areas. Salary and Benefits Up to £67,000 + 10% Non-Contributory Pension + 29 Days Holiday + Bank Holidays + Hybrid Working + Excellent Benefits … cloud projects, the opportunity to shape technical direction, and the chance to help upskill a growing team within an ambitious and rapidly expanding data division? This is an excellent opportunity to join a collaborative and fast-growing data team within an established research organisation that ...

leading global business in the United Kingdom is seeking a Senior Data Engineer to lead the design of their data platform. The role involves mentoring others, solving complex challenges, and optimising data systems. Candidates should have extensive experience in designing large-scale data ...

Azure) Conduct rigorous model evaluation, A/B testing, and performance monitoring Mentor junior ML engineers and conduct technical code reviews Collaborate with data engineers to optimise feature stores and data pipelines Stay current with latest ML research and evaluate applicability to client projects Requirements 5+ ...

market intelligence platform currently in development that will help recruiters identify opportunities within their markets and specialisms. We have many more plans in the pipeline for the near future too, all of which you’ll help build with us. We are a small, ambitious team. … modern stack (NestJS, TypeScript, GraphQL via Hasura, PostgreSQL, Vue.js) Legacy platform work - maintaining and improving our older Node.js applications (Express, Handlebars, MongoDB) Data and ingestion - working with large datasets, building and optimising data pipelines, and ensuring our systems perform at scale This is a hands ...

provide expert analytics, reporting, and BI support for external partners in health and care. You will lead on complex datasets, dashboards, and data pipelines while ensuring data quality, governance and security. You will collaborate with multiple project teams, mentor junior analysts, and maintain relationships with internal … external stakeholders. The role requires strong SQL, Power BI skills, and experience with data integration tools such as #J-18808-Ljbffr ...

systems, including non-deterministic and agentic applications. OptimizeAI systems and workloads for latency, throughput,computeefficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoingoperation. Establish engineering standards,mentorengineers,and influencetechnical strategy across teams. Theminimumrequirements … model-driven applications in production. Strongproficiencyin Python anda track recordof developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

deterministic and agentic applications. Optimize AI systems and workloads for latency, throughput, compute efficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoing operation. Establish engineering standards, mentor engineers, and influence technical strategy across … production. Strong proficiency in Python and a track record of developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

deterministic and agentic applications. Optimize AI systems and workloads for latency, throughput, compute efficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoing operation. Establish engineering standards, mentor engineers, and influence technical strategy across … production. Strong proficiency in Python and a track record of developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

Senior Python Engineer/Back End Developer to join a fast-moving team. You will develop Python microservices, scalable services, voice chat, and data pipelines, using AI technologies including ASR, TTS, and LLMs. The ideal candidate will have strong Python skills, a pragmatic delivery-focused approach … ability to take ownership in a fast-paced, evolving environment. Key Responsibilities: Develop and maintain scalable Python services, microservices, voice chat, and data pipelines. Work with the Tech Lead and wider team on architecture, technical decisions, and solution design. Collaborate with product, data science, QA, design ...

maintaining quality and security. Familiarity with MCP (Model Context Protocol), Agent Skills and designing agentic systems that integrate models with tools and enterprise data via structured interfaces is a plus. Job Responsibilities Design, develop, and deploy GenAI and Agentic AI solutions that improve automation, decision-making, and user … practices. Develop prompt strategies and prompt engineering assets (templates, routing, guardrails), and implement automated evaluation to improve quality over time. Build and maintain data pipelines and processing workflows required for ML/GenAI use cases using cloud services. Apply MLOps practices across the lifecycle: experimentation, versioning, CI/ ...

maintaining quality and security. Familiarity with MCP (Model Context Protocol), Agent Skills and designing agentic systems that integrate models with tools and enterprise data via structured interfaces is a plus. Job Responsibilities Design, develop, and deploy GenAI and Agentic AI solutions that improve automation, decision-making, and user … practices. Develop prompt strategies and prompt engineering assets (templates, routing, guardrails), and implement automated evaluation to improve quality over time. Build and maintain data pipelines and processing workflows required for ML/GenAI use cases using cloud services. Apply MLOps practices across the lifecycle: experimentation, versioning, CI/ ...

Kubernetes, Elastic Container Service, or equivalent technologies in production environments Strong experience designing and implementing application programming interfaces, distributed systems, event-driven architectures, data pipelines, PostgreSQL, MongoDB, Redis, vector databases, observability, and automated deployment pipelines Demonstrated ability to influence technical direction while remaining close to the codebase, mentoring … coding, reviewing, debugging, and improving production systems that support AI-powered products and services Design and build scalable backend services, application programming interfaces, data pipelines, inference pipelines, and platform capabilities that support real-time and batch AI workloads at enterprise scale Implement advanced large language model applications using ...

Kubernetes, Elastic Container Service, or equivalent technologies in production environments Strong experience designing and implementing application programming interfaces, distributed systems, event-driven architectures, data pipelines, PostgreSQL, MongoDB, Redis, vector databases, observability, and automated deployment pipelines Demonstrated ability to influence technical direction while remaining close to the codebase, mentoring … coding, reviewing, debugging, and improving production systems that support AI-powered products and services Design and build scalable backend services, application programming interfaces, data pipelines, inference pipelines, and platform capabilities that support real-time and batch AI workloads at enterprise scale Implement advanced large language model applications using ...

site role, and candidates for this role are required to hold an active DV security clearance. Hexegic are looking for technically minded data and software engineers to work on an intriguing and exciting project, building and maintaining data pipelines and platforms for our customers … with similar languages API awareness for data retrieval and integration into processing pipelines Experience of stakeholder management and requirements capture Understanding of pipeline scheduling and health checks What’s in it for you? Base salary of £50,000-£70,000 £5000 a year professional development budget Wellness ...

Rise Technical in Manchester is seeking a Senior Data Engineer to build the foundations for reporting rather than inheriting someone else’s platform. You’ll create Azure-based data platforms from scratch, develop scalable data models and reporting architectures, and deliver trusted reporting with … lineage built in. You’ll work directly with planners, quantity surveyors and project managers to translate requirements into reliable reporting solutions, owning data pipelines and #J-18808-Ljbffr ...