376 to 400 of 657 Data Pipeline Jobs in the UK

skills: 8+ years’ experience in backend development, specifically in Python. Experience with DevOps tools and principles as well as IaaC. Experience in building data pipelines. Experience with NoSQL Databases. Able to lead and grow teams. Interview process: 1 st stage – video call with the Squad Lead (30 minutes ...

maintain an intelligence-gathering layer — combining web scraping, news monitoring, and people-move tracking — that feeds both our marketing campaigns and our business development pipeline • Explore and prototype multi-agent architectures for multi-step tasks that currently require human intervention at each stage • Optimise workflows for efficiency — right model … assisted tools (Cursor, Claude, Bolt, Replit, Lovable, or similar) to build something — a script, an automation, a simple app, a data pipeline — without a formal software engineering background. You are comfortable reading, editing, and prompting your way through code even if you wouldn't call yourself ...

small, high‐impact team building AI systems that power decision‐making across a global investment platform. You’ll work alongside experienced AI engineers, data scientists, and technologists to deliver real products used by investment teams and portfolio companies. This role is ideal for: PhD graduates in a STEM … computational experience; or Bachelor’s/Master’s graduates with 1–2 years of industry experience or relevant internships in machine learning, data engineering, or software engineering. You’ll contribute to designing, implementing, and deploying production-grade ML systems—ranging from NLP pipelines to model‐driven workflow automation. ...

Kantar is the world’s leading AI-native marketing data and analytics business and an indispensable brand partner to the world’s top companies. We combine the most meaningful attitudinal and behavioural data with deep expertise and advanced analytics to uncover how people think and act. … shape the marketing strategies that shape their future. Why this job is important This role is about applying data science where it genuinely matters — in live, production environments that support large‐scale research operations around the world. As a Senior Data Scientist on the Digital Twins ...

modern engineering best practices. Build and maintain microservices-based systems , with a strong focus on scalability, resilience, and performance. Develop and optimise scalable data pipelines , supporting both batch and streaming workloads, using technologies such as Apache Spark . Work extensively with data technologies , leveraging Python … deliver high-quality analytical and data-driven solutions. Lead the design and delivery of data-centric applications , translating complex business and analytical requirements into well-architected technical solutions. Implement and integrate large language models (LLMs) , including: Utilising both proprietary and open-source models Fine-tuning models ...

Role GenAI Data Engineer Your responsibilities: Design and maintain scalable data pipelines using PySpark, Python, and distributed computing frameworks to support high‐volume data processing. Architect and optimize AWS-based data and AI infrastructure, ensuring secure, performant, and cost‐efficient ingestion, transformation … prompt management, evaluation, and GenAI operations. Collaborate with cross-functional teams to integrate GenAI capabilities into production systems and ensure high-quality data, governance, and operational reliability Your Profile Essential skills/knowledge/experience: Strong experience with PySpark, distributed data processing, and largescale ETL/ ...

growing global macro hedge fund is seeking a Technology Associate/Data Engineer to join its lean, high-impact technology team in London. The firm combines an entrepreneurial culture with institutional backing and is known for empowering talented individuals to take ownership, innovate, and shape its future. This … hands-on engineering role at the intersection of technology, data, and business operations . You’ll work directly with teams across Trading, Risk, Operations, Finance, and Compliance to build tools, automate processes, and enhance the firm’s data and reporting infrastructure. The successful candidate will ...

Health—we're building the future of population health management. As a Senior Machine Learning Engineer, you will sit at the intersection of data science, platform engineering, and production systems. Your mission is to design and operate the foundations that allow ML, analytics, and agentic AI systems … move safely and reliably from experimentation into regulated healthcare production environments on Google Cloud Platform. You will be the primary interface between Data Science and Platform Engineering, enabling rapid iteration while enforcing production and compliance standards. Responsibilities Design and implement Onsera's agentic AI platform – architect LLM/ ...

Denodo Data Engineer - SC Cleared Day Rate: £470 per day IR35 Status: Inside IR35 - engagement via an umbrella company Duration: 6 months Location: Hybrid - occasional on-site workshops (typically 1-2 days per month) in Telford or Hove Security Clearance: Active SC clearance required Role Overview … seeking an SC-cleared Denodo Data Engineer to join a central government data platform programme . This is a client-facing role requiring strong communication skills, commercial awareness, and a proactive approach. You will work within a delivery team to build and deliver base and integration ...

Denodo Data Engineer - SC Cleared Day Rate: £470 per day IR35 Status: Inside IR35 - engagement via an umbrella company Duration: 6 months Location: Hybrid - occasional on-site workshops (typically 1-2 days per month) in Telford or Hove Security Clearance: Active SC clearance required Role Overview … seeking an SC-cleared Denodo Data Engineer to join a central government data platform programme . This is a client-facing role requiring strong communication skills, commercial awareness, and a proactive approach. You will work within a delivery team to build and deliver base and integration ...

Title: Data Engineer (Talend & Unix Specialist) Location: Telford (Hybrid - occasional onsite workshops, ~2 days/month in Telford) Rate: Up to £450/day inside IR35 Security Clearance: Active SC Role Overview We are seeking an experienced Data Engineer to design, build, and support robust data integration and ETL solutions within a secure government environment. The role focuses on delivering scalable, performant data pipelines and ensuring high service reliability across critical data platforms. Key Responsibilities Design and implement secure, scalable data integration and ETL solutions using Talend ...

able to work closely with others to shape solutions Beneficial - exposure to ERP, B2B SaaS, or financial software Beneficial - experience with vector search, data pipelines, AI monitoring, and security For more information, please contact Katie at Matched Group. AI Software Engineer/AI Software Developer/AI/ ...

able to work closely with others to shape solutions Beneficial - exposure to ERP, B2B SaaS, or financial software Beneficial - experience with vector search, data pipelines, AI monitoring, and security For more information, please contact Katie at Matched Group. AI Software Engineer/AI Software Developer/AI/ ...

developers in a high-growth environment. You'll be responsible for architecting and building Python-based systems (FastAPI, Django, Flask), developing and optimising data pipelines, and ensuring systems are scalable, secure, and performant. You'll collaborate closely with product, AI, and design teams to translate business requirements into ...

agile environment Able to balance innovation with robustness and user impact Nice to Have Experience working on customer-facing products Exposure to data pipelines, prompt engineering, or AI optimisation Interest in shaping how AI is adopted across a wider product suite Why Join? Work on a well-established ...

models and systems, from experimentation to production Cross-Functional Collaboration Partner with Product, Engineering, and DevOps teams to integrate AI capabilities Ensure smooth data flow, deployment, and system interoperability Technical Leadership Provide guidance on tools, frameworks, and AI/ML best practices Explore and implement advanced approaches including … Optimisation Identify and address challenges in AI workflows Improve system performance, scalability, and reliability Model Performance & Governance Enhance model accuracy and robustness Address data quality, bias, and interpretability considerations Ensure compliance with security and privacy standards Documentation & Knowledge Sharing Maintain clear documentation and internal best practices Support continuous ...

experience doesn't quite match the specification, we'd still really love to hear from you Your new Role Working closely with the Data Analytics Manager and wider Marketing Team, this role will be responsible for turning audience data and customer intelligenceinto real-world outcome-driven … marketing activations across paid media, CRM, and emerging channels across the DFS Group. This role sits at the heart of our Group Customer Data Strategy so the successful candidate will be responsible for the deployment and activation of our FirstParty Data (1PD) audiences, enriching audience data ...

will be responsible for: Designing, implementing, and maintaining scalable data pipelines and ETL processes Developing and optimising databases and data storage solutions for structured and unstructured data Collaborating with data scientists and analysts to deliver reliable, high-quality data for analytics and reporting Ensuring data quality, integrity, and compliance with security and governance click apply for full job details ...

Remote (UK) A large UK organisation delivering training and apprenticeship programmes is looking for a Senior BI & Insight Analyst to join its growing Data & Automation team. This role sits within a small but high-impact data team and will focus on delivering end-to-end business … maintain Power BI dashboards and reports for stakeholders across the business Work closely with stakeholders to gather requirements and translate business needs into data solutions Manage BI support requests including troubleshooting reports, managing access, and maintaining dashboards Support data modelling, reporting structures, and data ...

area . Core areas AI Engineering LLM orchestration, prompting, and workflows Evaluation systems and feedback loops Reliable deployment of AI systems in production Data Engineering Data ingestion from heterogeneous sources Data modelling, transformation, and pipelines PostgreSQL, vector databases, medallion architectures Enterprise Infrastructure Multi-tenant … infrastructure and deployment Security, authentication, and system reliability The role 🧠 Build and deploy AI systems using LLMs (prompting, orchestration, evaluation) 📊 Design and scale data pipelines across diverse sources (APIs, scraping, structured data) ⚙️ Develop core SaaS infrastructure, including multi-tenant architecture 🔧 Take ownership of system design across ...

Role : Data Architect Location: Bournemouth Salary: £90,000 + Bonus WFH policy: One Day a month My client who is a leading insurance company is looking for a Data Architect to join their team, this is an exciting opportunity as you will be working on transformational … project this is not a BAU role. Role and Responsibilities Lead solution-level data architecture across a complex data estate, acting as the key link between business stakeholders, analysts, and engineering teams to ensure practical, delivery-focused outcomes Own end-to-end design authority, shaping both ...

technology to trade a broad range of energy, metals, and agricultural commodities globally. Our success is driven by cutting-edge analytics, high-frequency data processing, and a commitment to innovation. We are now looking for a Senior Python Engineer to join our dynamic team in London and drive … Python Engineer, you will be at the heart of our technology platform, building robust systems that enhance our trading strategies, risk management, and data analysis. You will collaborate closely with quants, data scientists, and traders, providing Python-based solutions that directly impact the profitability ...

constructs, including: Support coverage models (core hours, escalation) Incident, problem, and change processes Release and maintenance windows Ensure service definitions are fit for current pipeline complexity , not aspirational future platforms. 2. Service Readiness & Operational Assurance Assess and validate service readiness for each critical pipeline, ensuring: Ownership is clear … service maturity and agree mitigation actions within Phase 1/Phase 2 scope. Support formal service readiness and handover sign‐off . 3. Critical Pipeline Support & Continuity Work with Data Architects and Senior Data Engineers to ensure: Service models are grounded in actual pipeline ...

U.K. TO BE CONSIDERED FOR THIS ROLE. An early stage, high growth technology business is redefining how eCommerce brands connect with customers through data driven, automated marketing solutions. With a strong product focus and rapid scaling plans, the team is building robust, high performance systems that enable personalised … knowledge of cloud infrastructure, ideally AWS, alongside containerisation tools such as Docker • Experience working with databases including Postgres and Redis, plus data pipeline or event driven systems • Familiarity with CI CD workflows and modern development tooling such as GitHub Actions • Ability to collaborate cross functionally with product ...

across sportsbooks, lottery, casino, virtual gaming, and financial trading. Our vision is to shape the future of gaming by transforming operations into intelligent, data-driven solutions that deliver exceptional customer experiences and create sustainable value for all stakeholders. We believe in teamwork, knowledge sharing, and transparency with accountability. … Technical Stack Our data ecosystem is built for massive scale and diverse query patterns: - Primary Transactional: **PostgreSQL** (Self-managed on EC2/K8s and AWS RDS/Aurora). - Real-Time Analytics: **ClickHouse** (used for sub-second telemetry, high-throughput event logging, and real-time trading dashboards). ...