51 to 75 of 76 Data Engineering Jobs in Berkshire

Senior Data Engineer - Hybrid - Contract - Outside IR35 Our client is expanding their core data engineering function and hiring two Senior Data Engineers to strengthen a modern, scalable data platform. Both will be Databricks specialists, with one role focused on deep technical delivery and the other combining hands-on engineering with team leadership and upskilling … Live Tables (DLT) pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and … automate deployments. (For leadership-focused role) Mentor and upskill engineers, define coding standards, and embed engineering excellence across the team. What’s Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and real More ❯

We’re hiring an AI Data Engineer to turn 3D assets and visuals into high-quality datasets for next-gen AI in digital play. Own the full data pipeline and help build scalable, creative systems at the crossroads of AI, data, and fun RESPONSIBILITIES Design and operate data ingestion pipelines for 3D assets, geometry, images, video … annotation vendors, and automate quality checks to ensure scalable, reliable datasets. Define schemas and metadata for digital assets, maintaining catalogues, lineage, and versioning to ensure reproducibility and governance. Enforce data quality, drift detection, and compliance (GDPR/COPPA), including watermarking and traceability to safeguard IP and user privacy. Collaborate with AI infrastructure engineers to optimize data storage and … compute performance for large-scale processing. Work with AI engineers to define data specifications, support experimentation, and integrate active learning loops that improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). Hands-on experience More ❯

models) for real-world enterprise use cases. Build and fine-tune LLM-based applications such as: - Chatbots - Document Q&A systems - Report generators - Code assistants - Summarization tools Apply prompt engineering, Retrieval-Augmented Generation (RAG), and context-aware pipelines to enhance model accuracy and relevance. Integrate AI models with enterprise systems, APIs, and data stores using Python, Java, or … through model compression, quantization, and API optimization. Ensure compliance with AI ethics, security, and governance standards. Prepare and curate training datasets (structured/unstructured text, images, code). Apply data preprocessing, tokenization, and embedding generation techniques. Work with vector databases (e.g., Pinecone, Weaviate, FAISS, Chroma) for semantic search and retrieval. Partner with business stakeholders to identify and shape impactful … Experience with cloud platforms (AWS, GCP, Azure) and AI/ML services. Knowledge of MLOps tools and practices (e.g., MLflow, Kubeflow, Vertex AI, Azure ML). Strong understanding of data engineering, data pipelines, and ETL workflows. Excellent problem-solving, communication, and stakeholder engagement skills. Bachelor's or Master's degree in Computer Science, AI/ML, Data More ❯

Senior Data Engineer with 5+ years’ experience, and 2+ years in a Hedge Fund and/or in Systematic Trading Technology, sought by one of the original Quantitative Hedge Funds, with a 20+ year track-record. The firm are renowned for a healthy, supportive, and collegiate working environment and culture, with no siloes, boasting an industry-leading staff tenure. … You will join a 5-strong Data Engineering team in a Senior Individual Contributor capacity, working directly with Quant Researchers, Portfolio Managers and Traders, and designing and engineering the ingestion, storage, transformation and distribution of tick, timeseries, reference and alternative datasets. The technology stack spanson-premise and cloud infrastructure with technologies and tooling such as Python, dbt … KDB+, Snowflake, SQL, interfacing with Market Data vendors such as Bloomberg, Refinitiv, Factset and MorningStar. This is an exciting time for you to join the team they consolidate our technology estate, revamp how they process and filter data, and overhaul the way data is accessed by their consumers, while continuing to onboard new datasets that enhance their More ❯

As a Data and Implementation Lead the successful candidate will work with the project team to plan and orchestrate the implementation of a new data structure to support back-office customer service processes for a financial services provider in Bracknell. What you’ll be doing: Collaborating with the project team to design and deliver the new data … on track. Providing clear leadership and direction to the project team and setting clear priorities. Acting as a key point of technical knowledge on the delivery of software and data services across a range of digital areas, including systems, applications, data analysis, information reporting, information governance and information interpretation. Ensuring testing is completed regularly throughout the implementation. Identifying … data related risks and data quality issues early and implementing solutions. Meeting with key stakeholders to provide reports and progress updates. Communicating technical concepts to non-technical stakeholders. What we’d like to see from your application: Experience in data architecture and engineering with enterprise size systems. Demonstrable leadership in data engineering or software More ❯

As a Data and Implementation Lead the successful candidate will work with the project team to plan and orchestrate the implementation of a new data structure to support back-office customer service processes for a financial services provider in Bracknell. What you’ll be doing: Collaborating with the project team to design and deliver the new data … on track. Providing clear leadership and direction to the project team and setting clear priorities. Acting as a key point of technical knowledge on the delivery of software and data services across a range of digital areas, including systems, applications, data analysis, information reporting, information governance and information interpretation. Ensuring testing is completed regularly throughout the implementation. Identifying … data related risks and data quality issues early and implementing solutions. Meeting with key stakeholders to provide reports and progress updates. Communicating technical concepts to non-technical stakeholders. What we’d like to see from your application: Experience in data architecture and engineering with enterprise size systems. Demonstrable leadership in data engineering or software More ❯

Data Engineer — Hedge Fund (L/S Equity) | London A fundamentally driven long/short equity fund focused on the European Industrials sector is seeking a Data Engineer for a variety of greenfield development. Founded by a former Citadel portfolio manager, the team brings together expertise from leading global institutions such as Citadel, DE Shaw and Millennium. They … combine rigorous data analysis with industry insight to anticipate industrial cycles ahead of the market, acting decisively when conviction and evidence align. Role Overview We are seeking a highly skilled Data Engineer to design, build and maintain the core data infrastructure powering the investment and risk processes. This is a fully hands-on role within a small … high-calibre team, offering significant impact and ownership. You will develop robust, production-grade ETL pipelines, manage cloud-based and on-prem data environments, and integrate diverse datasets from external vendors, trading systems and internal sources. The role also involves implementing automated data validation processes, optimising data quality and performance, and ensuring high availability across all systems. More ❯

Miryco is working with a leading player in the Pension and Asset Management market. Job Specification: Business Intelligence Analyst/Data Engineer Department: Business Intelligence/Data Analytics Sector: Pensions & Asset Management About the Role: We are seeking a hybrid Business Intelligence Analyst/Data Engineer to join our data and analytics team within a leading … Pension & Asset Management organisation. This role will play a key part in unlocking the value of our data, driving insights that support investment decisions, client reporting, and operational efficiency. The ideal candidate will combine strong technical/Data Engineering skills — particularly with Databricks — with a financial services (insurance, pensions or asset management preferred) environment. Key Responsibilities Develop … maintain, and optimise BI solutions using Databricks and other data tools. Collaborate with investment, risk, and operations teams to gather requirements and deliver actionable insights. Transform complex data sets into clear dashboards, visualisations, and reports for business stakeholders. Ensure data accuracy, governance, and security across reporting processes. Work with large datasets from multiple sources (investment, risk, client More ❯

Forward Deployed Engineer – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions using Palantir Foundry? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you. Morela is proud to partner one of the fasted growing consultancies in … Europe, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled Forward Deployed Engineer to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects. You'll be part of a forward-thinking consultancy … that operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a Forward Deployed Engineer, you'll play a crucial role in designing and implementing data solutions that empower clients to make informed decisions. Core Responsibilities Data More ❯

Senior Data Analyst - SQL & Python Location: West Berkshire - Hybrid working 2 days in the office Reference: J12993 Salary : Neg up to £60,000 DOE Note: Full and current UK working rights required for this role Join a supportive, collaborative team where your inquisitive nature is valued and encouraged. We’re working with a valued and respected client who is … looking to grow their analytical team. You’ll be responsible for leading the strategic analysis and interpretation of complex datasets. Your work will directly inform the development of data products that influence key business and research outcomes. This is a cross-functional role with direct interaction across data engineering, product teams, and stakeholders, both technical and non … technical. About the Role Key Responsibilities Skills Translate complex business requirements into robust data solutions and modelling frameworks. Collaborate with internal stakeholders and clients to gather requirements and deliver high-impact data insights. Own and maintain business and technical documentation, ensuring clarity across the delivery lifecycle. Drive Agile ways of working - contributing to backlog refinement, defining outcomes, and More ❯

Senior Data Engineer (AWS Kafka Python) London/WFH to £85k Are you a tech savvy Data Engineer with AWS expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using AWS native tools, Kafka and modern data architectures, applying AWS Well-Architected Principles to ensure scalability, security and resilience. You’ll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and … fault tolerant data engineering solutions. Location/WFH: There’s a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you: You are an experienced Data Engineer within financial services environments You have expertise with AWS including Lake formation and transformation layers You More ❯

organizations unlock the value of technology and build a more sustainable, more inclusive world. Your Role We are looking for a skilled Spark/Scala Developer to join our data engineering team. The ideal candidate will have hands-on experience in designing, developing, and maintaining large-scale data processing pipelines using Apache Spark and Scala. You will … work closely with data scientists, analysts, and engineers to build efficient data solutions and enable data-driven decision-making. Key Responsibilities: Develop, optimize, and maintain data pipelines and ETL processes using Apache Spark and Scala. Design scalable and robust data processing solutions for batch and real-time data. Collaborate with cross-functional teams to gather … requirements and translate them into technical specifications. Perform data ingestion, transformation, and cleansing from various structured and unstructured sources. Monitor and troubleshoot Spark jobs, ensuring high performance and reliability. Write clean, maintainable, and well-documented code. Participate in code reviews, design discussions, and agile ceremonies. Implement data quality and governance best practices. Stay updated with emerging technologies and More ❯

Snowflake Centre of Excellence Lead - London Who we are: We deliver powerful data and AI solutions that minimise operational cost, strengthen resilience against risk, and uncover revenue opportunity. Our clients can retain our people to drive lasting adoption while futureproofing their workforce with exceptional talent. We’re the preferred partner of today’s leading technology providers, including Databricks, Snowflake … and Collibra, to accelerate delivery and co-create revolutionary solutions. We transform the lives of our consultants, clients, and their customers through data and AI. Role Purpose: As part of our Core Practice, you will be joining a tight knit team of motivated technology professionals where ongoing learning and development are central to our ethos and internal culture. You … developing Snowflake-focused intellectual property, including best practices, accelerators, reusable frameworks, and reference architectures Strengthen our Snowflake partnership by leveraging technical credibility to build trusted relationships with architecture and engineering stakeholders at Snowflake Provide technical assurance on delivery projects, ensuring that all solutions adhere to established Snowflake implementation best practices Contribute to pre-sales activities by shaping proposals, supporting More ❯

core technology crucial to Ki's success – allowing us to evolve underwriting intelligently and unlock massive scale. We're a multi-disciplined team, bringing together expertise in software and data engineering, full stack development, platform operations, algorithm research, and data science. Our squads focus on delivering high-impact features – we favour a highly iterative, analytical approach. We … re looking for a Staff Software Engineer to join our Engineering team. You will provide technical leadership for both delivery squads and the wider engineering organisation. Along with our engineering leadership, you’ll champion engineering excellence and high standards of quality through an environment of continuous improvement. You will be hands-on, directly delivering new impactful … for growth and improvement - Build mock-ups or prototypes to explore and troubleshoot new initiatives - Explore new ideas and emerging technologies, develop prototypes quickly - Uphold and advance the wider engineering team’s principles and ways of working - Promote a culture of continuous improvement, positively influence current ways of working, leading by example - Serve as a domain expert in many More ❯

options About the Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … AI Infrastructure/AI Platform Lead Hybrid London office: minimum 3 days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and … to streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

Engineer Rate - £850 Hybrid working - London What you'll do Design and build AI prototypes using LLMs, agentic workflows, and vector-based knowledge retrieval Collaborate with investment teams and data scientists to identify and scope high-impact use cases Implement and orchestrate multi-agent systems using frameworks such as LangGraph or similar tools Develop pipelines and interfaces for prompt … engineering, context injection, and fine-tuned workflows Build internal demos and proof-of-concepts for investment research, market commentary, and portfolio analysis The knowledge, experience and qualifications you need Strong proficiency in Python, particularly for AI/ML, data engineering, or automation use cases Experience working with or building applications around large language models (open-source or … commercial) Familiarity with LLM agents, orchestration frameworks (e.g. LangGraph, LangChain), and context management Experience with cloud platforms (AWS preferred) and associated services for AI workloads A background in software engineering or data science, ideally in a research-driven or exploratory environment Strong collaboration skills and ability to work with investment stakeholders The knowledge, experience and qualifications that will More ❯

Principal Python Engineer Salary: Up to £130k + bonus Location: London (3x per week) I’m working with a global financial organisation that’s investing heavily in its data and cloud technology platform, and they’re looking for a Python Engineer to join their growing Investment Technology team. You’ll be: Building clean, scalable Python back-end systems Designing … cloud-first solutions in AWS (Lambda, AppSync, DynamoDB) Collaborating with data, investment, and engineering teams Shaping best practices across CI/CD, DevOps, and agile development What we’re looking for: 5+ years’ experience in software engineering (3+ in Python) Needs to have experience within financial services, fintech, or investment tech! Strong AWS and data engineering … of APIs, SQL/NoSQL, and modern software design A problem-solver who enjoys working closely with the business If you’re a Python engineer who loves solving complex data challenges in a collaborative, cloud-first environment — drop me a message: daniel.wexler@sourcegroupinternational.com THIS ROLE DOES NOT PROVIDE SPONSORSHIP More ❯

We make equipment, software, and systems that help to plan, deploy, certify, monitor, and optimize all kinds of networks - like those for mobile phones, service providers, large businesses, and data centers. And we are also at the forefront of optical security - we bend light to develop and deliver optical solutions that provide security to the world's currencies and … and monitor AI workloads in containerized cloud environments (Docker, Kubernetes, AWS/GCP/Azure) Participate in code reviews, architecture discussions, and mentor junior engineers Collaborate cross-functionally with data science, product, and operations teams Champion responsible AI practices and safety mechanisms in all development work Pre-Requisites/Skills/Experience Requirements: Bachelor's degree in Computer Science … Software Engineering, or related field (Master's a plus) Extensive experience in professional software development Strong Python skills and a track record of delivering maintainable, well-tested code Experience with LLM APIs (OpenAI, Hugging Face, Anthropic) or ML frameworks (PyTorch, TensorFlow) Solid understanding of CI/CD, Git, testing, and agile methodologies Hands-on experience with Linux, Docker, and More ❯

ML workflows. Ensure reliability, scalability, observability, and security of production systems and ML infrastructure. Automate deployment, orchestration, and environment management using modern DevOps tooling. Collaborate closely with software engineers, data scientists, and product teams to bring ML-powered features to production. Proactively detect, troubleshoot, and resolve infrastructure and model performance issues. Stay up to date with industry best practices … MLOps, and infrastructure engineering. Document infrastructure, workflows, and operational procedures clearly and thoroughly. We’re Looking For: Proven experience in a senior-level DevOps, MLOps, or related infrastructure-focused engineering role. Strong proficiency in Python and familiarity with ML frameworks such as TensorFlow or PyTorch. Deep experience with cloud platforms (AWS, GCP, or Azure) and container orchestration tools (Docker … Kubernetes). Solid understanding of CI/CD systems (e.g., GitHub Actions, GitLab CI, ArgoCD) and infrastructure-as-code tools (e.g., Terraform, Helm). Familiarity with data engineering concepts such as ETL pipelines, data lakes, and large-scale batch/stream processing. Ability to design scalable, secure, and observable systems in fast-moving environments. Strong debugging and More ❯

About Us: Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed. Company Highlights: Quantiphi, a Services … AI Platforms company, has seen 2.5x growth YoY since its inception in 2013 Headquartered in Boston, with 3300+ data science professionals across 11 global offices Winner of 3X NVIDIA AI Partner of the year award Winner of the 17X Google Cloud Partner of the Year award including "Machine Learning, Breakthrough and Social Impact partner Winner of 3X AWS AI … Recognized Leaders by Gartner, Forrester, IDC, ISG, Everest Group and other leading analyst and independent research firms. Recognized in the Fast Company 2021 World Changing Ideas- AI and Data category Winner of 2021 AWS Canada Rising Star of the Year Be part of a trailblazing team that’s shaping the future of AI, ML, and cloud innovation. Your next More ❯

core technology crucial to Ki's success – allowing us to evolve underwriting intelligently and unlock massive scale. We're a multi-disciplined team, bringing together expertise in software and data engineering, full stack development, platform operations, algorithm research, and data science. Our squads focus on delivering high-impact features – we favour a highly iterative, analytical approach. We … and UX designers to review designs, implement new features, and ensure user experience is top level • Explore new ideas and emerging technologies, develop prototypes quickly • Uphold and advance the engineering team’s principles and ways of working • Serve as a domain expert for one or more of Ki’s core technologies • Mentor and coach colleagues in both engineering and business domain subjects Required Skills and Experience: • Experience as a mid-senior level engineer working across a modern web stack • Strong software engineering principles (SOLID, DRY, ER modelling) • Professional experience with a server-side language, ideally JVM based • Professional experience building web-based single page applications, using React/Typescript or an equivalent • Knowledge of front-end More ❯

seeking a Senior Engineer with strong software experience and ambition to grow and develop their career. Responsibilities: Design and implement scalable, secure backend services to support a high-availability, data-driven SaaS platform operating in a regulated industry. Work primarily with Python to build microservices, automation tools, and backend logic, leveraging its rich ecosystem for data processing, compliance … workflows, and API development. Collaborate with cross-functional teams including product, DevOps, and data engineering to deliver end-to-end functionality that meets regulatory and business requirements. Leverage modern cloud services (AWS, Azure, or GCP) to deploy, monitor, and scale distributed systems in production environments. Establish and uphold engineering best practices, including CI/CD pipelines, automated … testing, and peer code reviews, to ensure code quality, reliability, and auditability. Mentor and guide junior engineers, providing technical leadership and helping shape the team’s engineering culture and standards. Experience: Minimum 5 years’ experience working as a software developer in a commercial environment. Strong python programming experience. Experience of managing teams. Ability to effectively share knowledge of development More ❯

Business Analyst – Power BI | Outside IR35 Location: London once a week | | 6 month contract Why this role matters If you’re a hands-on Technical BA who thrives in data-heavy environments and wants to make a visible impact fast, this one’s for you. You’ll join a global insurance group that’s on a mission to transform … how it reports, visualises and uses data across its portfolio, bringing clarity to senior stakeholders and driving smarter business decisions. What you’ll be doing You’ll take the lead on gathering, defining and refining business requirements for Power BI dashboard projects within their Underwriting Programme. Working with teams across the UK, EU, and US, you’ll bridge the … gap between business needs and data engineering, shaping how group-level reporting comes to life. Expect to: Collaborate with PMs, architects, and data engineers (Power BI & Databricks stack) Translate complex data and business logic into clear, actionable user stories Design and validate visual concepts that help senior stakeholders see the bigger picture Bring structure, speed and More ❯

ll shape the digital and AI ecosystem powering this landmark project. You’ll provide technical leadership, align multi-stakeholder teams, and ensure the secure and scalable integration of multimodal data across global partners. This opportunity offers you A high-impact role within one of Europe’s most ambitious digital health research programmes. The chance to define digital infrastructure and … for multimodal health data. Oversee vendor partnerships, system integration, and performance delivery. Collaborate with AI, software, and clinical teams to build innovative digital health tools. Ensure compliance with healthcare data standards (FHIR, HL7) and data protection regulations. Establish quality and risk frameworks, monitor KPIs, and report on platform progress. You will bring BSc/MSc/PhD (or … in Digital Health, AI, Computer Science, Bioinformatics , or similar. Strong vendor management and supplier negotiation experience. Digital solutions experience within healthcare or another highly regulated industry. Strong knowledge of data engineering, cloud infrastructure, and healthcare interoperability . Excellent leadership, communication, and stakeholder management skills. A collaborative mindset with a passion for advancing responsible, real-world AI in healthcare. More ❯

400m revenue we achieved in 2021 and are looking to grow exponentially over the next few years. We're a multi-disciplined team, bringing together expertise in software and data engineering, full stack development, platform operations, algorithm research, and data science. Our squads focus on delivering high-impact features – we have open and honest conversations about what More ❯