26 to 50 of 258 Data Pipeline Jobs in Berkshire

twentyAI are partnering with a globally renowned law firm currently undergoing a major digital and data transformation. With a deep-rooted legacy in legal excellence and a strong global footprint, the firm is currently modernising their data capability and building a new data platform. About the Role You will be part of a diverse … group of engineers and machine learning experts, working with cutting-edge Azure cloud technologies, including Microsoft Fabric and related services. Your mission is to design reliable, efficient data pipelines that enable the business to access trusted, well-structured data. You will also focus on building and scaling the core data infrastructure that supports advanced analytics and … machine learning efforts across the business. Responsibilities Design and develop end-to-end data pipelines that ingest, transform, and prepare data for analytics and machine learning workflows. Work with Infrastructure as Code, primarily Terraform, to automate and manage cloud infrastructure, enabling repeatable and reliable deployment processes. Collaborate closely with data scientists, MLEs, and business More ❯

NO SPONSORSHIP OPTION** Title: AI & Data Platform Engineer Salary/Package: £50k-£60k Company Sector: Techforgood (Sustainability) WFH/Hybrid: 2 days a week on site (East London) Bounce are excited to partner with a customer we helped secure a Lead Data Engineer earlier this year, he's now looking for his first hire to join … are a fast-growing business focused on sourcing, refurbishing, and reselling IT devices to create real social and environmental impact. We're hiring a foundational member of the Data & AI team to build the early infrastructure powering smarter pricing, faster sales, and more efficient operations. You'll start by owning data pipelines, reporting, and validation systems … What You’ll Do (First 3–6 Months) Build automated ETL pipelines (Bronze-Silver-Gold architecture) Develop dashboards and reporting in Looker or Power BI Ingest and clean data from internal (Odoo/PostgreSQL) and external (eBay APIs) sources Define data quality rules, set up monitoring/logging, and support architecture decisions What You Bring Strong More ❯

Job Description: The PNE Data Foundations Sr Lead ensures that Pet Nutrition Europe (PNE) has a strong, governed, and scalable data foundation to enable high-quality analytics and insights. This role is critical in bridging the gap between the AOE D&A data team and PNE, ensuring alignment with global data models … governance principles, and strategic data initiatives such as the DDF (Digital Data Foundation) program. What are we looking for? Preferred education Is a university degree In business or IT Strong background in data engineering, data governance, and data architecture, ideally in a multinational or matrixed organization. 5+ years of experience … in data engineering, analytics, or data management, with hands-on expertise in cloud-based data platforms (e.g., Azure, AWS, GCP, Snowflake). Proven expertise in designing, developing, and maintaining scalable data pipelines, ETL/ELT processes, and integrations to support advanced analytics. Experience with data governance frameworks, master data More ❯

Join a Leading Growth business on its transformative journey to become the UK's most recommended businesses in their industry Lead Data Engineer Salary: £70-90k Location: Reading – Hybrid Benefits: Competitive Role Overview: As Lead Data Engineer , you will be part of the Corporate Data team, reporting directly to the Senior Leadership team. … You will lead a small team of data engineers, overseeing the design, build, and maintenance of the infrastructure and systems that collect, store, and process corporate data for reporting and analysis. Key Responsibilities: • Lead and manage a team of data engineers. • Design, build, and maintain data infrastructure and systems. • Ensure effective use … of Microsoft Fabric and Synapse analytics platform. • Collaborate with various stakeholders, including Data and Systems owners, Data Analysts, Data Architects, Infrastructure Architects, and external suppliers. Experience required • Dynamic and hands-on leader who excels in managing and coaching a team. • Thrives in a collaborative environment and adapts to changing priorities with ease. • Excellent communication More ❯

Join a Leading Growth business on its transformative journey to become the UK's most recommended businesses in their industry Lead Data Engineer Salary: £70-90k Location: Reading – Hybrid Benefits: Competitive Role Overview: As Lead Data Engineer , you will be part of the Corporate Data team, reporting directly to the Senior Leadership team. … You will lead a small team of data engineers, overseeing the design, build, and maintenance of the infrastructure and systems that collect, store, and process corporate data for reporting and analysis. Key Responsibilities: • Lead and manage a team of data engineers. • Design, build, and maintain data infrastructure and systems. • Ensure effective use … of Microsoft Fabric and Synapse analytics platform. • Collaborate with various stakeholders, including Data and Systems owners, Data Analysts, Data Architects, Infrastructure Architects, and external suppliers. Experience required • Dynamic and hands-on leader who excels in managing and coaching a team. • Thrives in a collaborative environment and adapts to changing priorities with ease. • Excellent communication More ❯

Social network you want to login/join with: Software Engineer (Consultant) - Data & AI, slough col-narrow-left Client: Pace Location: slough, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 2 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: Job Title: Software Engineer (Consultant) - Data & AI Location: London … Client Lifecycle Management (CLM) system for a leading accounting firm. This role is hands-on and impactful – you’ll be designing and building key technical components such as data migrations, Azure-hosted integrations, and system connectivity across Power Platform, Dataverse, and the firm’s practice management system. You’ll work across a modern stack – including Azure Logic Apps … mix of Python, C#, and Typescript – all supported by robust CI/CD pipelines and infrastructure automation. Your contributions will be central to ensuring secure, accurate, and timely data movement across the CLM ecosystem. Working alongside the Technical Business Analyst, Test Manager, Change Manager, and Project Manager, you will contribute across key technical workstreams — including endpoint builds, integration More ❯

Senior Data Analyst – Real Estate Investment Firm 📍 London, UK (Hybrid – 3 days in office) 🕒 Full-time | Real Estate Investment Firm 💰 Salary: Up to £60,000 per year + benefits Are you passionate about transforming complex data into meaningful insights that drive global strategy? A leading real estate investment firm is looking for a Senior Data Analyst to join their Global Programs team and play a key role in delivering data-driven solutions across international operations. 🔍 What You’ll Do: Design and deliver enterprise, regional, and local dashboards and reporting tools Uncover actionable insights from operational data through advanced analytics and storytelling Collaborate across departments (Tech, Finance, Operations) to improve … data infrastructure Build and automate data pipelines for cross-functional business reporting Ensure data quality, compliance, and adherence to governance standards Support and execute data migrations within ERP systems as part of transformation and integration projects 🧠 What You Bring: 5+ years of experience in data analytics or reporting Strong skills More ❯

login/join with: Duration: contract to run until 31/12/2025 Rate: up to £644 p/d Umbrellainside IR35 We are seeking an experienced Data Modeller with proven expertise in the London Market insurance sector. The successful candidate will play a key role in designing and validating data models that support enterprise … data initiatives. This includes working closely with data engineers, architects, and business stakeholders to ensure data structures are scalable, accurate, and aligned with business needs. Key Skills/requirements Design and maintain conceptual, logical, and physical data models to support reporting, analytics, and operational systems. Collaborate with data engineers and … to non-technical stakeholders. Preferred Skills: Experience with insurance platforms such as Guidewire, Duck Creek, or legacy PAS systems. Knowledge of Delta Lake, Apache Spark, and data pipeline orchestration tools. Exposure to Agile delivery methodologies and tools like JIRA, Confluence, or Azure DevOps. Understanding of regulatory data requirements such as Solvency II, Core Data More ❯

join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by a huge Multi National equity firm who are looking to bolster my client's financial position. They are expected to … and utilise the most in-demand and cutting-edge technology on the market right now. Your role will include: Collaborate closely with stakeholders to understand and interpret their data and analytics needs. Design and deploy end-to-end data solutions using Microsoft Fabric, encompassing data ingestion, transformation, and visualisation workflows. Construct and refine data models, pipelines, and ETL frameworks within the Fabric ecosystem. Leverage Fabric’s suite of tools to build dynamic reports, dashboards, and analytical applications. Maintain high standards of data integrity, consistency, and system performance across the data environment. Advise on data governance, security protocols, and compliance strategies aligned with industry best practices. Diagnose and More ❯

Social network you want to login/join with: Data and AI - Senior Consultants/Senior Managers, slough col-narrow-left Client: Wavestone Location: slough, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: Company Description Wavestone is a leading global transformation … value. D&AI Architecture & Platform Advisory : Combining architectural assessments with platform selection guidance, providing vendor-independent recommendations for optimal data ecosystem design. Data Migration, Integration & Pipeline Support : Providing strategic guidance on data migration and integration approaches, logical pipeline design, and data flow orchestration, based on best-practice architectural patterns that … and associated architectural patterns. Strong understanding of methodologies and principles of data science and MLOps, including model development, validation, and lifecycle management. Experience in data pipeline design, ETL/ELT processes, and data integration approaches and appreciation of trade-offs associated with specific use-cases and architectural choices. Knowledge of data More ❯

Social network you want to login/join with: Senior Data Analyst (Ref: 184942), slough Our client, a fast-growing company in the financial services sector, is seeking a Senior Data Analyst to support its continued expansion. The ideal candidate will bring a strong understanding of the insurance industry, along with hands-on experience in delivering … end-to-end data solutions—such as building data lakes, developing ETL processes, and deploying data visualization tools. Working closely with global teams and reporting to the Group Data Lead , the Senior Data Analyst will play a key role in shaping and executing the company’s data strategy … enabling more efficient and effective client service. JOB Responsibilities: Perform statistical analysis and data modeling Clean, analyze, and interpret data from multiple sources Communicate insights to both technical and non-technical audiences Ensure data quality through governance and regular checks Design and implement data pipelines, ETL processes, and dashboards Apply knowledge of More ❯

About Apexon: Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation is built on a comprehensive suite of engineering services, a dedication to … Sachs Asset Management and Everstone Capital, Apexon now has a global presence. About the Role We are seeking a highly motivated and experienced AI Engineer to join our Data and AI team . This role is ideal for someone who has a strong track record of designing, developing, and deploying AI/ML solutions in a business context … channels for our Financial Services client. Key Responsibilities End-to-End AI Solution Delivery: Lead AI/ML initiatives from conceptual design to production deployment, including problem scoping, data acquisition, model development, validation, deployment, and monitoring. AI-Driven Marketing Insights: Develop predictive and generative models to support audience segmentation, personalization, channel optimization, lead scoring, and campaign measurement. Collaborative More ❯

Social network you want to login/join with: Our client a London based Technology and Data Engineering leader have an opportunity in a high growth AI Lab for an ‘AI Engineering Researcher' A UK based 'Enterprise' Artificial Intelligence organisation, focussing on helping accelerate their clients journey towards becoming 'AI-Optimal' - starting with significantly enhancing its abilities in … team of exceptional PhD computer scientists, software engineers, mathematicians & physicists, to use a unique multi-disciplinary approach to solving enterprise-AI problems. Principal Activities of role: Data Pipeline Development: • Design, develop, and maintain ETL processes to efficiently ingest data from various sources into data warehouses or data lakes. • Data Integration and Management: Integrate data from disparate sources, ensuring data quality, consistency, and security across systems. Implement data governance practices and manage metadata. • System Architecture: Design robust, scalable, and high-performance data architectures using cloud-based platforms (e.g., AWS, Google Cloud, Azure). • Performance Optimization: Monitor, troubleshoot, and optimize data More ❯

Data Engineering Manager | Top Brokerage in London | £110,000 - £120,000 Base + Bonus I'm looking for an experienced Data Engineering Manager to join a leading Brokerage in Central London and lead an initial team of 2 Senior Data Engineers. You will be responsible for managing large-scale data pipelines, ensuring … data quality and integrity, and supporting cross-functional teams with reliable and scalable data solutions—primarily using Microsoft Azure, Python, Databricks , as well as the integration of Microsoft Fabric . This role will require 3 days a week onsite in their state of the art office and will remain a technically hands on role. Key Responsibilities … Design, build, and manage scalable data pipelines and ETL/ELT processes in Azure Data Factory , Databricks , and other Azure services. Develop and maintain data models, data lakes, and data warehouses (e.g., Azure Synapse). Use Python for data manipulation, transformation, and automation tasks. Collaborate with data More ❯

London/Hybrid | 💷 £750/day | 🗓 12-Month Rolling | ✅ Outside IR35 Our client, a leading Investment Management firm, is looking for a contract Data Engineer with strong Python and Databricks skills to help drive their data platform modernisation. You’ll be working on business-critical data pipelines and analytics infrastructure, supporting both investment and … operations teams. This is a hands-on role in a fast-moving environment, ideal for someone who thrives in financial services. What you’ll be doing: Building scalable data pipelines in Python and Databricks Designing data models to support analytics, reporting & regulatory needs Working with cloud-based data platforms (Azure preferred) Partnering closely with … data analysts, quants, and tech teams Tech you’ll be using: Python (strong hands-on coding essential) Databricks/Spark Azure Data Lake/Delta Lake SQL/ETL frameworks CI/CD tools and version control (Git, Azure DevOps) What we’re looking for: Strong commercial experience as a Data Engineer Deep Python More ❯

Our Client We power the future of Marketing and realise business value by applying human creativity to AI, data, and technology. Our expert consultants partner with leading brands to unlock the power of their enterprise data and transform their Marketing capabilities, building sustainable value in a privacy-respectful way. Integrating enterprise technologies, Google’s ecosystem, and … our proprietary solutions to clients' first-party data, we create innovative solutions and unlock the power of AI, delivering tangible ROIs for our clients. Our expert consultants orchestrate Google Marketing and Google Cloud technologies to unlock ultimate AI-powered performance within our client’s organisation. About the Role As one of our Data Engineers, you will … be part of a team responsible for the development and overall delivery of big data platform solutions, automation solutions and data AI Agents. You will be designing and proposing effective combinations of Google Marketing Platform tools (GA4, Campaign Manager 360, Search Ads 360, etc.) and Google Cloud solutions (BigQuery, BQ Sharing (Analytics Hub), Cloud Storage, APIs More ❯

The role Position: Data Analyst Contract type: Full Time/Permanent Reporting to: Head of Data Location: London Overview of role Zodiac Maritime is undergoing an exciting data transformation, and we’re looking for a talented Data Analyst to join our growing data team. In this role, you’ll be … instrumental in supporting the Head of Data in building and deploying fit for purpose data quality management capability underpinned by modern data stack (Azure Databricks, ADF and Power BI), ensuring that data is reliable and trustworthy, then extract insights from it to improve operations and optimise resources. Key responsibilities and primary deliverables … Drive requirements for data quality measurement. Build reports & dashboards for data quality and other business problems as per business priorities using Power BI and Databricks Dashboard Create and maintain the data quality tracker to document rule planning and implementation. Deliver continuous improvements of data quality solution based upon feedback. Investigation and analysis More ❯

Join us a Data Analyst for our client. At Peregrine, we’re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector – we are always in search of the best talent to … across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: The business is undergoing an exciting data transformation, and we’re looking for a talented Data Analyst to join our growing data team. In this role, you’ll be instrumental in supporting … the Head of Data in building and deploying fit for purpose data quality management capability underpinned by modern data stack (Azure Databricks, ADF and Power BI), ensuring that data is reliable and trustworthy, then extract insights from it to improve operations and optimise resources. Key responsibilities & deliverables: Drive requirements for data More ❯

population while taking care of our planet. Join us and help shape the future of agriculture. Job Description We have an exciting opportunity for a passionate and experienced Data engineer to join our R&D IT team to design and own data publishing scenarios for our Bioinformatics Platform! You will collaborate with the platform team to … design and establish data governance policies and procedures, while designing production-grade ETL processes to integrate data. Key responsibilities will include: Working closely with bioinformaticians to design, build, and maintain scalable data pipelines for processing multi modal -omics datasets. Establishing and enforcing data quality standards. Developing and optimizing database schemas for efficient storage and … retrieval of bioinformatics and biological data. Leveraging cloud technologies to build and maintain scalable, cost-effective data solutions. Ensuring data FAIRness and integrity, including third-party bioinformatics tools and databases. Establishing guard-rails and document best practices to support the data platform users, and drive platform adoption. Qualifications What we are looking for? Awareness More ❯

Graduate Development Programme Locations: London Starting Salary: £28,000 Application Requirements: Minimum 2:1 or above in a STEM (Science, Technology, Engineering, and Math) subject Experience in analysing data Right to work in the UK unsponsored for the duration of the programme Ability to work on site 5 days a week Grayce is not on the UK Border … delivering excellence. If you have a keen attention to detail and accuracy, a knack for spotting trends and patterns, and the ability to tell a compelling story using data, you'll thrive in our environment. We value resourcefulness, resilience, and a passion for driving change. Join us and be part of a community that cares, collaborates, and thrives … together. Understanding the roles available to a Graduate Digital Analyst: Data Analyst: Kick-start your career as a Data Analyst, transforming complex data into actionable insights, creating dynamic visualisations, and driving business decisions. Work with cutting-edge tools, collaborate with stakeholders, and develop automated reports and dashboards to refine your technical skills in a More ❯

highly skilled Generative AI Architect to lead the design and implementation of advanced AI solutions tailored for professional services. This role requires expertise in AI-driven decision automation , data-driven insights , and scalable architecture to enhance business processes and client outcomes. As a key member of our team, you will architect solutions that learn, reason, and make intelligent … AI algorithms for predictive analytics, recommendation engines, and automation in professional services. Apply machine learning (ML) and deep learning (DL) techniques to enhance decision-making and business intelligence. Data Engineering & Integration Architect robust data pipelines to support AI model training and inference. Implement automated data collection, integration, cleansing, and transformation techniques to ensure high … quality data inputs. Collaborate with data engineering teams to align AI solutions with real-world business applications. AI Model Training, Evaluation & Performance Optimization Train AI models using supervised, unsupervised, and reinforcement learning techniques , refining them based on business insights . Define model performance metrics to ensure AI solutions deliver tangible value. Real-Time AI Applications & System More ❯

for musicians and artists to use to promote their music. At un:hurd music, we've created a music-tech platform that uses proprietary technology to turn music data into stronger promotional campaigns for artists. We've created both mobile and web applications which act as the 'digital marketing companion' for independent artists, facilitating data-led … responsible for the software development and technical infrastructure needed to design, train, deploy and scale machine learning models in production environments. You will harness a diverse array of data sources, from streaming services to social media, revolutionizing the way artists promote their music. Our Data Team members are full stack data professionals who independently … manage projects across the complete spectrum, from raw data ingestion to deployment, monitoring, and optimization. While this role emphasizes data engineering and ML deployment, you will have the responsibility of managing projects with autonomy across the full data lifecycle. Responsibilities📝 As an ML Engineer at Un:hurd music, you'll be: MLOps and Model More ❯

As a Data Specialist at this tech scaleup in London, you will analyse, collect, sort, and create data solutions that integrate across multiple products. You will steer decisions regarding data and build the models that power their products. You will take client insights and requirements and make them a reality, by developing datasets and … drive innovation into the product development process. You will interpret your client’s objectives, desires, and preferences to help the wider technical team understand the opportunities and apply data engineering responsibilities consistently. You will be working on an interesting range of projects that deliver to National Security customers and as such, you will have to hold the highest … pipelines that are tested and robust using a variety of technologies and techniques depending on the available technologies (Nifi, Spark) Build analytics tools that utilise the data pipeline to provide actionable insights into client requirements, operational efficiency, and other key business performance metrics. Complete onsite client visits and provide excellent customer support service. Problem-solve in a More ❯

Job Title: Data Engineer (with AI Engineering Experience) Location: Hybrid (UK-based) Outside IR35 Contract role - 6 months rolling Industry: Energy/Wholesale Markets & Trading We’re looking for a skilled Data Engineer with Artificial Intelligence (AI) experience to join a cutting-edge team within one of the UK’s leading energy companies. This role sits … within the organisation’s Wholesale Market Services and Trading division, a key area focused on enabling smarter, data-driven decision-making in fast-paced energy markets. You’ll play a pivotal role in designing and delivering complex, cloud-native data solutions that support trading operations, risk management, market forecasting, and AI-led optimisation initiatives. Key Responsibilities … Design, build, and maintain robust data pipelines and cloud-based infrastructure to support large-scale data processing and analytics workloads. Collaborate with data scientists and AI engineers to productionise machine learning models and support intelligent automation solutions. Contribute to the development and enhancement of the enterprise data platform with scalable, high-quality More ❯

Job title: Senior Data Solutions Architect Type: Contract Duration: 12 months Location: London, UK (Hybrid) Daily rate: DOE Description: We're working with a large, established client in the Banking sector who are looking to welcome Senior Data Solutions Architects onto the team as they undergo a large transformation program. Key responsibilities: Take ownership of designing … designs , ensuring they meet functional requirements and align with long-term technology roadmaps . Oversee architecture management , driving continuous refinement and improvement of systems. Work with cutting-edge data technology stacks and cloud infrastructure, balancing foundational data solutions with emerging AI and ML capabilities . Collaborate with delivery teams and engineers to define project scopes and … with internal standards. Qualifications: Agile Delivery Expertise - Extensive experience in driving technical solutions within agile frameworks. Solution Architecture Proficiency - Demonstrated success in designing robust solution architectures , particularly in data platforms and complex pipelines , preferably within cloud environments (AWS, GCP, Azure) . Deep Application Design Knowledge - Expertise in architecting low-latency, scalable solutions to meet performance, availability, and resilience More ❯