1 to 25 of 71 Data Pipeline Jobs in Berkshire

engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities: Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources … effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote ...

developers (quants and strategists) in a unique hands-on opportunity within a focused, high-impact team. You'll be at the forefront of data and cloud-native engineering, working with modern technologies across AWS, On-premise kubernetes, Python, and data pipelines, while engaging directly with … leading global Investment Banks' front-office. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge faced by all banks, working closely with various businesses and gaining an overview of many different sectors. What We're Looking For 5 + ...

unique opportunity to remain hands-on in engineering while also leading a focused, high-impact team. You'll be at the forefront of data and cloud-native engineering, working with modern technologies across AWS, On-premise kubernetes, Python, and data pipelines, while engaging directly with … leading global Investment Banks' front-office. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge faced by all banks, working closely with various businesses and gaining an overview of many different sectors. What We're Looking For 10 + ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Data Engineer (Inside IR35) £425 Per day SC Cleared - A must to be considered for this opportunity London To support the formation of a new Data Team, there is a critical need to establish robust, scalable, and secure data infrastructure. Currently, data … performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence ...

governance, and security across all platforms. Troubleshoot and enhance existing pipelines to improve scalability and resilience. Sample Projects You Work On Financial Asset Management Pipeline: Build and manage data ingestion from third-party APIs, model data using dbt, and support machine learning workflows for asset … production environments, emphasizing performance optimization and code quality. Python expertise: Advanced proficiency in Python for data engineering, data wrangling and pipeline development. Cloud Platforms: Hands-on experience working with Azure. AWS experience is considered, however Azure exposure is essential. Data Warehousing: Proven expertise ...

Data Engineer – Modern Data & AI Platforms London (Hybrid 2 days) | Contract/Permanent | Global Consulting Environment Build the data foundations behind AI, automation, and real-world impact. We're hiring a Data Engineer to join a fast-growing digital and data … operating across energy, manufacturing, chemicals, infrastructure, automotive, and commodities. This is a hands-on engineering role where you'll design and run the data systems that power analytics, automation, and AI-driven solutions — working alongside consultants, analysts, and data scientists in a true delivery-focused environment. ...

Lead Data Engineer (AWS Snowflake Python) London/WFH to £110k Are you a technologist Data Engineer with strong technical leadership skills? You could be progressing your career in an impactful, hands-on Lead Data Engineer role at a growing technology company as they … expand their UK presence. As a Lead Data Engineer you'll take responsibility for the team's engineering practices such as code reviews and CI/CD and for overall code quality and test coverage. You'll plan and manage the team's Sprints, collaborating closely with product ...

Role Overview We are seeking a high-performing FME Analyst to support the Local Digitisation Programme, delivering high-volume, high-accuracy spatial data automation. This role is critical to enabling scale, consistency, and quality across multiple Local Authorities, supporting both production delivery and automation uplift. The ideal candidate … Collaboration Support daily production delivery across LA waves and batches Collaborate with: o Delivery Pods o QA teams o Automation and data pipeline teams o Programme and Planning leads Provide clear documentation of: o FME logic o Data rules o Exceptions and assumptions Required Skills ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

Senior Data Engineer Job Title: Senior Data Engineer Salary Range: £80,000–£100,000 Location/Working model: London | Hybrid This is a critical technical position within a high-growth, forward-thinking organization that specializes in digital innovation. We require an experienced Senior Data … systems for high-volume data ingestion and processing, implementing effective monitoring, logging, and alerting mechanisms. Performance Optimization: Continuously monitor, tune, and optimize pipeline scalability and performance to meet stringent throughput and latency standards. Cross-Functional Alignment: Partner directly with technical and business teams to ensure the data ...

Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks … Data Engineer to design, develop, and manage data pipelines using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business ...

Data Engineer Salary: Up to £60,000 I am working with a leading Microsoft partner that are currently recruiting for a Data Engineer to join their growing team. This organisation is driving digital transformation for a wide range of businesses across the UK, specialising in delivering … that improve efficiency, enable self-sufficiency and accelerate growth. With a strong focus on scalable analytics and advanced business intelligence, they are modernising data platforms to deliver future-ready solutions. This is a chance to join a genuinely people-focused, high-performing consultancy where you play a trusted ...

Senior Data Engineer Salary: Up to £70,000 I am working with a leading Microsoft partner that are currently recruiting for a Senior Data Engineer to join their growing team. This organisation is driving digital transformation for a wide range of businesses across the UK, specialising … that improve efficiency, enable self-sufficiency and accelerate growth. With a strong focus on scalable analytics and advanced business intelligence, they are modernising data platforms to deliver future-ready solutions. This is a chance to join a genuinely people-focused, high-performing consultancy where you play a trusted ...

Data Engineer – SC Cleared (or Clearable) Location: Remote/London occasional visits to London Salary: Up to £70,000 Start Date: ASAP About the Role Join a dynamic Digital Transformation Consultancy as a Data Engineer and play a pivotal role in delivering innovative, data … What We're Looking For: Proven hands-on experience in data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services ...

well-established professional services business is hiring a Data Engineer to play a key role in building and optimising its modern cloud data environment. This is a technical, hands-on role with team management responsibilities – ideal for someone who wants to stay close to the tech … while guiding and developing a growing team. Role: Data Engineer Salary: £70,000 - £85,000 Location: Guildford – 5 days per week onsite What you'll be doing: Design, build, and optimise scalable data pipelines and architecture Work hands-on with SQL, PySpark, Databricks, Azure, and Data ...

looking for a Data Engineer who will design and implement customer data solutions that enable personalised experiences while ensuring privacy, quality, and accessibility of customer information across all touchpoints. Length: 12 months Location: London, UK Environment: Hybrid - 2-3 days in the office Key responsibilities: Leading … engineering decisions for customer data, including infrastructure, APIs and data pipelines Defining & delivering company's identity customer 360 solutions, ensuring seamless integration across different customer-facing platforms Architecting and implementing real-time data integration Designing and enforcing consent and preference management systems in compliance ...

Founding Solutions Data Architect London/WFH to £115k Are you a data technologist with start-up experience looking for your next opportunity? You could be progressing your career, in a founding position at a tech start-up that is producing an AI native data pipelining platform. As the Founding Solutions Data Architect you'll play a vital role in helping client data teams to adopt and scale the company's platform. You'll be responsible for a broad range of activities including Solution Design and Architecture, Technical Onboarding ...

well as modernising legacy pipelines. If you like building data infrastructure where you can see the direct impact on conversion rates, pipeline quality, and reporting speed, this role will suit you. About You You're a data engineer with 3+ years' experience who thrives … understandable, not just making things work once. Most importantly, you care about outcomes. You measure the impact of your work on conversion rates, pipeline velocity, and data quality. You're excited to join a mission-driven organisation where better data infrastructure means better outcomes ...

with digital twin frameworks (topology/graph modeling, intent-based orchestration), AIOps platforms (anomaly detection, noise reduction, predictive insights), and streaming/data pipelines (Kafka, Pub/Sub, Dataflow) Familiarity with cloud-native (GCP/Azure/AWS), Kubernetes, API-first integration, and observability stacks (metrics, logs, traces ...

models for education - solving the ultimate learning task of predicting student knowledge and optimal 'next task' Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable … English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create ...

Senior Data Scientist Up to £100K Xcede is currently partnering with the world's largest multinational services company as they continue to expand their central data solutions capability. In this role, your work will be rolled out across a truly global legal organisation, shaping how advice … delivered to clients in 80+ countries worldwide. You'll use data and machine learning to enhance legal processes, support strategic decision-making, and deliver forward-looking insights to an international client base. This includes designing innovative, data-driven solutions, building proof-of-concepts, and converting them ...

Title: Sr. Project Manager/Program Manager - GCP/Data Factory (OSS) Location: Reading, UK- 3 days onsite Job Type: Permanent/Fixed Term Job Summary: Job Role: We are seeking an experienced GCP/Data Factory Program Manager with 15+ years in the Telecom domain … lead strategic data transformation programs leveraging Google Cloud Platform (GCP) and modern data engineering frameworks. The role involves defining the data strategy, overseeing migration from legacy systems to cloud-native architectures, and implementing scalable data pipelines and analytics solutions using GCP services ...

leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £90,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager will … come from a data engineering background and have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role ...

client, an award-winning fintech specialising in investment and insurance data solutions, is urgently seeking a Senior Data Engineer. You will work with actuarial and asset management datasets, building end-to-end data pipelines in Python (Pandas, NumPy), SQL, GCP (BigQuery), DBT, and Databricks. … This role focuses on large-scale financial data, automating processes, integrating multiple data sources, and delivering actionable insights to senior stakeholders. Only candidates with direct experience in investment, asset management, or reinsurance/insurance operations handling financial securities or actuarial outputs will be considered. Key Skills ...