1 to 25 of 73 Data Pipeline Jobs in Berkshire

engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities: Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources … effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote ...

developers (quants and strategists) in a unique hands-on opportunity within a focused, high-impact team. You'll be at the forefront of data and cloud-native engineering, working with modern technologies across AWS, On-premise kubernetes, Python, and data pipelines, while engaging directly with … leading global Investment Banks' front-office. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge faced by all banks, working closely with various businesses and gaining an overview of many different sectors. What We're Looking For 5 + ...

unique opportunity to remain hands-on in engineering while also leading a focused, high-impact team. You'll be at the forefront of data and cloud-native engineering, working with modern technologies across AWS, On-premise kubernetes, Python, and data pipelines, while engaging directly with … leading global Investment Banks' front-office. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge faced by all banks, working closely with various businesses and gaining an overview of many different sectors. What We're Looking For 10 + ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Data Engineer (Inside IR35) £425 Per day SC Cleared - A must to be considered for this opportunity London To support the formation of a new Data Team, there is a critical need to establish robust, scalable, and secure data infrastructure. Currently, data … performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence ...

LatentView Analytics is a leading global analytics and decision sciences provider, delivering solutions that help companies drive digital transformation and use data to gain a competitive advantage. With analytics solutions that provide a 360-degree view of the digital consumer, fuel machine learning capabilities and support artificial intelligence … technical and non-technical audiences A proactive, growth-oriented mindset, passionate about improving data accessibility and scalability Responsibility: Data Engineering & Pipeline Development: Design, build, and maintain ETL/ELT data pipelines to consolidate and transform customer success data from multiple international ...

governance, and security across all platforms. Troubleshoot and enhance existing pipelines to improve scalability and resilience. Sample Projects You Work On Financial Asset Management Pipeline: Build and manage data ingestion from third-party APIs, model data using dbt, and support machine learning workflows for asset … production environments, emphasizing performance optimization and code quality. Python expertise: Advanced proficiency in Python for data engineering, data wrangling and pipeline development. Cloud Platforms: Hands-on experience working with Azure. AWS experience is considered, however Azure exposure is essential. Data Warehousing: Proven expertise ...

Data Engineer – Modern Data & AI Platforms London (Hybrid 2 days) | Contract/Permanent | Global Consulting Environment Build the data foundations behind AI, automation, and real-world impact. We're hiring a Data Engineer to join a fast-growing digital and data … operating across energy, manufacturing, chemicals, infrastructure, automotive, and commodities. This is a hands-on engineering role where you'll design and run the data systems that power analytics, automation, and AI-driven solutions — working alongside consultants, analysts, and data scientists in a true delivery-focused environment. ...

Title: Data Architect/Data Modeler - P&C Insurance Domain Contract/Permanent – Open for Both Mode of work: Hybrid 3 days onsite/week Roles and responsibilities • Lead the design and implementation of scalable data architecture supporting analytics and digitalization agenda … cross-functional team of architects from business and technology • Develop and maintain data models (Logical and Physical) to support business needs ensuring data integrity and efficiency. • Design and govern data architecture and integration standards across Azure Data Factory and Databricks to enable ...

Factory, Databricks, and related Azure services. Build ETL/ELT processes to transform raw data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data … ADLS, Azure SQL Database, Synapse Analytics). Strong hands-on expertise in Databricks, Delta Lake, and cluster management. Proficiency in SQL and Python for pipeline development. Familiarity with Git/GitHub and CI/CD practices. Understanding of data modelling, data governance, and security principles. ...

Role Overview We are seeking a high-performing FME Analyst to support the Local Digitisation Programme, delivering high-volume, high-accuracy spatial data automation. This role is critical to enabling scale, consistency, and quality across multiple Local Authorities, supporting both production delivery and automation uplift. The ideal candidate … Collaboration Support daily production delivery across LA waves and batches Collaborate with: o Delivery Pods o QA teams o Automation and data pipeline teams o Programme and Planning leads Provide clear documentation of: o FME logic o Data rules o Exceptions and assumptions Required Skills ...

Lead Data Engineer (SQL Python Snowflake) London/WFH to £85k Are you a skilled data technologist with strong leadership and stakeholder management skills? You could be progressing your career in a senior, hands-on Data Engineer position at a global tech company that … provide data centric software solutions to major blue-chip and government organisations to enable them to discover and analyse data and customer feedback. What's in it for you: As a Lead Data Engineer you'll earn a competitive package: Salary to £85k Bonus ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

Senior Data Engineer Job Title: Senior Data Engineer Salary Range: £80,000–£100,000 Location/Working model: London | Hybrid This is a critical technical position within a high-growth, forward-thinking organization that specializes in digital innovation. We require an experienced Senior Data … systems for high-volume data ingestion and processing, implementing effective monitoring, logging, and alerting mechanisms. Performance Optimization: Continuously monitor, tune, and optimize pipeline scalability and performance to meet stringent throughput and latency standards. Cross-Functional Alignment: Partner directly with technical and business teams to ensure the data ...

Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks … Data Engineer to design, develop, and manage data pipelines using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business ...

Data Engineer Salary: Up to £60,000 I am working with a leading Microsoft partner that are currently recruiting for a Data Engineer to join their growing team. This organisation is driving digital transformation for a wide range of businesses across the UK, specialising in delivering … that improve efficiency, enable self-sufficiency and accelerate growth. With a strong focus on scalable analytics and advanced business intelligence, they are modernising data platforms to deliver future-ready solutions. This is a chance to join a genuinely people-focused, high-performing consultancy where you play a trusted ...

Senior Data Engineer Salary: Up to £70,000 I am working with a leading Microsoft partner that are currently recruiting for a Senior Data Engineer to join their growing team. This organisation is driving digital transformation for a wide range of businesses across the UK, specialising … that improve efficiency, enable self-sufficiency and accelerate growth. With a strong focus on scalable analytics and advanced business intelligence, they are modernising data platforms to deliver future-ready solutions. This is a chance to join a genuinely people-focused, high-performing consultancy where you play a trusted ...

Data Engineer – SC Cleared (or Clearable) Location: Remote/London occasional visits to London Salary: Up to £70,000 Start Date: ASAP About the Role Join a dynamic Digital Transformation Consultancy as a Data Engineer and play a pivotal role in delivering innovative, data … What We're Looking For: Proven hands-on experience in data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services ...

well-established professional services business is hiring a Data Engineer to play a key role in building and optimising its modern cloud data environment. This is a technical, hands-on role with team management responsibilities – ideal for someone who wants to stay close to the tech … while guiding and developing a growing team. Role: Data Engineer Salary: £70,000 - £85,000 Location: Guildford – 5 days per week onsite What you'll be doing: Design, build, and optimise scalable data pipelines and architecture Work hands-on with SQL, PySpark, Databricks, Azure, and Data ...

Data Engineer — Hedge Fund (L/S Equity) | London A fundamentally driven long/short equity fund focused on the European Industrials sector is seeking a Data Engineer for a variety of greenfield development. Founded by a former Citadel portfolio manager, the team brings together expertise … frameworks Experience designing and maintaining cloud-based data pipelines (e.g. AWS, Airflow, Snowflake) Deep understanding of data modelling, validation, and pipeline resilience Familiarity with financial or alternative datasets preferred ...

well as modernising legacy pipelines. If you like building data infrastructure where you can see the direct impact on conversion rates, pipeline quality, and reporting speed, this role will suit you. About You You're a data engineer with 3+ years' experience who thrives … understandable, not just making things work once. Most importantly, you care about outcomes. You measure the impact of your work on conversion rates, pipeline velocity, and data quality. You're excited to join a mission-driven organisation where better data infrastructure means better outcomes ...

Data Scientist [Analyst/Associate] About the job As a Data Scientist on the AI team at Cerberus, you'll work on high-impact projects that combine the pace of a startup with the reach of a global investment platform. Our team partners directly with internal … pricing and valuation across diverse asset classes to dynamically optimizing prices under changing market conditions. You'll be expected to translate complex data into actionable insights and ensure your solutions are not only technically sound but also adopted and delivering measurable business value, supporting deal team members ...

with digital twin frameworks (topology/graph modeling, intent-based orchestration), AIOps platforms (anomaly detection, noise reduction, predictive insights), and streaming/data pipelines (Kafka, Pub/Sub, Dataflow) Familiarity with cloud-native (GCP/Azure/AWS), Kubernetes, API-first integration, and observability stacks (metrics, logs, traces ...

models for education - solving the ultimate learning task of predicting student knowledge and optimal 'next task' Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable … English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create ...

Senior Data Scientist Up to £100K Xcede is currently partnering with the world's largest multinational services company as they continue to expand their central data solutions capability. In this role, your work will be rolled out across a truly global legal organisation, shaping how advice … delivered to clients in 80+ countries worldwide. You'll use data and machine learning to enhance legal processes, support strategic decision-making, and deliver forward-looking insights to an international client base. This includes designing innovative, data-driven solutions, building proof-of-concepts, and converting them ...