1 to 25 of 94 Permanent Data Pipeline Jobs in the Thames Valley

engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities: Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources … effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote ...

developers (quants and strategists) in a unique hands-on opportunity within a focused, high-impact team. You'll be at the forefront of data and cloud-native engineering, working with modern technologies across AWS, On-premise kubernetes, Python, and data pipelines, while engaging directly with … leading global Investment Banks' front-office. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge faced by all banks, working closely with various businesses and gaining an overview of many different sectors. What We're Looking For 5 + ...

unique opportunity to remain hands-on in engineering while also leading a focused, high-impact team. You'll be at the forefront of data and cloud-native engineering, working with modern technologies across AWS, On-premise kubernetes, Python, and data pipelines, while engaging directly with … leading global Investment Banks' front-office. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge faced by all banks, working closely with various businesses and gaining an overview of many different sectors. What We're Looking For 10 + ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Data Engineer (Inside IR35) £425 Per day SC Cleared - A must to be considered for this opportunity London To support the formation of a new Data Team, there is a critical need to establish robust, scalable, and secure data infrastructure. Currently, data … performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence ...

Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth … management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Engineer will include: Understand ...

seeking an experienced Data Architect to join our Group Technology team in Milton Keynes. You will help realise the value of the immense Connells Group dataset for the benefit of customers, colleagues and the overall business. You will use your expertise to define, evolve and communicate the existing … enterprise data architecture, to democratise safe access to data to help engineering teams create personal, relevant and timely customer experiences. The data architecture will also support colleagues in accessing data, getting insights and providing next best actions for faster and aligned decision ...

LatentView Analytics is a leading global analytics and decision sciences provider, delivering solutions that help companies drive digital transformation and use data to gain a competitive advantage. With analytics solutions that provide a 360-degree view of the digital consumer, fuel machine learning capabilities and support artificial intelligence … technical and non-technical audiences A proactive, growth-oriented mindset, passionate about improving data accessibility and scalability Responsibility: Data Engineering & Pipeline Development: Design, build, and maintain ETL/ELT data pipelines to consolidate and transform customer success data from multiple international ...

governance, and security across all platforms. Troubleshoot and enhance existing pipelines to improve scalability and resilience. Sample Projects You Work On Financial Asset Management Pipeline: Build and manage data ingestion from third-party APIs, model data using dbt, and support machine learning workflows for asset … production environments, emphasizing performance optimization and code quality. Python expertise: Advanced proficiency in Python for data engineering, data wrangling and pipeline development. Cloud Platforms: Hands-on experience working with Azure. AWS experience is considered, however Azure exposure is essential. Data Warehousing: Proven expertise ...

Data Engineer – Modern Data & AI Platforms London (Hybrid 2 days) | Contract/Permanent | Global Consulting Environment Build the data foundations behind AI, automation, and real-world impact. We're hiring a Data Engineer to join a fast-growing digital and data … operating across energy, manufacturing, chemicals, infrastructure, automotive, and commodities. This is a hands-on engineering role where you'll design and run the data systems that power analytics, automation, and AI-driven solutions — working alongside consultants, analysts, and data scientists in a true delivery-focused environment. ...

Title: Data Architect/Data Modeler - P&C Insurance Domain Contract/Permanent – Open for Both Mode of work: Hybrid 3 days onsite/week Roles and responsibilities • Lead the design and implementation of scalable data architecture supporting analytics and digitalization agenda … cross-functional team of architects from business and technology • Develop and maintain data models (Logical and Physical) to support business needs ensuring data integrity and efficiency. • Design and govern data architecture and integration standards across Azure Data Factory and Databricks to enable ...

Factory, Databricks, and related Azure services. Build ETL/ELT processes to transform raw data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data … ADLS, Azure SQL Database, Synapse Analytics). Strong hands-on expertise in Databricks, Delta Lake, and cluster management. Proficiency in SQL and Python for pipeline development. Familiarity with Git/GitHub and CI/CD practices. Understanding of data modelling, data governance, and security principles. ...

This role is fully remote in UK, with full work authorization already in effect. No Visa sponsorship is available. Job Description In a data-driven and AI-oriented environment, you will be responsible for the design, industrialization, and optimization of inter-application data pipelines. You will … Languages: Advanced SQL and Python for data manipulation, automation, and ML integration. Data Engineering: Proven experience in ETL/ELT pipeline design. AI/ML Integration: Ability to prepare data for model training and deploy AI models into production workflows (batch or real ...

Senior Data Engineer (Databricks) Full Time/Permanent £70,000 - £80,000 + car allowance, generous bonus, private medical and other extensive benefits Hybrid - 1 day a week in the Oxfordshire head office required The Company: My client is an industry leading and award-winning financial services organisation … closely with the Head of Data, Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from a wide-ranging dataset to support executive and operational decision making that will underpin sustained ...

Role Overview We are seeking a high-performing FME Analyst to support the Local Digitisation Programme, delivering high-volume, high-accuracy spatial data automation. This role is critical to enabling scale, consistency, and quality across multiple Local Authorities, supporting both production delivery and automation uplift. The ideal candidate … Collaboration Support daily production delivery across LA waves and batches Collaborate with: o Delivery Pods o QA teams o Automation and data pipeline teams o Programme and Planning leads Provide clear documentation of: o FME logic o Data rules o Exceptions and assumptions Required Skills ...

Lead Data Engineer (SQL Python Snowflake) London/WFH to £85k Are you a skilled data technologist with strong leadership and stakeholder management skills? You could be progressing your career in a senior, hands-on Data Engineer position at a global tech company that … provide data centric software solutions to major blue-chip and government organisations to enable them to discover and analyse data and customer feedback. What's in it for you: As a Lead Data Engineer you'll earn a competitive package: Salary to £85k Bonus ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

Senior DataBricks Engineer - £70,000 - Hybrid We're looking for a hands-on Senior Databricks Engineer to lead the delivery of scalable data solutions within an Agile environment. Working closely with the Data Product Manager and Data Architect, you will shape and develop … data models, schemas, and documentation. Operate CI/CD practices in Azure DevOps and contribute to Agile sprint cycles. Troubleshoot and resolve pipeline issues promptly. Stay current with industry trends and recommend improvements. Ensure adherence to governance standards. Line-manage and mentor a small team of Data ...

Senior Data Engineer Job Title: Senior Data Engineer Salary Range: £80,000–£100,000 Location/Working model: London | Hybrid This is a critical technical position within a high-growth, forward-thinking organization that specializes in digital innovation. We require an experienced Senior Data … systems for high-volume data ingestion and processing, implementing effective monitoring, logging, and alerting mechanisms. Performance Optimization: Continuously monitor, tune, and optimize pipeline scalability and performance to meet stringent throughput and latency standards. Cross-Functional Alignment: Partner directly with technical and business teams to ensure the data ...

Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks … Data Engineer to design, develop, and manage data pipelines using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business ...

Data Engineer Salary: Up to £60,000 I am working with a leading Microsoft partner that are currently recruiting for a Data Engineer to join their growing team. This organisation is driving digital transformation for a wide range of businesses across the UK, specialising in delivering … that improve efficiency, enable self-sufficiency and accelerate growth. With a strong focus on scalable analytics and advanced business intelligence, they are modernising data platforms to deliver future-ready solutions. This is a chance to join a genuinely people-focused, high-performing consultancy where you play a trusted ...

Data Engineer Salary: Up to £60,000 I am working with a leading Microsoft partner that are currently recruiting for a Data Engineer to join their growing team. This organisation is driving digital transformation for a wide range of businesses across the UK, specialising in delivering … that improve efficiency, enable self-sufficiency and accelerate growth. With a strong focus on scalable analytics and advanced business intelligence, they are modernising data platforms to deliver future-ready solutions. This is a chance to join a genuinely people-focused, high-performing consultancy where you play a trusted ...

Senior Bioinformatics Data Engineer Are you a data engineer passionate about turning large-scale genomic data into actionable biological insight? Join a cutting-edge biotech at the forefront of functional genomics and therapeutic discovery. THE COMPANY This pioneering Oxford-based biotech is unlocking … vast, complex datasets to drive precision drug discovery. As part of a cross-disciplinary Computational team, you’ll help expand and scale the data infrastructure that powers these discoveries, working at the interface of bioinformatics, data engineering, and software development. THE ROLE As Senior Bioinformatics Data ...