1 to 25 of 73 Permanent Data Ingestion Jobs in the Thames Valley

At Insurwave, we are looking for remarkable people who thrive on making an exceptional contribution. We now have an exciting opportunity for a Data Engineer to play a key role in our Data and AI team. If making a difference gets you out of bed in the morning … then this could be the perfect opportunity and the start of something incredible! What will you be doing? As a Data Engineer, you will directly report to a Senior Data Engineer and will work in the team responsible for designing and building large scale, real time and scalable … batch data pipelines using the latest tools and technologies. You will work alongside other teams to assist in building the data ingestion processes, data storage and expanding BI capabilities of the Platform to improve data visualisation and produce actionable insights. You will participate in all More ❯

Senior Data Engineer Bristol 6-month contract Paying up to £80p/h (Outside IR35) *** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using … the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana to enable data More ❯

Senior Data Engineer Bristol 6-month contract Paying up to £80p/h (Outside IR35) *** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using … the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana to enable data More ❯

Senior Data Engineer Bristol 6-month contract Paying up to £80p/h (Outside IR35) *** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using … the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana to enable data More ❯

Senior Data Engineer Bristol 6-month contract Paying up to £80p/h (Outside IR35) *** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using … the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana to enable data More ❯

Senior Data Engineer Bristol 6-month contract Paying up to £80p/h (Outside IR35) *** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using … the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana to enable data More ❯

Job Title: D&A Engagement Lead/Practice Sales Skills: Data & Analytics Sales, Account Mining, Solutioning, Bid Management, Client Engagement Experience: 12+ years Location: London We are seeking a dynamic and experienced leader to drive Data & Analytics (D&A) engagement and practice sales across strategic accounts in London. … The ideal candidate will have a strong background in data technologies, client relationship management, and end-to-end bid and solution ownership. This role requires a proactive, entrepreneurial mindset and the ability to collaborate across delivery, talent, and ecosystem partners to drive revenue growth and customer satisfaction. Key Responsibilities … to build Solutions (with support from various SMEs) and front-end customer interactions 8. Meet growth/revenue targets for the Account Portfolio for (Data Analytics Service Line) Assist in solution development by delivering feedback on market needs and opportunities Forge and grow deep professional connects’ with key decision More ❯

Databricks Data Engineer – Contract Day Rate: £450 - £550 P/day Location: Hybrid (Remote/2 Days a week in London) Start: Immediate Start Note: Capital Markets, or at least Banking experience is a MUST! Key expertise and experience we’re looking for: Data Engineering in Databricks – Spark … programming with Scala, Python, SQL and Ideally experience with Delta Lake or Databricks workflows, jobs, etc. Familiarity with Azure Data Lake: experience with data ingestion and ETL/ELT frameworks Data Governance experience – Metadata, Data Quality, Lineage, Data Access Models Good understanding of Data Modelling concepts, Data Products and Data Domains Unity Catalog experience is a key differentiator – if not then experience with a similar Catalog/Data Governance Management component MS Purview (Metadata and Data Quality tool) experience is a bonus – experience in similar tools is valuable (Collibra More ❯

person) Contract : 12 months + Start : ASAP Status : Inside IR35 Key Skills: Azure Event Hubs | Kafka | Databricks | Spark | ETL/ELT | CI/CD | Data Governance | Terraform | Key Responsibilities: Evaluate the Cyber Analytics Platform architecture and design the data lake structure. Identify data sources for ingestion and define a prioritized backlog of processing requirements. Design scalable data pipelines and document ingestion patterns. Provide technical leadership and mentorship to the engineering team. Implement data governance, access controls, and security models. Work with DevOps engineers to ensure CI/CD processes for data workflows. Build cloud-based solutions focusing on high-performance analytics and distributed data processing. Optimize data workflows and pipelines for large-scale data processing (terabytes/billions of events). Design cost-efficient, scalable solutions in the cloud. Ensure data quality, security, and compliance in More ❯

months Daily rate : £495 inside IR35 Location: London, hybrid working. Can be onsite one day a week Methods are seeking a SC cleared Data Engineer in London, responsible for designing, building, and maintaining scalable data pipelines and infrastructure. The ideal candidate will have expertise in Microsoft Fabric, Azure … Python, and C#. Key Responsibilities: - Design, develop, and optimize data pipelines using Microsoft Fabric and Azure services (eg, Azure Data Factory, Azure Synapse Analytics, Azure Databricks). - Build and maintain scalable, high-performance data architectures to support analytics, reporting, and machine learning workloads. - Write clean, efficient, and … maintainable code in Python and C# for data processing, transformation, and integration tasks. - Implement data ingestion, ETL/ELT processes, and data warehousing solutions. - Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions. - Ensure data quality, security, and More ❯

Our client is seeking a skilled Data Engineer to take the lead in developing and optimising their data systems. This role will focus on SQL database application development, utilising Google BigQuery as the new platform for data management, and supporting the development of data analytics and … visualisation tools such as PowerBI. The Data Engineer will be responsible for ensuring seamless data ingestion, transformation, and reporting, as well as working with key stakeholders to provide timely and actionable insights. Main Responsibilities Engineering : Developing and maintaining business-critical data ingestion, analysis, and management … systems. Utilizing API and ETL methods to integrate with internal systems. Building tools to minimize errors and improve customer experience. Automating data development and governance to improve data health. Designing procedures for system troubleshooting, capacity management, and scaling infrastructure. Analytics : Developing scripts and data outputs to automate More ❯

our Wealth Practice in the UK. In this role, you'll play a key part in designing, developing, and maintaining high-quality software and data structures to support our evolving data platforms. You'll collaborate across teams to support data migration, cleansing, enrichment, scripting, and reconciliation—ensuring … management, and software development—combined with a solid understanding of the Avaloq Enterprise-Wide Object Model—will be critical in shaping and enhancing our data capabilities. This is a fantastic opportunity to bring your passion for innovation into a fast-paced, dynamic environment where your impact will be tangible. … Mandatory Skills Description: You will have between 3-5 years experience working as an Avaloq Developer. Mapping physical data from Avaloq and other platforms to the Enterprise Data Model, ensuring adherence to reference data standards and clear conceptual definitions. Performing data quality assessments, developing strategies to More ❯

our Wealth Practice in the UK. In this role, you'll play a key part in designing, developing, and maintaining high-quality software and data structures to support our evolving data platforms. You'll collaborate across teams to support data migration, cleansing, enrichment, scripting, and reconciliation—ensuring … management, and software development—combined with a solid understanding of the Avaloq Enterprise-Wide Object Model—will be critical in shaping and enhancing our data capabilities. This is a fantastic opportunity to bring your passion for innovation into a fast-paced, dynamic environment where your impact will be tangible. … Qualifications You will have between 3-5 years experience working as an Avaloq Developer. Mapping physical data from Avaloq and other platforms to the Enterprise Data Model, ensuring adherence to reference data standards and clear conceptual definitions. Performing data quality assessments, developing strategies to enhance data More ❯

I'm working with a client who is looking for a Lead Data Engineer to take ownership of their data infrastructure as they build out a brand-new Snowflake-based platform. This is an exciting opportunity to work directly with a talented team of data professionals and … contribute to a cutting-edge project for a major magazine client. The business has secured significant investment and is preparing to launch a new data-driven platform that will transform their operations. They're now looking for someone to help shape the platform using Python, DBT, Terraform, and Snowflake … building scalable solutions that will enable their data strategy to grow. Please apply if the below sounds exciting to you-but only if you have strong experience with Snowflake, Python, DBT, and Terraform. Key Responsibilities Build and optimize scalable data pipelines on Snowflake Develop ETL processes using Python More ❯

Data Architect, £450 day rate, Outside IR35, Hybrid, COR7260 We’re seeking an experienced Data Architect for a 3-month initial contract, with strong potential to extend. This role is hybrid remote in Reading, it’s outside IR35 and offers a day rate of up to £450. Candidates … must be based in the UK and eligible to work here. As the Data Architect, you’ll take the lead in shaping scalable and secure architecture to support a range of platforms within a SaaS environment. What’s required of the Data Architect? Proven experience designing data architecture in Azure environments Strong grasp of data ingestion, modelling, and governance best practices Hands-on expertise with Python, PySpark and config-based design Familiar with building secure and compliant data platforms and delivery pipelines Confident in leading CI/CD strategies What Next? If you More ❯

Data Architect, £450 day rate, Outside IR35, Hybrid, COR7260 We’re seeking an experienced Data Architect for a 3-month initial contract, with strong potential to extend. This role is hybrid remote in Reading, it’s outside IR35 and offers a day rate of up to £450. Candidates … must be based in the UK and eligible to work here. As the Data Architect, you’ll take the lead in shaping scalable and secure architecture to support a range of platforms within a SaaS environment. What’s required of the Data Architect? Proven experience designing data architecture in Azure environments Strong grasp of data ingestion, modelling, and governance best practices Hands-on expertise with Python, PySpark and config-based design Familiar with building secure and compliant data platforms and delivery pipelines Confident in leading CI/CD strategies What Next? If you More ❯

Lead Data Engineer - London/Hybrid (3days per week onsite) - Up £120K + 10% Bonus TogetherWeTech is hiring a Lead Data Engineer for our exciting iGaming scale-up. As a Lead Data Engineer, you'll be an integral hire in the company's transition to bringing all … its tech in-house. This means, becoming their first-ever Lead Data Engineer, designing and building robust, scalable, and high-performance real-time data. Key Benefits: 10% Bonus Private Health Insurance Personal development training budget Quarterly rewards Annual trips for company conferences Key Requirements & Responsibilities: Design, develop, and optimise … real-time data pipelines and infrastructure. Build efficient data models for real-time analytics. Proven experience in managing real-time data pipelines across multiple initiatives. Expertise in distributed streaming platforms (Kafka, Spark Streaming, Flink). Experience with GCP (preferred), AWS, or Azure for real-time data More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus … on P&L reporting and operational decision-making. As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This is a business-critical role, working closely with Risk … Finance, Trading, and Business Solutions teams to build high-performance data models and pipelines that drive decision-making at scale. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven More ❯

Junior–Mid Software Engineer (Data Pipelines) 📍 Onsite – London | Full-time We’re helping one of our partner — a seriously exciting AI company started by a team of top scientists — find a Software Engineer to join their data team. They’re building powerful platforms that help organisations make smarter … decisions, and the data ingestion & pipelines team plays a huge part in that. You’d be working on real infrastructure, solving real problems, and making an actual impact from day one. What you’ll be up to: Building and optimising data pipelines (think ETL, scraping, ingestion) Keeping data accurate, clean, and flowing smoothly Collaborating with engineers, analysts, and data scientists Playing around with modern tools, cloud platforms, and a very smart team You might be a good fit if you: Have 1–3 years of experience writing software (Python, Java, Scala — whatever works More ❯

passionate about sustainability and eager to make a tangible impact, we'd love to hear from you. We spend our days dealing with energy data for some of the most interesting commercial building operators. You will be part of the team responsible for gathering, organising and communicating information about … our customer sites both internally to the software and data science teams and back to the customer. In this role, you’ll support the team extracting and managing data to help build energy management products for our customers. Your role will be a conduit between Grid Edge and … and enabling Grid Edge on those buildings. You will be responsible for all technical aspects of the onboard across your assigned projects, focusing on data egress and hardware and comms enablement of buildings where required. This is a high-paced, reactive role where you will be exposed to a More ❯

passionate about sustainability and eager to make a tangible impact, we'd love to hear from you. We spend our days dealing with energy data for some of the most interesting commercial building operators. You will be part of the team responsible for gathering, organising and communicating information about … our customer sites both internally to the software and data science teams and back to the customer. In this role, you’ll support the team extracting and managing data to help build energy management products for our customers. Your role will be a conduit between Grid Edge and … and enabling Grid Edge on those buildings. You will be responsible for all technical aspects of the onboard across your assigned projects, focusing on data egress and hardware and comms enablement of buildings where required. This is a high-paced, reactive role where you will be exposed to a More ❯

passionate about sustainability and eager to make a tangible impact, we'd love to hear from you. We spend our days dealing with energy data for some of the most interesting commercial building operators. You will be part of the team responsible for gathering, organising and communicating information about … our customer sites both internally to the software and data science teams and back to the customer. In this role, you’ll support the team extracting and managing data to help build energy management products for our customers. Your role will be a conduit between Grid Edge and … and enabling Grid Edge on those buildings. You will be responsible for all technical aspects of the onboard across your assigned projects, focusing on data egress and hardware and comms enablement of buildings where required. This is a high-paced, reactive role where you will be exposed to a More ❯

passionate about sustainability and eager to make a tangible impact, we'd love to hear from you. We spend our days dealing with energy data for some of the most interesting commercial building operators. You will be part of the team responsible for gathering, organising and communicating information about … our customer sites both internally to the software and data science teams and back to the customer. In this role, you’ll support the team extracting and managing data to help build energy management products for our customers. Your role will be a conduit between Grid Edge and … and enabling Grid Edge on those buildings. You will be responsible for all technical aspects of the onboard across your assigned projects, focusing on data egress and hardware and comms enablement of buildings where required. This is a high-paced, reactive role where you will be exposed to a More ❯

passionate about sustainability and eager to make a tangible impact, we'd love to hear from you. We spend our days dealing with energy data for some of the most interesting commercial building operators. You will be part of the team responsible for gathering, organising and communicating information about … our customer sites both internally to the software and data science teams and back to the customer. In this role, you’ll support the team extracting and managing data to help build energy management products for our customers. Your role will be a conduit between Grid Edge and … and enabling Grid Edge on those buildings. You will be responsible for all technical aspects of the onboard across your assigned projects, focusing on data egress and hardware and comms enablement of buildings where required. This is a high-paced, reactive role where you will be exposed to a More ❯

Data Engineer - £75,000 per annum - Azure - Snowflake - Finance My client are seeking a Data Engineer to join their tech function, this role will report to the Lead Data Engineer, and has a focus on building and maintaining a robust data infrastructure to support the business … s strategic goals. This role involves developing and managing data ingestion and transformation pipelines using modern tools such as Fivetran, DBT, and GitLab, while collaborating with business analysts and end-users to ensure systems are continuously enhanced to meet evolving needs. In this role you’ll play a … crucial part in the migration of legacy systems to modern data platforms, supporting the creation of insightful management information dashboards and scalable data solutions. The role requires hands-on experience in developing and maintaining high-quality code aligned with industry standards and internal practices. Key Skills: Proven experience More ❯