1 to 25 of 39 Data Ingestion Jobs in Slough

At Insurwave, we are looking for remarkable people who thrive on making an exceptional contribution. We now have an exciting opportunity for a Data Engineer to play a key role in our Data and AI team. If making a difference gets you out of bed in the morning … then this could be the perfect opportunity and the start of something incredible! What will you be doing? As a Data Engineer, you will directly report to a Senior Data Engineer and will work in the team responsible for designing and building large scale, real time and scalable … batch data pipelines using the latest tools and technologies. You will work alongside other teams to assist in building the data ingestion processes, data storage and expanding BI capabilities of the Platform to improve data visualisation and produce actionable insights. You will participate in all More ❯

responsible for developing and delivering all technology solutions for the firm’s internal use. We are taking a cloud-first approach to transform our data platforms and analytical applications across the firm. We are seeking an experienced data engineer to shape and accelerate the delivery of target state … data platform enabling GenAI use-cases. We want a passionate specialist who loves to build data solutions as part of multi-disciplinary team, working closely with digital product professionals, data scientists, cloud engineers and others. Your impact within our firm We are looking for a Data Engineer with expertise in Python development, who is passionate about cloud-based data engineering using AWS services and loves to build data solutions as part of a multi-disciplinary team. You would be working closely with digital product professionals, data scientists, cloud engineers and others. You More ❯

Senior Data Engineer Bristol 6-month contract Paying up to £80p/h (Outside IR35) *** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using … the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana to enable data More ❯

About Quantum: Quantum is building next-generation AI and trading technologies that harness cutting-edge research and data science. As part of our rapid growth, we are seeking a highly skilled Senior Data Engineer to support our Data & AI team by designing and maintaining robust, scalable, and … production-grade data systems. This is greenfield project, allowing for full product ownership and key decision making. Role Overview: As a Senior Data Engineer at Quantum, you will be instrumental in building the infrastructure that powers our Data Science, AI and Trading tools. You will work closely … with the Data and Technology teams to ensure data accessibility, quality, and scalability - particularly focusing on trading (time-series databases), analytical, and AI pipelines. This is a highly collaborative role, ideal for someone who thrives on taking full ownership from systems design to implementation in a fast-paced More ❯

Databricks Data Engineer – Contract Day Rate: £450 - £550 P/day Location: Hybrid (Remote/2 Days a week in London) Start: Immediate Start Note: Capital Markets, or at least Banking experience is a MUST! Key expertise and experience we’re looking for: Data Engineering in Databricks – Spark … programming with Scala, Python, SQL and Ideally experience with Delta Lake or Databricks workflows, jobs, etc. Familiarity with Azure Data Lake: experience with data ingestion and ETL/ELT frameworks Data Governance experience – Metadata, Data Quality, Lineage, Data Access Models Good understanding of Data Modelling concepts, Data Products and Data Domains Unity Catalog experience is a key differentiator – if not then experience with a similar Catalog/Data Governance Management component MS Purview (Metadata and Data Quality tool) experience is a bonus – experience in similar tools is valuable (Collibra More ❯

Director of Data Engineering Location: Hybrid – London, Blackfriars Join us at Merlin Entertainments as we transform the future of digital guest experiences across our iconic global attractions. We're seeking an experienced Director of Data Engineering to lead the design, development, and implementation of Merlin's enterprise data architecture and engineering strategy. You'll oversee the data engineering and platform function, with a key focus on building a high-performing team and driving excellence across Databricks-based data platforms. About the Role A key focus will be managing the development and operational management of the … data platform using Databricks. The successful candidate will also lead a high-performing team of data engineers and platform specialists, fostering collaboration across technical and business teams to deliver innovative solutions that drive value and support data-driven decision-making. Key Responsibilities as Director of Data More ❯

months Daily rate : £495 inside IR35 Location: London, hybrid working. Can be onsite one day a week Methods are seeking a SC cleared Data Engineer in London, responsible for designing, building, and maintaining scalable data pipelines and infrastructure. The ideal candidate will have expertise in Microsoft Fabric, Azure … Python, and C#. Key Responsibilities: - Design, develop, and optimize data pipelines using Microsoft Fabric and Azure services (eg, Azure Data Factory, Azure Synapse Analytics, Azure Databricks). - Build and maintain scalable, high-performance data architectures to support analytics, reporting, and machine learning workloads. - Write clean, efficient, and … maintainable code in Python and C# for data processing, transformation, and integration tasks. - Implement data ingestion, ETL/ELT processes, and data warehousing solutions. - Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions. - Ensure data quality, security, and More ❯

Data Engineer – Data Warehouse £55,000 + Annual Bonus Are you looking to join an expanding Data function within a Global Team? There has been significant investment into growing the Data Teams and this is a really good opportunity to be a part of something special … The Data Engineer will be working on a centralised enterprise Data Warehouse and will be working on deploying architectures to drive greater analytical and business value from various data sources. What will you be doing? Working with various teams from delivery, product, architecture to develop data driven solutions Developing and supporting a comprehensive data warehouse. Leverage your data modelling skills – designing and developing a dimensional model. Identify & deploy appropriate file formats for data ingestion Tech Stack SQL Python Web APIs – SOAP, REST DBT Have worked on denormalised data Has worked More ❯

our Wealth Practice in the UK. In this role, you'll play a key part in designing, developing, and maintaining high-quality software and data structures to support our evolving data platforms. You'll collaborate across teams to support data migration, cleansing, enrichment, scripting, and reconciliation—ensuring … management, and software development—combined with a solid understanding of the Avaloq Enterprise-Wide Object Model—will be critical in shaping and enhancing our data capabilities. This is a fantastic opportunity to bring your passion for innovation into a fast-paced, dynamic environment where your impact will be tangible. … Qualifications You will have between 3-5 years experience working as an Avaloq Developer. Mapping physical data from Avaloq and other platforms to the Enterprise Data Model, ensuring adherence to reference data standards and clear conceptual definitions. Performing data quality assessments, developing strategies to enhance data More ❯

I'm working with a client who is looking for a Lead Data Engineer to take ownership of their data infrastructure as they build out a brand-new Snowflake-based platform. This is an exciting opportunity to work directly with a talented team of data professionals and … contribute to a cutting-edge project for a major magazine client. The business has secured significant investment and is preparing to launch a new data-driven platform that will transform their operations. They're now looking for someone to help shape the platform using Python, DBT, Terraform, and Snowflake … building scalable solutions that will enable their data strategy to grow. Please apply if the below sounds exciting to you-but only if you have strong experience with Snowflake, Python, DBT, and Terraform. Key Responsibilities Build and optimize scalable data pipelines on Snowflake Develop ETL processes using Python More ❯

Data Architect – Azure Hybrid (Manchester or London) Up to £100,000 base About the Role Our client, a trusted Microsoft Partner, is looking for a skilled Data Architect to lead the design and delivery of modern data platforms using the Microsoft technology stack. This role is pivotal … in shaping enterprise-grade solutions that support advanced analytics, reporting, and data governance across a wide range of sectors. Experience with Microsoft Fabric is highly desirable as clients move towards next-generation data strategies. Key Responsibilities Design and architect robust, scalable data solutions using Microsoft Azure services … and tools. Lead discovery sessions and translate business requirements into high-level and detailed solution designs. Deliver enterprise data platform architectures, including data warehousing, lakehouse, and real-time data ingestion. Guide and mentor data engineering teams throughout delivery lifecycles. Define data governance, security, and integration More ❯

Kingdom (Hybrid) Day Rate: 600 p/d (Outside IR35) About the company: I'm working with a digital consultancy at the forefront of data-driven transformation within the sports industry. They partner with some of the world's most recognised football organisations to deliver strategic, technology-enabled solutions … My client is seeking an experienced and dynamic Analytics Consultant to join a growing team. In this high-impact role, you will lead complex data science initiatives and guide strategic decision-making across a portfolio of client projects. You will play a key part in developing advanced recommendation systems … improving CRM workflows, and enabling actionable insights through data visualisation and analytics. You will work closely with cross-functional teams and clients, manage a small team of analysts and data scientists, and oversee the delivery of analytics projects from inception through to execution. This is a hands-on More ❯

Lead Data Engineer - London/Hybrid (3days per week onsite) - Up £120K + 10% Bonus TogetherWeTech is hiring a Lead Data Engineer for our exciting iGaming scale-up. As a Lead Data Engineer, you'll be an integral hire in the company's transition to bringing all … its tech in-house. This means, becoming their first-ever Lead Data Engineer, designing and building robust, scalable, and high-performance real-time data. Key Benefits: 10% Bonus Private Health Insurance Personal development training budget Quarterly rewards Annual trips for company conferences Key Requirements & Responsibilities: Design, develop, and optimise … real-time data pipelines and infrastructure. Build efficient data models for real-time analytics. Proven experience in managing real-time data pipelines across multiple initiatives. Expertise in distributed streaming platforms (Kafka, Spark Streaming, Flink). Experience with GCP (preferred), AWS, or Azure for real-time data More ❯

My client, a prestigious multi-strat hedge fund, is seeking an exceptional Data Developer to join their Reporting & Analytics team within their London office. In this role, you will play a key role in designing and developing next-generation reporting and data analytics solutions, with a strong focus … on P&L reporting and operational decision-making. As part of a rapidly growing firm, you will work on revamping existing implementations, optimising data pipelines, and implementing rigorous data standards to support key business functions across the firm. This is a business-critical role, working closely with Risk … Finance, Trading, and Business Solutions teams to build high-performance data models and pipelines that drive decision-making at scale. This role will offer continuous exposure to Portfolio Managers, Risk & Portfolio Research teams, Product Control, and Compliance, providing an opportunity to influence critical workflows and enhance data-driven More ❯

Junior–Mid Software Engineer (Data Pipelines) 📍 Onsite – London | Full-time We’re helping one of our partner — a seriously exciting AI company started by a team of top scientists — find a Software Engineer to join their data team. They’re building powerful platforms that help organisations make smarter … decisions, and the data ingestion & pipelines team plays a huge part in that. You’d be working on real infrastructure, solving real problems, and making an actual impact from day one. What you’ll be up to: Building and optimising data pipelines (think ETL, scraping, ingestion) Keeping data accurate, clean, and flowing smoothly Collaborating with engineers, analysts, and data scientists Playing around with modern tools, cloud platforms, and a very smart team You might be a good fit if you: Have 1–3 years of experience writing software (Python, Java, Scala — whatever works More ❯

passionate about sustainability and eager to make a tangible impact, we'd love to hear from you. We spend our days dealing with energy data for some of the most interesting commercial building operators. You will be part of the team responsible for gathering, organising and communicating information about … our customer sites both internally to the software and data science teams and back to the customer. In this role, you’ll support the team extracting and managing data to help build energy management products for our customers. Your role will be a conduit between Grid Edge and … and enabling Grid Edge on those buildings. You will be responsible for all technical aspects of the onboard across your assigned projects, focusing on data egress and hardware and comms enablement of buildings where required. This is a high-paced, reactive role where you will be exposed to a More ❯

We are currently working with a leading, private equity-backed music rights investor that is seeking a Data Engineer to join their growing team. The data team builds, owns, and maintains proprietary data assets that support the full data lifecycle — from raw data ingestion … pipelines. The team plays a critical role across the business. Responsibilities: Develop, maintain, and optimise robust ETL/ELT pipelines in Python Collaborate with data teams to translate business requirements into scalable data solutions Work cross-functionally to support analytics, reporting, and product development Write clean, maintainable, and … testable code with a strong emphasis on clarity and structure Contribute ideas and insights to help evolve the client’s data platform for scale and efficiency To be successful in this role, you will have: A minimum of 2 years' of relevant experience Proficiency in Python Experience building ETL More ❯

Python, and any of Perl, C, C++, Java, JavaScript or Scala for programming. Work with cloud platforms (predominantly GCP and AWS) Implement and manage data ingestion modules to download and manage publicly available genomic and molecular data sources. Ensure robust data processing pipelines and workflows for … and manage databases and/or warehouses used for access to and storage of biological data. Providing efficient I/O capabilities to connect data and use efficiently in data science workflows and products. Utilise orchestration (e.g. Nextflow, Snakemake) and high-performance computing (e.g., SLURM, AWS Batch) frameworks. … Write efficient and optimised SQL queries for data manipulation and analysis Build and maintain GUI, dashboards and website front-ends to enable user-friendly exploration of data or execution of data science workflows. Build Microservices and APIs. Oversee the existing pipelines and lead/support the design More ❯

will have a deep experience and understanding of test automation frameworks, and an understanding of COTS (Commercial Off-The-Shelf) products and experience in Data Modernization/Transformation programmes. As an Automation Test Lead, you will be responsible for designing and executing test plans, coordinating with cross-functional teams … teams, including developers, business analysts, and project managers, to understand project requirements and develop test strategies Potentially also support, advise, assist to prepare test data, migrations testing CI/CD, NFT and UAT Potentially create automated solutions around data inputs, outputs and data source-target comparisons Qualifications … Lead, with at least 5 years of experience and automation testing in the banking and financial sector Experience with cloud technologies, such as Azure Data Factory In depth experience, knowledge and understanding of test automation frameworks with Karate, JSON, NUnit, Pytest, Eggplant; along with Github Actions pipeline and IntelliJ More ❯

Product Manager you will be the owner of multiple software development initiatives. Working closely with the customer and the technology, business, relationship management, operations, data science and governance teams you will; discover the underlying unmet needs from the customers; define and agree the outcomes and acceptance criteria; orchestrate the … design of the prototype; help architect a software platform providing data ingestion, processing and analytics delivery; manage its development through the software development lifecycle, and; build measurement and product improvements processes. As a Senior Product Manager - you will focus on the internal and external facing products and components … that most require a deep data architecture understanding. You will be part of a small team of technically-minded product managers who are in the process of transforming the organisation and its products into an end-to-end digital experience through the development of a componentised software stack. What More ❯

of RMN platforms, covering sponsored ads, programmatic DSP, self-service portals, and dynamic ad placements. • Design scalable and modular RMN solutions, integrating Ad-Serving, Data Management Platforms (DMP), Customer Data Platforms (CDP), and Demand-Side Platforms (DSP). • Ensure real-time bidding (RTB) and programmatic advertising capabilities within … Implement Generative AI for automated ad creation, content personalization, and A/B testing. • Enhance Dynamic Creative Optimization (DCO) capabilities for personalized ad experiences. Data & Integration Framework • Define data ingestion, processing, and activation strategies across first-party, second-party, and third-party data sources. • Ensure seamless … performance effectively. Ad-Tech Stack & Cloud Architecture • Design RMN solutions leveraging Google Cloud, AWS, or Azure, ensuring high availability and low-latency performance. • Optimize data pipelines, real-time analytics, and identity resolution mechanisms. • Oversee privacy-compliant data handling (GDPR, CCPA) and secure identity frameworks. Stakeholder Collaboration & Roadmap Execution More ❯

role will report into Operations Lead UK and Europe. You will work alongside the Sales & Distribution, Technology, Finance and Outsourced Operations teams to manage data onboarding, premium and cash management of speciality underwriters within Europe and UK, at Accelerant we call them members. In this role you will build … relationships and intimate knowledge of our Members data, technology and processes and will be the point contact on all data queries, problems and solutions. You will work alongside our members to assist them in the analysis and resolution of data quality issues that impact data ingestion, regulatory compliance, and reporting, utilising your knowledge and experience of the applicable data standards. Your role will contribute to the overall success of the Operations function who are charged with transforming our data processes to deliver governed, timely and high-fidelity data sources. Key Responsibilities Member More ❯

Senior Data Engineer – OUTSIDE IR35 Start date: ASAP Duration: 6 months Location: 1 day every month in the London office Rate: £600 - £700 per day Outside IR35 Responsibilities Collaborate with our clients to design and build modern data platforms using a variety of technologies Help lead the design … and implementation of complex, cloud-based data ingestion and transformation pipelines Implement scalable and secure Data Lakes/Warehouses Help drive effective development patterns and delivery practices Continually improve with our internal development program, including mentoring and paid training/certifications Skills Data Modelling - SQLDBM Snowflake More ❯

Senior Data Platform Engineer – £80k–£110k + bonus London (Hybrid – 3 days onsite) We’re working with a forward-thinking tech consultancy delivering modern data platforms for leading organisations across the UK. As they scale their Platform Engineering capability, they’re hiring a Senior Data Platform Engineer … to design, deploy and scale cloud-native data solutions using best-in-class tooling. 🔧 The Role You’ll join a high-impact delivery team responsible for building robust, secure, and scalable data platforms for enterprise clients. Expect hands-on technical work and leadership responsibility across infrastructure design, deployment … and optimisation. 💡 Key Tech Environment Cloud: AWS/Azure/GCP (2+ preferred) Data Platforms: Databricks, Snowflake IaC: Terraform, Pulumi, CI/CD pipelines Orchestration: Airflow, dbt, data ingestion frameworks DevOps: GitHub Actions, Jenkins, Docker, Kubernetes 📌 What We're Looking For Strong platform/infrastructure engineering experience More ❯

Future Talent Pool - GCP Data Engineer, London, hybrid role - digital Google Cloud transformation programme Proficiency in programming languages such as Python, PySpark and Java develop ETL processes for Data ingestion & preparation SparkSQL CloudRun, DataFlow, CloudStorage GCP BigQuery Google Cloud Platform Data Studio Unix/Linux Platform … control tools (Git, GitHub), automated deployment tools Google Cloud Platform services, Pub/Sub, BigQuery Streaming and related technologies. Deep understanding of real-time data processing and event-driven architectures. Familiarity with data orchestration tools Google Cloud Platform cloud composer. Google Cloud Platform certification(s) is a strong … advantage. Develop, implement, and optimize real-time data processing workflows using Google Cloud Platform services such as Dataflow, Pub/Sub, and BigQuery Streaming. 6 months initial, likely long term extensions This advert was posted by Staffworx Limited - a UK based recruitment consultancy supporting the global E-commerce, software More ❯