51 to 75 of 108 Data Ingestion Jobs in England

Lead Data Engineer - Gambling Sector (No Sponsorship) Salary: £125,000 Location: Remote (London Office) This is an opportunity to step into a hands-on leadership role where you will shape a modern data function, influence technical direction, and build high-impact data infrastructure from the ground up. … base across the UK. With strong growth, a clear product vision, and a collaborative engineering culture, they offer the chance to directly influence how data powers the next phase of their evolution. The business values responsible innovation, high technical standards, and a genuine passion for building great digital products. ...

integrated platform-based technologies and offerings from CJ, Epsilon and Influential. A key business solution of Publicis Groupe , Publicis Media’s digital-first, data-driven global solutions deliver client value and drive growth in a platform-powered world. It is present in over 100 countries with over … employees worldwide. THE TEAM Data Solutions is a Groupe wide practice for the delivery of end-to-end Data and Reporting Solutions for our key Global Network Clients. Data Solutions works with key external and internal stakeholders to understand and analyse technical reporting requirements, define business rules ...

life cycle. Should have managed Risks/Issues, should have managed Agile project. Must have used agile management tool. Needs to have knowledge around Data specific project executions like - Data Warehousing, Data Migrations, Business Intelligence, Analytics, Big Data, Cloud (AWS/Azure) transformations. Key Responsibilities … technical delivery roadmap across data ingestion, ETL/ELT pipelines, data lake/warehouse models, streaming workloads, and analytics products. Own and Supervise Quality, Testing & Release Governance Required Expertise:- Overall experience: 12 to 14 years, 6+ years relevant project management experience with focus on delivering cross-functional ...

Machine Learning Engineer London – (3 days a week in office) Up to £90,000 About the Role Our client is a data-driven organisation focused on delivering measurable operational and financial improvements across a range of industries. They combine deep technical expertise with real-world delivery to design, build … deploy machine learning solutions that create tangible business impact. As a Machine Learning Engineer, you’ll work closely with Data Scientists, Data Engineers and delivery teams to productionise models and build robust, scalable ML systems within client environments. This role is highly hands-on, with a strong focus ...

Client Gamma RRF ID 2026-18851 £400 per day Outside IR35 Duration 3 months initial Start ASAP Overview We are looking for an experienced Data Engineer to design and deliver scalable, secure, and high performance data solutions. The role focuses heavily on Snowflake architecture, cloud data platforms … modern data pipeline development. Key Responsibilities Design and architect data solutions using Snowflake Optimise workflows and integrations using Openflow Develop and maintain ETL and ELT pipelines from Salesforce, relational databases, files, and NoSQL sources Implement dimensional modelling to support data warehousing and BI reporting Build and optimise ...

Data Engineer £60 0-700/day outside IR35 3-month initial contract Remote working - occasional site visits Working with a leading financial services client who are looking for a Data Engineering Consultant. Looking for someone who can act independently and deliver complex data products - work with … stakeholders to understand requirements, engineer and deliver products. Data Engineering Consultant, key responsibilities: Take ownership of end-to-end of complex data products Work cross-functionally with non-technical stakeholders to understand data requirements Expert knowledge of SQL to query, analysis and model data Experience with ...

Data Platform Engineer – Warton – SC Cleared – 12 Month Contract About Your Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on premises platforms. You will play … role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will design, implement, and maintain data flows using NiFi, ensuring accurate, efficient ...

DATA ENGINEER 6-MONTH CONTRACT £500-£550 PER DAY OUTSIDE IR35 FULLY REMOTE This role offers a great opportunity for an AWS Data Engineer to join a fast-paced media company working on a cutting-edge data ingestion and transformation project. You'll take ownership … pipeline development, integrating real-time data streams and third-party APIs into a modern analytics stack. The environment promotes autonomy, modern tooling, and close collaboration across technical and business teams. THE COMPANY This is a leading media organisation leveraging data to drive audience insights, engagement strategies, and targeted ...

Data Engineer Hybrid: Birmingham Salary: £45000 to £50000. This is an exciting opportunity to step into a hands on Data Engineer role within an analytics team that is growing in both scope and influence. You will play a key part in stabilising and evolving a broad data … healthcare space with a strong reputation for product quality, research, and customer care. The organisation is scaling quickly, expanding internationally, and investing in data as a core enabler for decision making. The culture is collaborative and people focused, with a close knit feel, modern office space, and regular exposure ...

ready to play a key role in a modern data transformation? We are seeking a BI Solutions Analyst to join our Data Centre of Excellence. In this role, you will help us transition from legacy systems to a cutting-edge Microsoft Fabric platform, ensuring our reporting assets … measures. Semantic Model Support: Maintain enterprise-level semantic models (including Sales and Finance models) and develop efficient DAX measures aligned with governance standards. Data Triage & Operational Support: Monitor data ingestion pipelines across Bronze, Silver, and Gold layers. You'll diagnose load failures and inconsistencies within our metadata ...

Summary We require an Azure Databricks Architect to provide architectural leadership and assurance for the design, implementation, and ongoing evolution of an Azure-based data and analytics platform within a public sector environment. The role will focus on platform architecture, data patterns, governance, and non-functional requirements, working … secure, scalable, and compliant with organisational and government standards. Key Responsibilities Define and maintain the end-to-end architecture for Azure Databricks-based data platforms. Design Lakehouse architectures using Azure Databricks, Azure Data Lake Storage (ADLS Gen2), and associated Azure services. Produce and maintain High-Level Designs (HLDs ...

Data Engineer | Outside IR35 | £450 - £500 | 6 months | Hybrid London We’re supporting a company who are looking for a Data Engineer to build and enhance the data processing capabilities within their Databricks environment. You’ll be responsible for developing the code that drives their data … Python, Spark, and Databricks Workflows to deliver new platform functionality and ensure efficient execution. Key Responsibilities Develop reliable Python and PySpark code to support data ingestion, transformation, and end‐to‐end processing. Deliver new technical features and components aligned to approved solution designs and business requirements. Enhance, extend ...

Data Engineer | Outside IR35 | £450 - £500 | 6 months | Hybrid London We’re supporting a company who are looking for a Data Engineer to build and enhance the data processing capabilities within their Databricks environment. You’ll be responsible for developing the code that drives their data … Python, Spark, and Databricks Workflows to deliver new platform functionality and ensure efficient execution. Key Responsibilities Develop reliable Python and PySpark code to support data ingestion, transformation, and end-to-end processing. Deliver new technical features and components aligned to approved solution designs and business requirements. Enhance, extend ...

work closely with technical and delivery teams to realise measurable business value from CDP investments. The ideal candidate brings deep CDM/MA/data layer domain expertise , a strong understanding of the wider martech and data ecosystem , as well as the business impact of solutions … Business Architecture & Discovery Engage with senior stakeholders to understand business goals, customer strategies, and transformation priorities Lead CDP-focused discovery , defining customer use cases, data requirements, and activation opportunities Translate business needs into clear architectural requirements , flagging gaps, risks, or constraints early CDP, Data & Martech Architecture Design ...

leading global commodities trading firm is seeking a Senior .NET Developer to join its high-performing Data Platform team. This role sits within a business-critical engineering function responsible for building and maintaining high-throughput, low-latency data systems that underpin trading, analytics, and operational decision-making across … firm. This is not a typical backend development role. While predominantly software engineering focused, it carries elements of data engineering — building streaming pipelines, designing high-performance components, and handling significant data volumes across distributed systems. You’ll join a collaborative Scrum-based team with a strong engineering culture ...

Clearly is a fleet management intelligence platform on a mission to bring clarity to one of the most data-rich yet analytically underserved industries in the world. Fleet operators today are drowning in fragmented data, with little ability to turn that data into actionable insight. Clearly solves … ground up. About the role As a Senior Software Engineer at Clearly, you will own and shape the full technical stack - from the data pipelines that ingest telematics streams at scale, through the processing and analytics layers that power our intelligence platform, to the APIs and interfaces that ...

Architect with deep hands-on experience in AI/ML and Generative AI to design and govern end‐to‐end solutions across application, data, and infrastructure layers. The Architect will own reference architectures , lead solution shaping , and ensure responsible AI practices across discovery, build, and run—covering LLM/… agentic AI , LLMOps/MLOps , and cloud-native delivery. Key Responsibilities: Architecture & Design Define and evolve reference architectures for AI-powered solutions spanning data ingestion → model orchestration → inference services → application integrations ; ensure scalability, security, and observability. Select and integrate LLMs (Azure OpenAI, Google, AWS) and design RAG pipelines ...

experienced Back-End Developer with strong expertise in Go (Golang) to build scalable, high-performance backend systems. You will design APIs, manage real-time data pipelines, and support analytics-driven applications deployed on AWS cloud infrastructure. This role is ideal for someone passionate about data-driven systems, cloud … Responsibilities Backend Development Develop and maintain scalable backend services using Go (Golang). Design and implement RESTful APIs and GraphQL endpoints. Build APIs for data ingestion and service-to-service communication. Write clean, maintainable, and efficient production-level code. Implement authentication and security best practices (OAuth, JWT, encryption ...

Platform About Us We build decision-making infrastructure for complex, real-world systems. Our platform combines edge-deployed sensors and intelligence with centralised algorithms, data pipelines, and graph-based analytics. We work primarily in global logistics, where we ingest data from sensors, emails, spreadsheets, and external databases … devices and agents. The system includes edge devices with onboard sensors and compute, a central cloud-based analytics layer, and a graph-based data store and algorithmic engine that supports both machine learning and rules-based logic. Job Description We are hiring a Senior QA Engineer to own quality ...

Practice. This is an opportunity to work end-to-end on high-impact analytics solutions that directly support established organisations in making better, faster, data-driven decisions. The Role: As an Analytics Engineer, you'll play a key role in transforming high-quality data into trusted, scalable insight … semantic models Develop high-quality Power BI reports, including advanced DAX Apply best practices across modelling, performance optimisation, and governance Collaborate closely with Data Engineering teams using Microsoft Fabric Provide responsive support for analytics products used across the organisation Requirements: Hands-on experience with Power BI (data ingestion ...

quality, correctness, and long term system design genuinely matter. Responsibilities Design and build backend systems that power a complex, evolving platform using Python Own data models, schemas and database design with a strong focus on correctness and scale Build ingestion pipelines and integrations with production customer systems Develop … skills and experience designing schemas Experience building complex backend systems that evolve over time Comfort working in ambiguous, early stage product environments Experience with data ingestion pipelines or internal tooling for AI or data teams The engineering team is currently small and senior, with a strong academic ...

based financial services firm operating within the hedge fund and asset management space is seeking an Applied AI/Automation Engineer to join its Data Science function. This role will focus on designing and building an intelligent reporting and automation platform to support fund operations and administration teams. … deliver measurable efficiency gains and scalable automation solutions. The overall objective is to modernise reporting production and reconciliation processes through the application of modern data engineering practices, AI-enabled automation, and agent-based workflows. This is a hands-on engineering role focused on building reliable, production-grade systems within ...

design approach. Responsibilities System Architecture Design : Architect and implement a scalable, cloud-native software platform capable of handling the complexities of large-scale engineering data, AI-driven simulations, and seamless user interactions. Prioritise maintainability, testability, and extensibility in design choices. Data Pipeline Engineering : Design and build robust, high … throughput data pipelines to manage large volumes of engineering data. Ensure efficient data ingestion, transformation, storage, and retrieval from both internal simulations and external partner tools. Cloud-Based Scalability, Reliability, and Security : Leverage cloud technologies (AWS) to achieve system scalability, ensuring high availability, fault tolerance, and data ...

subject matter experts to identify automation opportunities and define technical and functional requirements. Coding and Programming: Develop automation scripts and build pipelines for data ingestion, preprocessing and feature engineering using languages such as Python, Java or R. Testing and Maintenance: Conduct thorough testing, resolve issues, monitor accuracy … system performance, and implement updates or improvements as needed. Collaboration: Partner with cross-functional teams including data scientists, engineers, software developers and IT operations to ensure seamless integration of AI/automation solutions. Documentation and Reporting: Produce and maintain clear technical documentation and prepare performance reports, insights and recommendations ...

security matter as much as feature velocity. Working embedded with AI, Backend, Frontend, and DevOps, you'll shape how they validate agent behaviours, data pipelines, and end-to-end operational workflows - from research prototypes through to production deployments. Quality is built in from day one, not inspected … safety-conscious, and security-first delivery expectations. Act as the primary quality authority across projects, advising engineering and productleadership on risk and readiness. AI & Data-Focused Testing Design approaches for testing multi-agent workflows, including orchestration logic, memory/state handling, and tool integrations. Define validation strategies ...