1 to 25 of 27 Contract Data Ingestion Jobs in the UK

role requires strong servant-leadership, expert Agile coaching, and the ability to drive predictable delivery across distributed teams while working closely with Product Owners, Data Architects, Cloud Engineers, and CDS Platform Leads. Agile Delivery & Scrum Leadership ? Lead 1-2 CDS Agile squads through Scrum ceremonies (stand-ups, refinement, planning … track delivery metrics (burn-down, cycle time, throughput, flow efficiency) and identify improvement opportunities. ? Enable squads to break down epics/user stories for data ingestion, ETL/ELT pipelines, APIs, cloud migration, metadata/lineage, and data provisioning services. CDS Platform & Technical Coordination ? Coordinate delivery dependencies ...

Role: Data Engineer Location: Edinburgh or Luton (hybrid/onsite as required) Engagement: Contract - Inside IR35 Security Clearance: Active SC Clearance required Rate: £500 - £600 per day - inside IR35 Project Description We are seeking an experienced Data Engineer to design, build, deploy, and maintain robust data platforms … pipelines within a secure environment. You will be responsible for the end-to-end data engineering lifecycle, transforming raw data into high-quality, consumable datasets that support analytics, reporting, and advanced modelling. You will own and optimise the data operations infrastructure, ensuring performance, reliability, scalability, and security ...

Details Role/Job Title: Data Engineer Work Location: Manchester, UK Mode of Working: Hybrid Office Requirement (Hybrid): Tuesday/Wednesday/Thursday The Role Seeking a Data Engineer profile with deep technical expertise and thought leadership, provides advanced data solutions by using software to process, store … serve data to others. Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure. Utilizes a deep dive analytical skillset on a variety of internal and external data. Your Responsibilities Writes ETL (Extract/Transform/Load) processes, designs database ...

Azure Data Engineer Rate - up to £350/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based in Central … London. They are seeking an experienced Azure Data Engineer to join the project on an initial 6-month contract, with strong potential for extension. Key Responsibilities - Azure Data Engineer: Design, build and maintain scalable and secure data pipelines on the Azure platform. Develop and deploy data ...

Senior Data Engineer Rate - up to £450/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based in Central … London. They are seeking an experienced Senior Data Engineer to join the project on an initial 6-month contract, with strong potential for extension. This role is Outside IR35 and offers £450/day, requiring 2 days onsite per week in Central London. Key Responsibilities - Senior Data Engineer ...

Data Engineer Rate: Up to £325 per day (Outside IR35) Contract Length: 6 Months (with strong potential for extension) Location: Hybrid - 1 day per week onsite in Central London A leading organisation is seeking an experienced AWS Data Engineer to join their data and analytics team, contributing … design, development and optimisation of large-scale data solutions within a modern cloud environment. This contract offers the opportunity to work on high-impact projects, delivering data platforms and pipelines that drive real-time insights and strategic business decisions. Responsibilities for the AWS Data Engineer: Design, build ...

Title: AWS Support Engineer/Data Engineer Location: Ipswitch (onsite) Job Type: Permanent Job Summary: AWS Support Engineer/Data Engineer Telecom Domain (JD) Key Skills & Expertise AWS Core Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing ETL pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: Expertise in Apache Iceberg table format Schema evolution, partitioning, compaction & metadata management Query performance tuning with Athena & Redshift Spectrum Redshift Expertise ...

dynamic team within a business that values innovation, supports professional development, and offers exceptional career progression. The Role Retelligence is seeking a Senior Data Engineer to design and deliver robust, real-time data pipelines and infrastructure in a Google Cloud Platform (GCP) environment. The company is particularly interested … candidates with strong expertise in SQL. Key Responsibilities: Design, develop, and maintain scalable, data pipelines and infrastructure in a GCP environment. Integrate multiple data sources to ensure seamless real-time data flow across the organization. Build and optimize data models for querying and analytics use cases. ...

Data Engineer £650-700/day outside IR35 3-month initial contract Remote working - occasional site visits Working with a leading financial services client who are looking for a Data Engineering Consultant. Looking for someone who can act independently and deliver complex data products - work with stakeholders … understand requirements, engineer and deliver products. Data Engineering Consultant, key responsibilities: Take ownership of end-to-end of complex data products Work cross-functionally with non-technical stakeholders to understand data requirements Expert knowledge of SQL to query, analysis and model data Experience with Snowflake Using ...

looking for a highly skilled Automation Test engineer with strong expertise Identity and Access management (IAM), skilled in identity orchestration, API testing, data ingestion and transformation, and event-driven (Pub/Sub) architectures. This role focuses on testing secure, scalable identity and access workflows across Google Cloud Platform … reports and notifying team about test results to streamline the CI/CD process. Able to develop and execute test plans, test cases, test data, test scenarios, and other testing related plans and documentation based on the requirements and technical specifications Test data generation Accurately report and track ...

looking for a highly skilled Automation Test engineer with strong expertise Identity and Access management (IAM), skilled in identity orchestration, API testing, data ingestion and transformation, and event-driven (Pub/Sub) architectures. This role focuses on testing secure, scalable identity and access workflows across Google Cloud Platform … reports and notifying team about test results to streamline the CI/CD process. Able to develop and execute test plans, test cases, test data, test scenarios, and other testing related plans and documentation based on the requirements and technical specifications Test data generation Accurately report and track ...

unified customer data. As a strategic technical leader, you will work across business and IT teams to architect scalable solutions that drive service excellence, data-driven insights, and long-term platform success. The ideal candidate brings a blend of hands-on architecture experience, platform mastery, and a forward-thinking … mindset to deliver impactful Salesforce transformations. Key Responsibilities Lead the end-to-end architecture and design of Salesforce Cloud and Data Cloud implementations. Translate complex business requirements into scalable and efficient Salesforce solutions. Define architectural best practices, integration patterns, and data models for cross-cloud solutions. Collaborate with ...

based sites) Duration: 6 month initial contract Inside IR35 Role details: Our client, a prominent player in the Defence & Security sector, is looking for Data Engineers to join their team on a contract basis. Whilst the site preference is Edinburgh or Newcastle, the team can also support contractors working … will be required onsite at least 4 days per week. Candidates must hold active SC clearance. Key Responsibilities: Design, develop, deploy, and support data infrastructure, pipelines, and architecture Implement reliable, scalable, and tested solutions to automate data ingestion Develop systems to manage batch processing and real-time ...

based sites) Duration: 6 month initial contract Inside IR35 Role details: Our client, a prominent player in the Defence & Security sector, is looking for Data Engineers to join their team on a contract basis. Whilst the site preference is Edinburgh or Newcastle, the team can also support contractors working … will be required onsite at least 4 days per week. Candidates must hold active SC clearance. Key Responsibilities: Design, develop, deploy, and support data infrastructure, pipelines, and architecture Implement reliable, scalable, and tested solutions to automate data ingestion Develop systems to manage batch processing and real-time ...

based sites) Duration: 6 month initial contract Inside IR35 Role details: Our client, a prominent player in the Defence & Security sector, is looking for Data Engineers to join their team on a contract basis. Whilst the site preference is Edinburgh or Newcastle, the team can also support contractors working … will be required onsite at least 4 days per week. Candidates must hold active SC clearance. Key Responsibilities: Design, develop, deploy, and support data infrastructure, pipelines, and architecture Implement reliable, scalable, and tested solutions to automate data ingestion Develop systems to manage batch processing and real-time ...

lead the end-to-end platform design. This is a unique opportunity to shape the architecture, governance, and delivery of a brand-new Fabric data platform from the ground up. If you have delivered Microsoft Fabric solutions at an architectural level, defining Lakehouse structures, medallion models, and analytics-ready … extension Key Responsibilities/Experience Required: Designing a greenfield Microsoft Fabric platform, including Lakehouse, Bronze, Silver and Gold layers, and reporting structures Defining data ingestion and transformation architecture across multiple sources such as CRM, CMS, SaaS platforms, and GA4 Designing Fabric Data Factory pipelines and Spark notebooks ...

Azure Cloud Platform Engineer to support, focusing on delivery of a greenfield environment into an existing Azure environment to host multi-terabytes of data and the establishment of a secure, scalable cloud data platform. Key Responsibilities Engineer and execute large-scale data transfer and migration of datasets … into Azure. Design and implement Azure-based storage solutions (Blob, ADLS Gen2) appropriate for high-volume, high-throughput data. Configure and manage secure data ingestion patterns, including private networking, firewalls, and endpoint controls. Implement role-based access control (RBAC) and data access segregation aligned to governance ...

Robert Half is partnering with a leading UK public-sector advisory organisation to hire a Cloud & Data Architect for an initial 3-6 month contract. This role will drive the modernisation of their data and analytics capabilities, enabling advanced analytics, AI-powered insights, and evidence-based decision-making. … Responsibilities: Conduct a structured assessment of cloud platforms (e.g., Azure vs. GCP) and data/AI architectures. Evaluate solutions against performance, security, cost, scalability, and operational simplicity. Deliver clear recommendations, including risks, timelines, and cost models, tailored for Board-level decision-making. Design an end-to-end cloud data ...

Responsibilities (High-Level) Design, implement, and maintain scalable ML model deployment pipelines (CI/CD for ML). Build infrastructure to monitor model performance, data drift, and other key metrics in production. Develop and maintain tools for model versioning, reproducibility, and experiment tracking. The Role As an MLOps Engineer … will support these products from inception. This requires working across the full data ecosystem: developing application-specific data pipelines (features), building CICD pipelines that automate the training and deployment of machine learning models, publishing the model results for downstream consumption, and/or building out the APIs that ...

complex AI workflows. Implement and manage vector databases (e.g., FAISS, Pinecone, Weaviate, Milvus) for fast similarity search and retrieval. Develop embedding pipelines for unstructured data using models like Sentence Transformers, OpenAI, or Hugging Face. Collaborate with data scientists and software engineers to create scalable AI-powered applications. Fine … . Familiarity with LangChain for building LLM-powered applications. Ability to create chains, prompts, and agents. Desirable Skills/Knowledge/Experience Experience with data ingestion, indexing, and querying. Working with unstructured data (text, documents, images). ...

/CD process. Lead, mentor, and manage other engineers within the team Able to develop and execute test plans, test cases, test data, test scenarios, and other testing related plans and documentation based on the requirements and technical specifications Test data generation Accurately report and track testing related … testing Policy explainability validation REST API automation, API Gateway testing, Batch ETL testing Consumer-driven contract testing Idempotency testing Replay and reprocessing testing Graph data validation (Neo4j) Containerised test execution Excellent verbal and written communications skills and stakeholder engagement at all levels Experience of using a range of automation ...

Required Outside IR35: £450 - £500 SR2 are hiring for a Business Analyst who will work closely with operational teams to deliver projects that enhance data products through new features, improved processes, and strengthened compliance. The role focuses on gathering and refining requirements, designing user-facing processes, and supporting … drive process improvements and ensure solutions align with business objectives and deliver measurable value. Key Responsibilities Deliver individual workstreams to embed required changes into data products and services Define frameworks and processes to support effective data ingestion Implement changes to user support processes and operating models Skills ...

looking for a highly skilled Lead Automation Test Architect with strong expertise Identity and Access management (IAM), skilled in identity orchestration, API testing, data ingestion and transformation, and event-driven (Pub/Sub) architectures. This role focuses on testing secure, scalable identity and access workflows across Google Cloud ...

creation of high-level and low-level solution designs, ensuring alignment with enterprise architecture standards, secure by design principles, and regulatory requirements. - development of data ingestion, telemetry, and integration patterns between Darktrace, Defender, SIEM/SOAR tools, and existing security stacks. - production of architecture decision records, design patterns … Leading technical delivery workstreams, providing direction and assurance across engineering teams. - Oversee deployment and configuration of Darktrace sensors, appliances, and monitoring coverage across networks, data centres, and cloud estates. - Guide onboarding, configuration, and tuning of Microsoft Defender XDR (Endpoint, Identity, Email, Cloud Apps, Server, and Threat Intelligence modules). ...

looking for a highly skilled Automation Test engineer with strong expertise Identity and Access management (IAM), skilled in identity orchestration, API testing, data ingestion and transformation, and event-driven (Pub/Sub) architectures. Key Responsibilities Working with the Lead automation architect in the creation of an overall testing … reports and notifying team about test results to streamline the CI/CD process. Able to develop and execute test plans, test cases, test data, test scenarios, and other testing related plans and documentation based on the requirements and technical specifications Skills required: Deep IAM domain knowledge Solid experience ...