1 to 25 of 33 Data Ingestion Jobs in the South East

Azure Data Engineer VIQU has partnered with a leading Telecommunications organisation seeking an experienced Azure Data Engineer to design, develop, and manage scalable data solutions on the Microsoft Azure platform. You’ll play a key role in architecting and implementing robust data integration solutions, as well … building ETL pipelines to support data ingestion, transformation, and loading. The Role:As an Azure data engineer, you’ll collaborate with cross-functional teams in an agile environment — contributing to sprint planning, daily stand-ups, and other agile ceremonies. Strong communication skills are essential ...

Adword Job Title: Data Architect (Insurance Domain) Location: London UK Hybrid role Responsibilities: Experience Level 15 years with at least 5 years in Azure ecosystem Role: We are seeking a seasoned Data Architect to lead the design and implementation of scalable data solutions for a strategic insurance … project The ideal candidate will have deep expertise in Azure cloud services Azure Data Factory and Databricks with a strong understanding of data modeling data integration and analytics in the insurance domain Key Responsibilities Architect and design end to end data solutions on Azure for insurance ...

Data Engineer (Inside IR35) £425 Per day SC Cleared London o support the formation of a new Data Team, there is a critical need to establish robust, scalable, and secure data infrastructure. Currently, data is dispersed across multiple systems with inconsistent formats and limited automation. … Data Engineer will play a key role in designing and implementing the pipelines, architecture, and tooling required to enable reliable data ingestion, transformation, and delivery. Key Responsibilities Design, build, and maintain scalable data pipelines to ingest, transform, and store data from multiple sources. Develop ...

become a rounded professional. Role During this 2 year apprenticeship, you will be part of a cross-disciplinary team, working closely with other data analysts, product managers, data scientists, data engineers, software engineers, data managers and business partners. You will be part of a team … responsibilities include: Bridging between business and digital organizations Providing actionable, data-driven business and product insights by combining deep statistical skills, data manipulation capabilities and business acumen Maintaining, defining metrics and building dashboards Autonomously executing data analysis, applying existing data & analytics strategies relevant to immediate scope ...

from across bp. Role and responsibilities During this 2 year apprenticeship, you will be part of a cross-disciplinary team, working closely with other data analysts, product managers, data scientists, data engineers, software engineers, data managers and business partners. You will be part of a team … whos responsibilities include: Bridging between business and digital organizations Providing actionable, data-driven business and product insights by combining deep statistical skills, data manipulation capabilities and business acumen Maintaining, defining metrics and building dashboards Autonomously executing data analysis, applying existing data & analytics strategies relevant to immediate ...

Data Engineer Remote (Occasional Travel to Birmingham) Up to £75,000 + Benefits (12 Months FTC) Are you a hands-on Data Engineer who enjoys building, maintaining, and optimising modern data systems? We're working with a well-established UK business currently going through a major transition … period, and they're looking for a Data Engineer to help ensure their data platforms, models, and pipelines continue to run smoothly during this exciting phase of change. This is a home-based role with occasional travel to Birmingham - ideal for someone who enjoys autonomy, technical variety ...

Location London Business Area Data Ref # 10047915 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint a complete picture for our clients—around the clock and around the world. In Data, we are responsible … delivering this data, news, and analytics through innovative technology—quickly and accurately. We apply product thinking, domain expertise, and technical insight to continuously improve our data offerings, ensuring they remain reliable, scalable, and fit-for-purpose in a fast-changing landscape. Our Team The Private Deals Data ...

Data Engineer (Databricks & Azure) - 3-Month Rolling Contract Rate: £400-£450 per day Location: Remote IR35 Status: Outside IR35 Duration: Initial 3 months (rolling) About the Company Join a leading Databricks Partner delivering innovative data solutions for enterprise clients. You'll work on cutting-edge projects leveraging Databricks … Azure to transform data into actionable insights. About the Role We are seeking an experienced Data Engineer with strong expertise in Databricks and Azure to join our team on a 3-month rolling contract. This is a fully remote position, offering flexibility and autonomy while working on high ...

Data Engineer Rate: Up to £400 per day (Outside IR35) Contract Length: 6 Months (with strong potential for extension) Location: Hybrid - 1 day per week onsite in Central London A leading organisation is seeking an experienced AWS Data Engineer to join their data and analytics team, contributing … design, development and optimisation of large-scale data solutions within a modern cloud environment. This contract offers the opportunity to work on high-impact projects, delivering data platforms and pipelines that drive real-time insights and strategic business decisions. Responsibilities for the AWS Data Engineer: Design, build ...

Contract Data Engineer £500/day - Outside IR35 6 Months (initial) Fully Remote A major hospitality operator is embarking on a large-scale data transformation project to build a Single Customer View (SCV) that will power personalised engagement across its portfolio of brands. This is a greenfield opportunity … shape the data foundation behind one of the UK's biggest customer data platforms (CDP). You'll work alongside the Lead Data Engineer to design and implement scalable data pipelines, unify disparate data sources, and deliver clean, reliable datasets that drive smarter marketing ...

Senior Data Engineer | £80,000 | Hybrid & Remote Flexibility No Sponsorship Available I am currently partnering with an innovative technology company that is simplifying complex processes through cutting-edge data solutions. They are seeking a Senior Data Engineer to join their agile, collaborative team, where hybrid working … flexible schedules are the norm. The Role: As a Senior Data Engineer, you will be instrumental in evolving the company's data infrastructure, driving reliability, scalability, and insight. This is an end-to-end hands-on role where you will: Enhance the stability and performance of the data ...

Head of Data Engineering Our long-standing financial services client is seeking a Head of Data Engineering to lead a high-performing team responsible for delivering a complex data transformation.Looking for a true greenfield challenge? This is your chance to shape a transformation from the ground … build cutting-edge data solutions, and lead a high-performing team that’s driving change across the business.To succeed in this role, you’ll bring hands-on experience owning and delivering Azure-based data platforms (Databricks, Synapse), alongside strong technical capability in designing and implementing data ingestion ...

exciting opportunity to design and implement the infrastructure that powers advanced machine learning workflows in a production trading environment. Key Responsibilities: Feature Store & Data Lake: Build scalable infrastructure for time-series feature storage, retrieval, and versioning optimised for ML workloads. MLOps Pipelines: Design end-to-end workflows for data ingestion, feature engineering, model training, backtesting, and deployment. Data Ingestion Layer: Connect raw data streams into structured, queryable formats (Parquet/Delta Lake). Production Serving: Deploy feature computation and model inference with appropriate latency characteristics. Integration: Collaborate with existing data capture and execution ...

Technology Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Engineering, ML, Azure, Mainly Remote Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe and the States … skillset in Microsoft Stack Technologies (C# .NET Core) who has then transitioned into Product Ownership. We need someone highly analytical who can understand large Data Sets, Data Bricks and is able to bring Proof of Concepts to the table and help with the execution. The platform primarily serves ...

Working within our Cyber Data Services team, which is at the core of our Proactive Insurance product offering and CFC's promise to protect our policyholders from existing and emerging cyber security vulnerabilities and threats. You will play a key role in developing the company's competitive advantage … aggregating, presenting, and analysing large datasets. You will contribute to the development of our proprietary data platform and work to solve problems that are key to protecting our policyholders. Your contributions will have a material impact on the business as a whole where you will be expected to play ...

Fabric Consultant Location: Hybrid in London Salary: Up to 90,000 + Benefits Are you passionate about data engineering? Join a leading Microsoft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data ...

Fabric Consultant Location: Hybrid in London Salary: Up to £90,000 + Benefits Are you passionate about data engineering? Join a leading Microsoft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data ...

Fabric Consultant Location: Hybrid in London Salary: Up to £90,000 + Benefits Are you passionate about data engineering? Join a leading Microsoft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data ...

Fabric Consultant Location: Hybrid in London Salary: Up to £90,000 + Benefits Are you passionate about data engineering? Join a leading Microsoft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data ...

Fabric Consultant Location: Hybrid in London Salary: Up to £90,000 + Benefits Are you passionate about data engineering? Join a leading Microosft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data ...

defence, water and beyond manage critical infrastructure. Work with the Best: Collaborate daily with a vibrant, multi-disciplinary team of consultants including geospatial experts, data scientists and engineers, sharing ideas and driving innovation across the globe. Cutting-Edge Technology: Get hands-on with the full Esri product suite (ArcGIS … want to make a real-world impact with geospatial technology, we want to hear from you. The role will involve contributions across Geospatial & Data Engineering, AI & Innovation, and Collaboration & Leadership: Collaborating with Tetra Techs digital solutions teams across the globe. Leverage and fine-tune foundation models and AI/ ...

SageMaker , with GenAI/agentic capabilities embedded into the platform. You will also lead a team of four developers and collaborate closely with data engineering, data science and platform teams. Assignment Details Initial Duration : 6 months (strong likelihood of extension) Location : Hybrid/London Day Rate : £flexible PAYE … GitLab CI/CD Extensive Docker containerisation & runtime experience Strong understanding of AWS SageMaker deployments Experience building developer environments for ML/quant/data-intensive workflows Knowledge of monitoring, logging, reporting and test automation Proven team leadership of small development teams Strong understanding of data ingestion ...

About the RoleWe are looking for a Python Data Engineer with strong hands-on experience in Behave-based unit testing, PySpark development, Delta Lake optimisation, and Azure cloud services. This role focusses on designing and deploying scalable data processing solutions in a containerised environment, emphasising maintainable, configurable … test-driven code delivery.Key Responsibilities Develop and maintain data ingestion, transformation, and validation pipelines using Python and PySpark. Implement unit and behavior-driven testing with Behave, ensuring robust mocking and patching of dependencies. Design and maintain Delta Lake tables for optimised query performance, ACID compliance, and incremental data ...

project plans, dependencies, and risk registers. Escalate complex requests to specialized engineering pods and track to closure. TECHNICAL IMPLEMENTATION & ENABLEMENT Provision and configure research, data, and trading environments (Python, AWS, Airflow, GitHub, Coder, etc.). Coordinate bespoke data ingestion (market, alternative, proprietary) via APIs, direct feeds … SaaS implementation roles, with 5+ years leading people or projects. Familiarity with Python, SQL, Linux, AWS/GCP, CI/CD, containerization, and modern data pipelines. Proven success in client onboarding, requirements gathering and workflow design for front office investment teams. Familiarity with market and alternative data sets ...

Senior AI Engineer In office ~x2 days a week This is a newly created opportunity to join a well-established data organisation that is investing in advanced AI capabilities to enhance data intelligence, automate research processes, and bring new value to their users. The team is building … from the ground up, combining deep software engineering rigour with cutting-edge machine learning and retrieval techniques. You will work at the intersection of data engineering, AI product development, and platform reliability. This role suits someone who enjoys building robust pipelines, working on modern LLM integrations, and applying ...