1 to 25 of 83 Remote Data Ingestion Jobs in the UK

Job Title: Senior Data Engineer Location: Hybrid – 1 day per fortnight in the Wilmslow offices Working hours 0900 to 1730 The Role Following recent investment, The Citation Group are looking to build out their data capabilities to be Best in Class. As such, a fantastic opportunity has arisen for a strong data engineer to work in the … data engineering team, to expand and maintain the data infrastructure that provides the foundations from which our BI, Data Science and Operational Data teams deliver insights and revenue to the functions across the wider group. We’re looking for an individual who has experience working with enterprise grade data pipelines and infrastructure, who can implement … processes on our modern tech stack with robust, pragmatic solutions. Responsibilities develop, and maintain ETL/ELT data pipelines using AWS services Data, Databricks and dbt Manage and optimize data storage solutions such as Amazon S3, Redshift, RDS, and DynamoDB. Implement and manage infrastructure-as-code (IaC) using tools like Terraform or AWS CloudFormation. Monitor and optimize More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯

My client is based in the London area and is currently looking to recruit an experienced Fabric Data Engineer to join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by … implement and utilise the most in-demand and cutting-edge technology on the market right now. Your role will include: Collaborate closely with stakeholders to understand and interpret their data and analytics needs. Design and deploy end-to-end data solutions using Microsoft Fabric, encompassing data ingestion, transformation, and visualisation workflows. Construct and refine data models, pipelines, and ETL frameworks within the Fabric ecosystem. Leverage Fabric's suite of tools to build dynamic reports, dashboards, and analytical applications. Maintain high standards of data integrity, consistency, and system performance across the data environment. Advise on data governance, security protocols, and compliance strategies aligned with industry best practices. Diagnose and resolve technical challenges More ❯

280+ Employees - We have over 280 passionate employees transforming the industry across the Group, one home at a time The Role We're seeking a motivated and detail orientated Data Engineer with experience in building and managing scalable data pipelines and infrastructure. You'll be responsible for developing robust ETL/ELT processes, optimising and maintaining data warehouse, and ensuring data quality and standards through comprehensive monitoring and governance. Collaborating closely with our Data, Tech and Product teams, you'll help shape and support our data strategy. The ideal candidate should have familiarity in SQL and cloud-based data solutions, be driven towards automated solutions and thrives in transforming complex data infrastructure into streamlined, reliable, and actionable assets. Responsibilities: Own Data Infrastructure : Design, develop, and maintain scalable data pipelines and infrastructure to enable reliable analytics and data-driven decisions. ETL/ELT Development : Build, optimise, and manage ETL processes in BigQuery and associated tools to ensure timely and accurate data ingestion. Data Warehousing : Maintain and More ❯

LBANK, Gett, Kaizen Gaming, and TransferGo. Our products are recognised by industry leaders like Gartner's Magic Quadrant, Forrester Wave and Frost Radar. Our tech stack: Superset and similar data visualisation tools. ETL tools: Airflow, DBT, Airbyte, Flink, etc. Data warehousing and storage solutions: ClickHouse, Trino, S3. AWS Cloud, Kubernetes, Helm. Relevant programming languages for data engineering … tasks: SQL, Python, Java, etc. What you will be doing: Designing and developing scalable and efficient data pipelines, ETL processes, and data integration solutions to support data ingestion, processing, and storage needs. Ensuring data quality and reliability by implementing data validation, data cleansing, and data quality monitoring processes. Optimising database performance by … tuning queries, implementing indexing strategies, and monitoring and analysing system performance metrics. Collaborating with cross-functional teams to gather requirements, understand data needs, and develop data solutions that align with business objectives. Staying up-to-date with emerging technologies and industry trends in data engineering, and identifying opportunities for process improvements and tool enhancements. Establishing and enforcing More ❯

Senior Machine Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great … for our colleagues too; we won Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the people inside and outside our … business that power us and were currently on the hunt for 2 experienced Senior Machine Learning Operation Engineers to join our Data Function. You'll play a significant role within our Data Function, working on the design and implementation of machine learning model engineering frameworks, solutions, and best practices. You'll be technically proficient in machine learning and More ❯

Senior Machine Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great … for our colleagues too; we won Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the people inside and outside our … business that power us and were currently on the hunt for 2 experienced Senior Machine Learning Operation Engineers to join our Data Function. You'll play a significant role within our Data Function, working on the design and implementation of machine learning model engineering frameworks, solutions, and best practices. You'll be technically proficient in machine learning and More ❯

Join a Leading Growth business on its transformative journey to become the UK's most recommended businesses in their industry Lead Data Engineer Salary: £70-90k Location: Reading – Hybrid Benefits: Competitive Role Overview: As Lead Data Engineer , you will be part of the Corporate Data team, reporting directly to the Senior Leadership team. You will lead … a small team of data engineers, overseeing the design, build, and maintenance of the infrastructure and systems that collect, store, and process corporate data for reporting and analysis. Key Responsibilities: • Lead and manage a team of data engineers. • Design, build, and maintain data infrastructure and systems. • Ensure effective use of Microsoft Fabric and Synapse analytics platform. … Collaborate with various stakeholders, including Data and Systems owners, Data Analysts, Data Architects, Infrastructure Architects, and external suppliers. Experience required • Dynamic and hands-on leader who excels in managing and coaching a team. • Thrives in a collaborative environment and adapts to changing priorities with ease. • Excellent communication and presentation skills, capable of conveying complex ideas to both More ❯

to join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by a huge Multi National equity firm who are looking to bolster my client's financial position. They are expected to … implement and utilise the most in-demand and cutting-edge technology on the market right now. Your role will include: Collaborate closely with stakeholders to understand and interpret their data and analytics needs. Design and deploy end-to-end data solutions using Microsoft Fabric, encompassing data ingestion, transformation, and visualisation workflows. Construct and refine data models, pipelines, and ETL frameworks within the Fabric ecosystem. Leverage Fabric’s suite of tools to build dynamic reports, dashboards, and analytical applications. Maintain high standards of data integrity, consistency, and system performance across the data environment. Advise on data governance, security protocols, and compliance strategies aligned with industry best practices. Diagnose and resolve technical challenges More ❯

to join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by a huge Multi National equity firm who are looking to bolster my client's financial position. They are expected to … implement and utilise the most in-demand and cutting-edge technology on the market right now. Your role will include: Collaborate closely with stakeholders to understand and interpret their data and analytics needs. Design and deploy end-to-end data solutions using Microsoft Fabric, encompassing data ingestion, transformation, and visualisation workflows. Construct and refine data models, pipelines, and ETL frameworks within the Fabric ecosystem. Leverage Fabric’s suite of tools to build dynamic reports, dashboards, and analytical applications. Maintain high standards of data integrity, consistency, and system performance across the data environment. Advise on data governance, security protocols, and compliance strategies aligned with industry best practices. Diagnose and resolve technical challenges More ❯

Job Description: Your Impact As a Software Data Engineer, you will design, develop, deploy, and maintain data architecture which employs various methods to transform raw data into processed data. You will own the data operations infrastructure, manage and optimise performance, reliability, and scalability of the system to meeting growing demands on ingestion and processing pipelines. … To succeed in this data engineering position, you should have strong problem-solving skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages. Key areas of responsibility. Orchestration ingestion and storage of raw data into structured or unstructured solutions. Design, Develop, Deploy and Support data infrastructure, pipelines and architecture. Implement reliable, scalable, and tested solutions to automate data ingestion. Development of systems to manage batch processing and real-time streaming of data Evaluate business needs and objectives. Facilitate pipelines, which prepare data for prescriptive and predictive modelling. Working with domain teams to scale the processing of data. Combine raw information from More ❯

Data Engineer (Integration) - Nationwide Charity Location: London-based (Hybrid - 1 day per week in the office) Contract: FTC - 23 months £56,500 per annum Overview: We are currently recruiting on behalf of a well-established nationwide charity for a Data Engineer (Integration) . This is an exciting opportunity to play a key role in designing and developing data products and services that improve how data is accessed and used across the organisation. You'll help ensure data is accurate, timely, and fit for purpose, supporting a wide range of departments and strategic goals. Role Summary: As a Data Engineer, you will work to connect systems, streamline business processes, and optimise data warehouse platforms. … You'll collaborate with stakeholders to deliver bespoke BI solutions, ranging from custom queries to dashboards and reports. Your work will transform raw data into actionable insights that drive the charity's mission forward.In addition to building and maintaining data integration pipelines, you'll help ensure the ongoing performance and reliability of the charity's core data More ❯

an office in Central London and work as a mix from office and home. The role We are looking for a senior Machine Learning Engineer with a spike in data engineering and maintaining real-time data pipelines. You will work with our Product & Engineering team along the end-to-end algorithm lifecycle to advance the Trudenty Trust Network. … A bit more on what you’ll do: Data Engineering Develop and maintain real-time data pipelines for processing large-scale data Ensure data quality and integrity in all stages of the data lifecycle Develop and maintain ETL processes for data ingestion and processing Algorithm Development, Model Training and Optimisation Design, develop, and … algorithms for fraud prevention and user personalization Train and fine-tune machine learning models using relevant datasets to achieve optimal performance Implement strategies for continuous model improvement and optimization Data Mining & Analysis Apply data mining techniques such as clustering, classification, regression, and anomaly detection to discover patterns and trends in large datasets. Analyze and preprocess large datasets to More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯