176 to 200 of 599 Data Ingestion Jobs in the UK

Are you passionate about building scalable, analytics-ready data models that power business intelligence and AI? I'm looking for an Analytics Engineer to join a global organisation that's investing heavily in a modern, AI-ready data platform - and this is your chance to help shape it from the ground up. You'll be part of a … newly formed, high-impact Data Team working in a fast-paced, collaborative, and entrepreneurial environment. Based in their modern Leeds office, you'll spend 4 days a week on-site, working closely with engineers, analysts, and business stakeholders. About the Platform: This greenfield initiative is focused on building a next-gen data ecosystem with a tech stack including … Snowflake for cloud data warehousing dbt for transformation and modelling Azure for cloud infrastructure and orchestration Fivetran for automated data ingestion Power BI and other modern BI tools for reporting and visualisation What You'll Do: Design and implement scalable, well-documented data models in Snowflake using dbt Build curated, reusable data layers that support More ❯

We are seeking a skilled Azure DevOps Engineer with hands-on experience in Terraform , Kubernetes , and cloud-native data architecture to help build and maintain scalable infrastructure in Microsoft Azure. This role is focused on automating infrastructure provisioning, deploying containerized applications, and building a secure and efficient cloud data lake environment to support large-scale data ingestion … CI/CD pipelines using Azure DevOps. Manage and provision cloud infrastructure using Terraform (Infrastructure as Code). Deploy and manage Kubernetes clusters (AKS) and containerized workloads. Work with data engineering teams to design and implement a cloud-based data lake architecture on Azure. Automate data pipeline deployments and integrations using Azure services (e.g., Data Factory … in DevOps or Cloud Engineering roles. Strong proficiency with Terraform and managing IaC deployments. Experience managing Kubernetes (AKS preferred) in production environments. Experience designing or supporting a cloud-based data lake (Azure Data Lake Gen2, Blob Storage, etc.). Proficient in scripting languages such as PowerShell , Bash , or Python . Experience with CI/CD tools, especially Azure More ❯

Search 5.0 is delighted to partner with an innovative AI tech start-up in the financial data sector, seeking a Rust Developer to join their exciting journey! Our client equips traders with tools that are faster, smarter, and easier to use. This is a fantastic opportunity to join a leading AI company whose Machine Learning product suite creates new … trading opportunities through real-time analytics, supported by a world-class, scalable, ultra-low latency architecture. The Data Platform is crucial to all capabilities and services, enabling data ingestion, analysis, querying, and storage at near-real-time speeds, setting our client apart from competitors. While most companies process data in days, hours, or minutes, our client … driving the technical direction ensuring requirements are met and building a scalable product. Develop and maintain the platform services that underpin our products, in tandem with SME’s in data science and quantitive finance. Contribute new products and technical ideas, providing feedback and collaboration sessions. Work closely with QA to ensure that systems are engineered accordingly What we’re More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

Responsibilities Develop and maintain infrastructure for our SaaS platform that delivers AI-driven computer vision tools to researchers and scientists. Collaborate with a multidisciplinary team of machine learning engineers, data scientists, software developers, and biologists. Build and support GPU-accelerated environments for training and real-time inference of deep learning models. Deploy and manage ML pipelines using tools like … Docker, Kubernetes, and frameworks such as Kubeflow or Ray. Create and document APIs that enable internal and external users to access data and model outputs. Implement secure authentication and authorization systems for platform users. Maintain and improve our cloud platform’s reliability, security, and compliance (e.g., GDPR, HIPAA readiness). Automate testing, training, and deployment of models through robust … CI/CD pipelines. Monitor and troubleshoot performance issues across data and inference workflows in production. What We’re Looking For 5+ years of experience in DevOps, MLOps, SRE, or Data Engineering roles. Strong proficiency with public cloud platforms (e.g., GCP, AWS, or Azure), with preference for GCP. Expertise in Terraform and infrastructure-as-code practices. Solid experience More ❯

be doing Support end-to-end deployment of ML models (batch and real-time) from code validation through to production rollout under guidance from senior team members. Work with Data Science teams to facilitate smooth model handover and ensure deployment readiness aligned with implementation standards. Build and maintain CI/CD pipelines for model deployment, scoring, and operational monitoring. … Debug and fix pipeline issues including data ingestion problems, model scoring failures, and deployment errors. Write comprehensive tests for ML pipelines (unit, integration, validation) and implement data quality checks and operational monitoring. Ensure deployed models meet audit, reconciliation, and governance requirements. Monitor production models for operational health, troubleshoot failures, and track data/variable drift over … time. Work with Platform Engineers within the team to create reusable MLOps templates and support Data Scientists in using them effectively. Support model migrations across data sources, tools, systems, and platforms. Participate in code reviews, knowledge sharing, and pod activities (standups, grooming, delivery check-ins). Learn from senior team members and contribute to continuous improvement of model More ❯

for online retail. For over 10 years, we've been pioneering privacy-safe, full-funnel marketing measurement, empowering all teams to make smarter decisions Our platform unites Finance, Marketing, Data, and Leadership with a shared view of performance and profitability—combining full-funnel measurement, forecasting, and optimization. With Fospha, every team moves faster and grows smarter. Trusted by over … and motivated Business Intelligence Manager to contribute to our Business Intelligence team. The ideal candidate will be a strong individual contributor with a solid analytical background, developing and implementing data-driven solutions to support business decisions. This is an exciting opportunity to contribute to shaping our BI capabilities from the ground up, fostering a data-driven culture and … collaborating with a high-performing team. You will combine analytical expertise with a collaborative approach to develop, optimize, and troubleshoot BI solutions. Responsibilities: Define and implement best practices for data analysis and reporting. Conduct in-depth analysis to identify actionable trends and patterns. Develop and maintain insightful reports and dashboards. Communicate complex data findings and recommendations clearly to More ❯

a unified, trusted and sustainable value chain that enables the most efficient production and logistics outcomes, while lowering the impact on the environment. We deliver actionable digital solutions and data insights that connect global supply chains, improving the safety, quality and sustainability of food and consumer goods, all in a way that's traceable and clear to the end … right price, creating more sustainable production and consumption outcomes. As part of our Food, Beverage and Consumer Goods team, you’ll help our customers connect business processes and leverage data-driven technology for better visibility, agility and responsiveness. The purpose of this role is to complete technical tasks as required in the delivery of client implementations of Trade Promotion … using SQL Server stack 2012 or above, Knowledge of SQL Server Suite, V12. Experience working with Developer tools such as Azure DevOps, Visual Studio Team Server Kimball methodologies for Data Warehousing Strong experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, An analytical mindset, excellent communication and interpersonal skills More ❯

Direct message the job poster from un:hurd music Lead Data Scientist at Un:hurd Music, PhD Who We Are For years, artists have been 'shooting in the dark' when it comes to their marketing. There's a clear lack of robust, transparent and accessible marketing tools for musicians and artists to use to promote their music. At un … hurd music, we've created a music-tech platform that uses proprietary technology to turn music data into stronger promotional campaigns for artists. We've created both mobile and web applications which act as the 'digital marketing companion' for independent artists, facilitating data-led promotional campaigns across streaming and social media platforms. Over the past two years we … hire responsible for the software development and technical infrastructure needed to design, train, deploy and scale machine learning models in production environments. You will harness a diverse array of data sources, from streaming services to social media, revolutionizing the way artists promote their music. Our Data Team members are full stack data professionals who independently manage projects More ❯

Lead Data Engineer - Investment Management | London | Hybrid | Permanent Salary: Up to £120,000 + bonus Location: London, UK (Hybrid - WFH & Office) Industry: Investment Management Sector: Data About the Role A hands-on Lead Data Engineer role within an established investment management firm, where you will take ownership of a new data team and drive innovation in … data technology. You will be responsible for defining and implementing data strategy and architecture, building a modern data stack, and leading a team of data professionals to enhance the firm's capabilities. Responsibilities Implement data strategy and architecture Build and maintain a modern data stack, including data lakes, warehouses, and pipelines for data ingestion and processing Ensure the data infrastructure meets the requirements of data science and analytics teams Lead and mentor a growing team of data professionals Key Experience Extensive background in data engineering roles, ideally within financial services Previous experience leading or managing a technical data team Strong proficiency in SQL and Python (Pandas More ❯

Job title: Data Engineer Location: UK Duration: 6-month contract Inside IR35 Working Mode: Fully Remote Vetting: Active SC Clearance Job Description: Data Engineer Skills and Technologies Data Engineering: Strong understanding of data concepts Data types, data structures, schemas (both JSON and Spark), schema management etc. Strong understanding of complex JSON manipulation Experience working … with Data Pipelines using custom Python/PySpark frameworks Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data. Strong understanding of Data Security principles Data owners, access controls Row and column level, GDPR etc including experience of handling sensitive datasets Strong problem … Delta Lake Bash (both CLI usage and scripting) Git Markdown Scala (bonus, not compulsory) Azure SQL Server as a HIVE Metastore (bonus) Technologies: Azure Databricks Apache Spark Delta Tables Data processing with Python PowerBI (Integration/Data Ingestion) JIRA #J-18808-Ljbffr More ❯

Senior Data Engineer MUST HAVE SNOWFLAKE, AWS, SNOWPRO CORE Salary - £70-80k with 15% bonus Hybrid working - couple of days in the office City of London We are looking for: Good understanding of data engineering principles A good technical grasp of Snowflake and automating it, and transforming complex datasets SnowPro core certification. AWS Skillset Delivery experience Building … solutions in snowflake Insurance experience - advantageous but not necessary MUST HAVE SNOWFLAKE, AWS, SNOWPRO CORE Key Responsibilities: Lead the design and implementation of Snowflake [and Redshift] based data warehousing solutions within an AWS environment Mentoring of team members through code reviews and pair programming Build and support new AWS native cloud data warehouse solutions Develop and optimize ETL … processes using AWS services (e.g. AWS Glue, Lambda) to ensure efficient data ingestion, transformation, storage, and cost optimization. Deliver data to presentation layers to power reporting and analytics Collaborate with stakeholders, product owners, and developers Create and maintain data models that serve as a foundation for reporting and analytics Monitor performance metrics and troubleshoot issues within More ❯

REQUIRED: DATA ENGINEER - SC CLEARED Location: Fully remote with occasional travel to Central London IR35 Status: Inside Duration: 6-month initial contract Job Description: Seeking a Data Engineer with a strong understanding of data concepts, including data types, data structures, schemas (JSON and Spark), and schema management. Key Skills and Experience: Strong understanding of complex … JSON manipulation Experience with Data Pipelines using custom Python/PySpark frameworks Knowledge of the 4 core Data categories (Reference, Master, Transactional, Freeform) and handling Reference Data Understanding of Data Security principles, access controls, GDPR, and handling sensitive datasets Strong problem-solving and analytical skills Experience in support roles, incident triage, and handling (SLAs) Linux system … and Frameworks: JSON YAML Python (advanced proficiency, Pydantic bonus) SQL PySpark Delta Lake Bash Git Markdown Scala (bonus) Azure SQL Server (bonus) Technologies: Azure Databricks Apache Spark Delta Tables Data processing with Python PowerBI (Data ingestion and integration) JIRA Additional Notes: Candidates with current or past high-level security clearance are encouraged to apply. Successful candidates will More ❯

Lead Data Engineer Leeds - Hybrid working £85,000-£90,000 Robert Walters are delighted to be partnering with an 8-figure turnover business based in Leeds. They are currently undergoing a transformation and are looking to hire a Lead Data Engineer to spearhead a greenfield project. The ideal candidate will have experience with Microsoft Fabric, with additional experience … in Azure or AWS being highly advantageous. Responsibilities Lead the end-to-end design and development of a new, cloud-based data platform focusing on scalability, performance, and security to support enterprise data initiatives. Serve as the subject matter expert for Microsoft Fabric, guiding its implementation and integration within the company's cloud environment, which is currently AWS … with potential migration to Azure. Establish and enforce best practices for data ingestion, transformation, storage, and orchestration, laying a solid foundation for analytics, reporting, and AI/ML projects. Collaborate with data analysts, data scientists, and business leaders to gather requirements and develop scalable data solutions. Design and build scalable data pipelines and ETL More ❯

Prestigious opportunity for a Data Platform Engineer within a pioneering technology team based in Manchester. Following a period of significant growth, investment and a cloud transformation, we are inviting you to join our success story! As our Azure Data Platform Engineer, you will be responsible for:- Designing, building, and maintaining scalable data solutions on Microsoft Azure. Designing … and implementing scalable data pipelines using Azure Data Factory, Databricks, Synapse Analytics, and other Azure services. Leading technical workstreams and supporting project delivery. Acting as the subject-matter expert for cloud-based data engineering. Ensure data governance, security, and compliance standards are met. Monitoring and troubleshooting data platform performance and issues. Automate data ingestion … transformation, and integration processes. Document technical solutions and maintain best practices. If you possess a combination of some of the following skills, then LETS TALK! Proven experience with Azure data services (SQL, Data Factory, Data Lake, Synapse, Databricks, Azure SQL and Cosmos DB). Strong proficiency in designing and operating scalable data solutions and pipelines. Familiar More ❯

Prestigious opportunity for a Data Platform Engineer within a pioneering technology team based in Manchester. Following a period of significant growth, investment and a cloud transformation, we are inviting you to join our success story! As our Azure Data Platform Engineer, you will be responsible for:- Designing, building, and maintaining scalable data solutions on Microsoft Azure. Designing … and implementing scalable data pipelines using Azure Data Factory, Databricks, Synapse Analytics, and other Azure services. Leading technical workstreams and supporting project delivery. Acting as the subject-matter expert for cloud-based data engineering. Ensure data governance, security, and compliance standards are met. Monitoring and troubleshooting data platform performance and issues. Automate data ingestion … transformation, and integration processes. Document technical solutions and maintain best practices. If you possess a combination of some of the following skills, then LETS TALK! Proven experience with Azure data services (SQL, Data Factory, Data Lake, Synapse, Databricks, Azure SQL and Cosmos DB). Strong proficiency in designing and operating scalable data solutions and pipelines. Familiar More ❯