1 to 25 of 86 Permanent Data Ingestion Jobs in England

Senior Data Engineer We are seeking a highly skilled Data Engineer to focus on maintaining data streams and ETL pipelines within a cloud-based environment. The ideal candidate will have experience in building, monitoring, and optimizing data pipelines, ensuring data consistency, and proactively collaborating with upstream and downstream teams to enable seamless data flow … across the organization. In this role, you will not only troubleshoot and resolve pipeline issues but also contribute to enhancing data architecture, implementing best practices in data governance and security, and ensuring the scalability and performance of data solutions. You will play a critical role in understanding the business context of data, supporting analytics and decision … making by collaborating with data scientists, analysts, and other key stakeholders This position requires client presence between 25%-50% of the time per month at the client's office, which is located in London. Key Responsibilities: Data Pipeline Development & Maintenance Build, maintain, and optimize scalable ETL/ELT pipelines using tools such as Dagster, or similar. Ensure high More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions … scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for enterprise data platforms and architecture, ensuring alignment with organizational goals and priorities. Collaborate with C-level executives and business leaders to identify opportunities for leveraging data as a More ❯

health by developing the most advanced biosensing technology science has to offer, capable of accessing bodily information in a painless, real-time and affordable way. Description Join Sava's Data Engineering team at a pivotal stage of growth, contributing to the development and scaling of both, internal and customer-facing data infrastructures. As a Data Engineer II … you will help implement reliable data pipelines, storage solutions, and reporting systems that power analytical and operational workflows across the company. This is a unique opportunity to work in a multidisciplinary environment, collaborating with a top-tier team in engineering, science, and product to shape the foundation of Sava's data architecture. Responsibilities Build and maintain scalable, reliable … data pipelines, ensuring efficient and accurate data ingestion, transformation, and delivery. Design, implement, and optimize data storage solutions using modern databases and cloud-native tools. Develop and maintain reporting systems and dashboards to support data-driven decision-making. Collaborate with backend and infrastructure teams to integrate data services with applications and customer-facing tools. More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations, FinTech and market data, with expertise around strategic cost … maintain our professional, supportive and entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not only lead the design and … implementation of the data infrastructure that powers advanced analytics and data science across our platforms, but also contribute to the strategic direction, roadmap, and execution of data products in collaboration with senior stakeholders. Architect & Build Scalable Data Solutions Collaborate closely with senior product stakeholders to understand data needs and architect end-to-end ingestion More ❯

Data Engineer - STR - London, UK Job Description OVERVIEW CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index and the NASDAQ 100, CoStar Group is on a mission to digitize the world's real estate, empowering all people to discover properties, insights … our employees, and investors. By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate. STR is the global leader in hospitality data benchmarking, analytics, and marketplace insights for the global hospitality industry. STR delivers data that is confidential, accurate, and actionable to empower our clients to strategize and compete in … their markets. Learn more about STR . ROLE DESCRIPTION The role of Data Engineer will be a key role within the STR Data Operations Team, reporting to the Director, Technical Data Operations. The Data Operations team is responsible for data acquisition, data loading, data quality, data processing, data delivery, and data More ❯

technology enables customers to easily personalise their creations to keep for themselves or share as the most thoughtful of gifts. About The Role: We are looking for a Senior Data Platform Engineerto join our London-based data team and help us build a platform that accelerates a decentralised-by-design data adoption model within the business. We … care about trustable, usable data and we want you to bring your technical expertise to make that happen. You're a software engineer at heart, you thrive in the data domain and care deeply about customer outcome-focused engineering excellence. Day to day, you will build observable, scalable and resilient data services that ingest data from … source systems into consuming applications such as our data warehouse to meet the needs of analytics engineers and stakeholders. You will make significant contributions to solution designs, provide technical guidance to other team members and champion iterative approaches to software delivery. You will work within a cross-functional mission-led team, led by a product manager, an engineering manager More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization of diverse … business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯

280+ Employees - We have over 280 passionate employees transforming the industry across the Group, one home at a time The Role We're seeking a motivated and detail orientated Data Engineer with experience in building and managing scalable data pipelines and infrastructure. You'll be responsible for developing robust ETL/ELT processes, optimising and maintaining data warehouse, and ensuring data quality and standards through comprehensive monitoring and governance. Collaborating closely with our Data, Tech and Product teams, you'll help shape and support our data strategy. The ideal candidate should have familiarity in SQL and cloud-based data solutions, be driven towards automated solutions and thrives in transforming complex data infrastructure into streamlined, reliable, and actionable assets. Responsibilities: Own Data Infrastructure : Design, develop, and maintain scalable data pipelines and infrastructure to enable reliable analytics and data-driven decisions. ETL/ELT Development : Build, optimise, and manage ETL processes in BigQuery and associated tools to ensure timely and accurate data ingestion. Data Warehousing : Maintain and More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization of diverse … business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization of diverse … business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI software development including database/reporting development, full development cycle … Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI/MI solutions in line with agreed architectural principles and toolsets. Capable of working closely with the business and delivering … complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practises, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional/Tabular), Power BI Python, MDX, DAX Responsibilities The Data Manager will be responsible for supporting Head of Data and Analytics and wider More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI software development including database/reporting development, full development cycle … Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI/MI solutions in line with agreed architectural principles and toolsets. Capable of working closely with the business and delivering … complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practises, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional/Tabular), Power BI Python, MDX, DAX Responsibilities The Data Manager will be responsible for supporting Head of Data and Analytics and wider More ❯

LBANK, Gett, Kaizen Gaming, and TransferGo. Our products are recognised by industry leaders like Gartner's Magic Quadrant, Forrester Wave and Frost Radar. Our tech stack: Superset and similar data visualisation tools. ETL tools: Airflow, DBT, Airbyte, Flink, etc. Data warehousing and storage solutions: ClickHouse, Trino, S3. AWS Cloud, Kubernetes, Helm. Relevant programming languages for data engineering … tasks: SQL, Python, Java, etc. What you will be doing: Designing and developing scalable and efficient data pipelines, ETL processes, and data integration solutions to support data ingestion, processing, and storage needs. Ensuring data quality and reliability by implementing data validation, data cleansing, and data quality monitoring processes. Optimising database performance by … tuning queries, implementing indexing strategies, and monitoring and analysing system performance metrics. Collaborating with cross-functional teams to gather requirements, understand data needs, and develop data solutions that align with business objectives. Staying up-to-date with emerging technologies and industry trends in data engineering, and identifying opportunities for process improvements and tool enhancements. Establishing and enforcing More ❯

Senior Machine Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great … for our colleagues too; we won Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the people inside and outside our … business that power us and were currently on the hunt for 2 experienced Senior Machine Learning Operation Engineers to join our Data Function. You'll play a significant role within our Data Function, working on the design and implementation of machine learning model engineering frameworks, solutions, and best practices. You'll be technically proficient in machine learning and More ❯

Senior Machine Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great … for our colleagues too; we won Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the people inside and outside our … business that power us and were currently on the hunt for 2 experienced Senior Machine Learning Operation Engineers to join our Data Function. You'll play a significant role within our Data Function, working on the design and implementation of machine learning model engineering frameworks, solutions, and best practices. You'll be technically proficient in machine learning and More ❯

a dynamic environment. Build, train, and deploy state-of-the-art models (e.g., deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, experimentation, model versioning, and monitoring. Collaborate with product, design, and DevOps teams to integrate AI features into our platform. Stay current with AI research, open-source tools … and frameworks to maintain a leading edge. Support and mentor junior engineers as the team grows. Key Responsibilities Implement end-to-end AI pipelines: data collection/cleaning, feature engineering, model training, validation, and inference. Rapidly prototype novel models using PyTorch, TensorFlow, JAX, or equivalent. Productionize models in cloud/on-prem environments (AWS/GCP/Azure) with … containerization (Docker/Kubernetes). 2. Data & Infrastructure Build and maintain scalable data pipelines (ETL/ELT) and data lakes/warehouses. Establish best practices for data labeling, versioning, and governance. Implement MLOps processes: CI/CD for model training, automated testing, model drift detection, and continuous monitoring. Evaluate applicability of new research and tools to More ❯

Data Engineer (Enterprise DataWarehouse Developer) Description: As a Data Engineer, you'll design and maintain data scrapers and data pipelines, design & optimize analytics & relational databases, and build analytics models using DBT and bespoke aggregation engines. You'll work closely with business stakeholders, other BI Developers and DataOps as well as System engineers to support both data … bespoke tools written in Python/Java, as well as tools such as Meltano, Airflow, Mulesoft/Snaplogic, Apache NIFI, and Kafka, ensuring a robust, well-modelled, and scalable data analytics infrastructure running on MySQL and Postgres style databases primarily. Requirements: Advanced SQL development and deep understanding of RDBMS concepts and engines Practical knowledge of Data Warehouse infrastructure … architecture and best practices Practical database design, development, administration knowledge (any RDBMS) Strong understanding of data governance, quality, and privacy (e.g. GDPR compliance) Proficiency in ELT/ETL processes Strong experience in data ingestion, transformation & orchestration technology (ETL tools such as Informatica, Datastage, SSIS, etc ) or open source Meltano, Airbyte, and Airflow Proven experience with DBT (data More ❯

solutions through an agile framework. Our Technology team is responsible for: Software Development Infrastructure DevOps and Automation Service Delivery Project Management Brief Role Objective: As a member of the Data Development team, you will be responsible for developing ways to consolidate, analyse, and present our data to support the operations and future growth of our business. In this … role you will be involved in a wide variety of high-profile business facing initiatives from developing data extracts and PowerBI reports to optimising the data warehouse to deliver data more quickly to the business each day. You will work with the Lead Data Engineer and other members of the Data Engineering team to deliver … our new strategic enterprise data platform based on Snowflake and DBT, while also maintaining our legacy data platform. Key Responsibilities: Data warehouse design and implementation working towards the creation of a single source of truth. Development of data ingestion/transformation pipelines using Fivetran, DBT and Gitlab. Creation of management information dashboards. Work with business More ❯

technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits and career development opportunities. Come make … to propel healthcare forward in a way that better serves everyone. With our hands at work across all aspects of health, we use the most advanced development tools, AI, data science and innovative approaches to make the healthcare system work better for everyone. As a Principal Data Engineer at Optum, you'll be responsible for working with key … developers to ensure a shared understanding of business and technical requirements Design and build data pipelines to process terabytes of data Develop and recommend best practice re dataingestion, processing,cleaningand standardizingof data (typically on Azure) Create Docker images for various applications and deploy Design and build tests Troubleshoot production issues Analyze existing Data solutions and recommend More ❯

It is only when expertise, highly professional processes and enjoyment of work unite that we can shape the future together. BMW Group Financial Services UK is looking for a Data Analyst. This role is based at the Summit ONE Campus in Farnborough. What awaits you? Analyse data from transactional systems to understand the generation and transformation of data, and its relationship to business processes and models. Develop a detailed understanding of transactional system data at the attribute level to prepare for effective transformation into a structure suitable for analytics. Identify and quantify business stakeholders' requirements which we can convert to re-usable Data Products. Design and implement suitable database schemas to be integrated into our … overall Data Model for the purpose of Self-Serving to our customer "spokes". Help embed Data Quality checks, validations, and alerting mechanisms across all data ingestion processes. Partner closely with our Data Engineering Hub in the integration of ETL processes into the Enterprise Data Model platform, ensuring data integrity and seamless flow. More ❯

Data Engineer: Migrations Salary: competitive depending upon experience + benefits Where the job is based: (home-based, working with Kerv office/customer site visits as required) UK HQ, Seven House, 18 High Street, Longbridge, B31 2UQ Who we are: Dive into a world where technology meets innovation. At Kerv Digital, we're not just another tech company. We … re the problem solvers, the magicians who transform complex challenges into seamless digital experiences. Utilising a powerful blend of Power Platform, DevSecOps, Data experiences, and Software Engineering, we create business solutions that truly resonate with our clients driving extreme value! With our roots planted in Birmingham and branches spreading across the globe from London to Bangalore, we're a … with a global multi-discipline team and be guided by the industry's most forward-thinking architects. Who we are looking for: You are excited by helping customers with data plumbing problems, getting from A to B; but still an engineer at heart, working to best practise in-mind. You learn fast and love to build. Cloud experience is More ❯

status, or disability status. About the role You'll be joining our Product Engineering team, specifically our Aggregate Team. The Aggregate Team is responsible for building and maintaining our data pipeline and ETL processes, which form the core of our product and define what makes Tenzo unique. With over 70 integrations and counting, we are constantly expanding our capabilities … and handling substantial amounts of data that feed our web and mobile applications. The Aggregate Team is strategic for us, with a primary focus on leading innovation, enhancing functionality, scalability, and connectivity of our new and legacy integrations, ultimately delivering seamless experiences for our valued customers and partners. You can explore our integrations here: Tenzo Integrations This is an … Our Tech Stack: Apache Airflow Python Django AWS (S3, RDS withPostgresql, ElastiCache, MSK, EC2, ECS, Fargate, Lamda etc.) Snowflake Terraform CircleCI Your mission Support the design and development of data pipelines, learning to orchestrate key activities such as data ingestion, extraction and transformation, task automation Work on data challenges under guidance, focusing on delivering short-term More ❯

Data Engineer: Migrations Salary: competitive depending upon experience + benefits Where the job is based: (home-based, working with Kerv office/customer site visits as required) UK HQ, Seven House, 18 High Street, Longbridge, B31 2UQ Who we are: Dive into a world where technology meets innovation. At Kerv Digital, we're not just another tech company. We … re the problem solvers, the magicians who transform complex challenges into seamless digital experiences. Utilising a powerful blend of Power Platform, DevSecOps, Data experiences, and Software Engineering, we create business solutions that truly resonate with our clients driving extreme value! With our roots planted in Birmingham and branches spreading across the globe from London to Bangalore, we're a … with a global multi-discipline team and be guided by the industry's most forward-thinking architects. Who we are looking for: You are excited by helping customers with data plumbing problems, getting from A to B; but still an engineer at heart, working to best practise in-mind. You learn fast and love to build. Cloud experience is More ❯

or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. How does this role contribute to our collective success? Data and analytics are of critical importance for AXIS. Simply put, we want to turn data into information, that can be used to: Enable decisions to be made with … Innovation & Analytics team is a core component of AXIS's strategy, with the potential to transform the way in which we do business and enable us to effectively leverage data and technology to our competitive advantage. The central mandate is to horizon-scan, prototype and implement innovative solutions to business problems. What will you do in this role? The … developing and implementing artificial intelligence solutions to solve complex problems and enhance business operations. The successful candidate will work cross-functionally; operating between the business stakeholders, technology teams, and data scientists, to ensure that final solutions meet requirements. The Lead AI Solutions Engineer is an expert in large language models, Gen AI application implementation and machine learning, and has More ❯