1 to 25 of 143 Permanent Data Ingestion Jobs in the UK

Job summary Are you looking for a pivotal role, where you can leverage your extensive experience in data engineering and architecture to design and implement robust data solutions that drive business insights and decision-making? We are looking for a Principal Data Engineer to lead a growing team and to own and help deliver our Digital and … Data strategy. Your leadership will be instrumental in setting technical direction and mentoring engineers to optimize our data pipelines and infrastructure. You will collaboratively develop and maintain data models, architecture, and integration strategies so that the organisation can use its data well and safely. You are equally as comfortable in your expert role, designing and delivering … solutions, as you are engaging with business owners and teasing out their user needs, building relationships with other DDaT professions and coaching less experienced data engineers. Main duties of the job You'll be leading the work to design and populate the data architecture for our local cloud environment, ensuring that our future data services can be More ❯

Job summary Are you a data engineer with a passion for public service? Then maybe you're looking for us! We are seeking an experienced and skilled Advanced Data Engineer to be part of a growing team that delivers on our mission of protecting and improving the health and wellbeing of the people of Wales. You'll be … involved in improving our data practices, cataloguing our data, automating our data processing, analytical pipelines and developing our overall data maturity. Working with us you'll collaborate with other technical specialists (such as developers, database administrators, data analysts and data scientists) on the development, implementation, maintenance, and improvement of robust, efficient, secure, and scalable … data infrastructure. You'll play a key role in communicating between technical and non-technical; listening to, interpreting and translating the needs of technical and business stakeholders to ensure shared understanding and effective solutions. Main duties of the job You'll be a champion for data engineering as a profession, agile development practices and methods such as CI More ❯

Senior Data Engineer We are seeking a highly skilled Data Engineer to focus on maintaining data streams and ETL pipelines within a cloud-based environment. The ideal candidate will have experience in building, monitoring, and optimizing data pipelines, ensuring data consistency, and proactively collaborating with upstream and downstream teams to enable seamless data flow … across the organization. In this role, you will not only troubleshoot and resolve pipeline issues but also contribute to enhancing data architecture, implementing best practices in data governance and security, and ensuring the scalability and performance of data solutions. You will play a critical role in understanding the business context of data, supporting analytics and decision … making by collaborating with data scientists, analysts, and other key stakeholders This position requires client presence between 25%-50% of the time per month at the client's office, which is located in London. Key Responsibilities: Data Pipeline Development & Maintenance Build, maintain, and optimize scalable ETL/ELT pipelines using tools such as Dagster, or similar. Ensure high More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions … scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data platforms and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and drive the long-term vision for enterprise data platforms and architecture, ensuring alignment with organizational goals and priorities. Collaborate with C-level executives and business leaders to identify opportunities for leveraging data as a More ❯

Join to apply for the Data Solutions Architect -GCP role at EXL 2 days ago Be among the first 25 applicants Join to apply for the Data Solutions Architect -GCP role at EXL Get AI-powered advice on this job and more exclusive features. Senior Talent Acquisition Manager | Hiring for Data, AI, Tech & Digital Transformation | Leadership Hiring … UK & Ireland | Driving Inclusive &... EXL (NASDAQ: EXLS) is a global data and artificial intelligence (AI) company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the world’s leading corporations in industries including … of innovation, collaboration, excellence, integrity and respect. We are headquartered in New York and have more than 59,000 employees spanning six continents. For more information, visit Role Title: Data Solutions Architect (GCP) Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent Summary of the role: The Data Solutions Architect at EXL plays a strategic, client-facing More ❯

Join to apply for the Data Solutions Architect -GCP role at EXL 2 days ago Be among the first 25 applicants Join to apply for the Data Solutions Architect -GCP role at EXL Get AI-powered advice on this job and more exclusive features. Senior Talent Acquisition Manager | Hiring for Data, AI, Tech & Digital Transformation | Leadership Hiring … UK & Ireland | Driving Inclusive &... EXL (NASDAQ: EXLS) is a global data and artificial intelligence (AI) company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the world’s leading corporations in industries including … innovation, collaboration, excellence, integrity and respect. We are headquartered in New York and have more than 59,000 employees spanning six continents. For more information, visit www.exlservice.com. Role Title: Data Solutions Architect (GCP) Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent Summary of the role: The Data Solutions Architect at EXL plays a strategic, client-facing More ❯

will serve as a subject matter expert providing technical leadership guidance and best practices across the team. You will play a critical role in designing developing and implementing complex data solutions on cloud platforms (primarily AWS) ensuring they meet the highest standards of quality scalability and performance. Serve as a subject matter expert in cloud data engineering providing … technical guidance and mentorship to the team. Drive the design development and implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda AWS S3 AWS Redshift AWS EMR). Develop and maintain data quality checks data validation rules and data lineage documentation. Collaborate with data analysts … data scientists business stakeholders and product owners to understand their data needs and translate them into innovative and effective technical solutions. Troubleshoot and resolve complex data quality issues performance bottlenecks and production incidents. Participate in the evaluation selection and implementation of new data technologies and tools. Adhere to and champion best practices in data engineering More ❯

will serve as a subject matter expert providing technical leadership guidance and best practices across the team. You will play a critical role in designing developing and implementing complex data solutions on cloud platforms (primarily AWS) ensuring they meet the highest standards of quality scalability and performance. Serve as a subject matter expert in cloud data engineering providing … technical guidance and mentorship to the team. Drive the design development and implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda AWS S3 AWS Redshift AWS EMR). Develop and maintain data quality checks data validation rules and data lineage documentation. Collaborate with data analysts … data scientists business stakeholders and product owners to understand their data needs and translate them into innovative and effective technical solutions. Troubleshoot and resolve complex data quality issues performance bottlenecks and production incidents. Participate in the evaluation selection and implementation of new data technologies and tools. Adhere to and champion best practices in data engineering More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations, FinTech and market data, with expertise around strategic cost … maintain our professional, supportive and entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not only lead the design and … implementation of the data infrastructure that powers advanced analytics and data science across our platforms, but also contribute to the strategic direction, roadmap, and execution of data products in collaboration with senior stakeholders. Architect & Build Scalable Data Solutions Collaborate closely with senior product stakeholders to understand data needs and architect end-to-end ingestion More ❯

health by developing the most advanced biosensing technology science has to offer, capable of accessing bodily information in a painless, real-time and affordable way. Description Join Sava's Data Engineering team at a pivotal stage of growth, contributing to the development and scaling of both, internal and customer-facing data infrastructures. As a Data Engineer II … you will help implement reliable data pipelines, storage solutions, and reporting systems that power analytical and operational workflows across the company. This is a unique opportunity to work in a multidisciplinary environment, collaborating with a top-tier team in engineering, science, and product to shape the foundation of Sava's data architecture. Responsibilities Build and maintain scalable, reliable … data pipelines, ensuring efficient and accurate data ingestion, transformation, and delivery. Design, implement, and optimize data storage solutions using modern databases and cloud-native tools. Develop and maintain reporting systems and dashboards to support data-driven decision-making. Collaborate with backend and infrastructure teams to integrate data services with applications and customer-facing tools. More ❯

Data Engineer - STR - London, UK Job Description OVERVIEW CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index and the NASDAQ 100, CoStar Group is on a mission to digitize the world's real estate, empowering all people to discover properties, insights … our employees, and investors. By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate. STR is the global leader in hospitality data benchmarking, analytics, and marketplace insights for the global hospitality industry. STR delivers data that is confidential, accurate, and actionable to empower our clients to strategize and compete in … their markets. Learn more about STR . ROLE DESCRIPTION The role of Data Engineer will be a key role within the STR Data Operations Team, reporting to the Director, Technical Data Operations. The Data Operations team is responsible for data acquisition, data loading, data quality, data processing, data delivery, and data More ❯

technology enables customers to easily personalise their creations to keep for themselves or share as the most thoughtful of gifts. About The Role: We are looking for a Senior Data Platform Engineerto join our London-based data team and help us build a platform that accelerates a decentralised-by-design data adoption model within the business. We … care about trustable, usable data and we want you to bring your technical expertise to make that happen. You're a software engineer at heart, you thrive in the data domain and care deeply about customer outcome-focused engineering excellence. Day to day, you will build observable, scalable and resilient data services that ingest data from … source systems into consuming applications such as our data warehouse to meet the needs of analytics engineers and stakeholders. You will make significant contributions to solution designs, provide technical guidance to other team members and champion iterative approaches to software delivery. You will work within a cross-functional mission-led team, led by a product manager, an engineering manager More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯

high-ambiguity environment. Build, train, and deploy state-of-the-art models (e.g., deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. Collaborate closely with product, design, and DevOps to integrate AI features into our platform. Continuously evaluate new research, open-source tools … high-ambiguity environment. Build, train, and deploy state-of-the-art models (e.g., deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. Collaborate closely with product, design, and DevOps to integrate AI features into our platform. Continuously evaluate new research, open-source tools … mentor, and grow an AI/ML team as we scale beyond our seed round. ⸻ Key Responsibilities Architecture & Hands-On Development Define and implement end-to-end AI pipelines: data collection/cleaning, feature engineering, model training, validation, and inference. Rapidly prototype novel models (e.g., neural networks, probabilistic models) using PyTorch, TensorFlow, JAX, or equivalent. Productionize models in cloud More ❯

high-ambiguity environment. Build, train, and deploy state-of-the-art models (e.g., deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. Collaborate closely with product, design, and DevOps to integrate AI features into our platform. Continuously evaluate new research, open-source tools … high-ambiguity environment. Build, train, and deploy state-of-the-art models (e.g., deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. Collaborate closely with product, design, and DevOps to integrate AI features into our platform. Continuously evaluate new research, open-source tools … mentor, and grow an AI/ML team as we scale beyond our seed round. ⸻ Key Responsibilities Architecture & Hands-On Development Define and implement end-to-end AI pipelines: data collection/cleaning, feature engineering, model training, validation, and inference. Rapidly prototype novel models (e.g., neural networks, probabilistic models) using PyTorch, TensorFlow, JAX, or equivalent. Productionize models in cloud More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization of diverse … business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯

on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from La Fosse As the Lead Enterprise Architect for Data & AI, you will be responsible for defining and driving an enterprise-wide data and information architecture strategy. Your role will ensure data platforms, governance frameworks, and information … are fully aligned with the needs of business domains such as Commercial, Finance, Supply Chain, Product, and Regulatory. You will lead the design of a scalable, trusted, and connected data architecture that enables AI/ML, advanced analytics, digital transformation, and regulatory compliance. This is a critical leadership role in advancing the organization’s data-driven enterprise vision. … grow its organizational influence. Continuously evolve the enterprise architecture practice and service portfolio. Mentor architects, product managers, and business leaders to embed architectural thinking. Principal Accountabilities: Define the enterprise data architecture vision, target state, and guiding principles, aligned with business priorities and regulatory frameworks. Lead architecture for enterprise data platforms such as Azure Synapse, Databricks, Power BI, and More ❯

on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from La Fosse As the Lead Enterprise Architect for Data & AI, you will be responsible for defining and driving an enterprise-wide data and information architecture strategy. Your role will ensure data platforms, governance frameworks, and information … are fully aligned with the needs of business domains such as Commercial, Finance, Supply Chain, Product, and Regulatory. You will lead the design of a scalable, trusted, and connected data architecture that enables AI/ML, advanced analytics, digital transformation, and regulatory compliance. This is a critical leadership role in advancing the organization’s data-driven enterprise vision. … grow its organizational influence. Continuously evolve the enterprise architecture practice and service portfolio. Mentor architects, product managers, and business leaders to embed architectural thinking. Principal Accountabilities: Define the enterprise data architecture vision, target state, and guiding principles, aligned with business priorities and regulatory frameworks. Lead architecture for enterprise data platforms such as Azure Synapse, Databricks, Power BI, and More ❯

280+ Employees - We have over 280 passionate employees transforming the industry across the Group, one home at a time The Role We're seeking a motivated and detail orientated Data Engineer with experience in building and managing scalable data pipelines and infrastructure. You'll be responsible for developing robust ETL/ELT processes, optimising and maintaining data warehouse, and ensuring data quality and standards through comprehensive monitoring and governance. Collaborating closely with our Data, Tech and Product teams, you'll help shape and support our data strategy. The ideal candidate should have familiarity in SQL and cloud-based data solutions, be driven towards automated solutions and thrives in transforming complex data infrastructure into streamlined, reliable, and actionable assets. Responsibilities: Own Data Infrastructure : Design, develop, and maintain scalable data pipelines and infrastructure to enable reliable analytics and data-driven decisions. ETL/ELT Development : Build, optimise, and manage ETL processes in BigQuery and associated tools to ensure timely and accurate data ingestion. Data Warehousing : Maintain and More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization of diverse … business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization of diverse … business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI software development including database/reporting development, full development cycle … Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI/MI solutions in line with agreed architectural principles and toolsets. Capable of working closely with the business and delivering … complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practises, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional/Tabular), Power BI Python, MDX, DAX Responsibilities The Data Manager will be responsible for supporting Head of Data and Analytics and wider More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI software development including database/reporting development, full development cycle … Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI/MI solutions in line with agreed architectural principles and toolsets. Capable of working closely with the business and delivering … complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practises, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional/Tabular), Power BI Python, MDX, DAX Responsibilities The Data Manager will be responsible for supporting Head of Data and Analytics and wider More ❯

Join to apply for the Data Architect role at Walkers 1 day ago Be among the first 25 applicants Join to apply for the Data Architect role at Walkers We are a leading international law and professional services firm providing legal, corporate and fiduciary services to global corporations, financial institutions, capital market participants and investment fund managers. With … own thinking in tune with the world in which we operate. Overview Of Role Office: London (hybrid - 2 days per week required as a min in the office) The Data Architect will be responsible for owning and executing Walkers' Enterprise Data Strategy. This will include leading and influencing the alignment of data strategy, and data architecture … across multiple service lines, and programmes of work. The Data Architect will be responsible for translating Walkers' data strategy into clear, actionable roadmaps of data-orientated solutions. The role holder will be responsible for setting and enforcing the standards, patterns and principles involving enterprise data, and ensuring that that any area within the firm working for More ❯