1 to 25 of 278 Data Ingestion Jobs in London

Full-time | Hybrid | London | Up to £95,000 + Bonus & Excellent Benefits | Key Responsibilities: Design, develop, and implement advanced data pipelines and ETL/ELT workflows using cloud-native services such as AWS Glue, Lambda, S3, Redshift, and EMR. Act as a technical authority in cloud data engineering by mentoring colleagues and promoting best practices. Collaborate cross-functionally … with analysts, data scientists, and business stakeholders to translate data requirements into robust technical solutions. Establish and enforce standards around data quality, validation, lineage, security, and governance. Troubleshoot and resolve complex production issues and performance bottlenecks in data systems. Develop and maintain CI/CD pipelines for data workflows leveraging tools like Jenkins. Automate data ingestion, transformation, and loading processes to enhance operational efficiency. Work closely with DevOps and Engineering teams to ensure seamless deployment and maintenance of data infrastructure. Stay updated on emerging cloud computing and data engineering technologies to continuously improve team capabilities. Lead small-scale projects or initiatives within the data engineering domain as needed. Background & Experience More ❯

Job Description Department: Information Technology Job Summary We are seeking a highly skilled and motivated Data Scientist with a strong focus on machine learning (ML) and artificial intelligence (AI) to join our innovative team. The ideal candidate will excel in developing, deploying, and optimizing ML models and AI solutions, leveraging cutting-edge technologies like Azure Machine Learning, AutoML, and … tools to manage model lifecycles. Leverage cloud platforms like Azure, AWS, and GCP for scalable ML model deployment. Employ frameworks like TensorFlow, PyTorch, and scikit-learn for model development. Data Engineering and Preparation Oversee data ingestion, cleaning, transformation, and feature engineering processes to ensure high-quality datasets. Work with large datasets and implement scalable data pipelines. … processes and maintain a centralized repository. Establish and follow best practices in model versioning, reproducibility, and model governance. Qualifications Education Advanced degree (Master’s or Ph.D.) in Computer Science, Data Science, Statistics, or a related field. Equivalent experience will be considered. Experience Minimum of 5 years in a data science or machine learning-focused role. Technical Skills Expertise More ❯

Nadara Greater London, England, United Kingdom R0001200 Data Architect (Open) We’re Nadara. We work harmoniously with the power of nature and the communities around us to power lifetimes to come. We call our approach ‘living energy’. We don’t just produce renewable energy, we live it – recognising our relationship with the people touched by our business and … connecting different perspectives with respect. Discover more about our culture and approach here: https://nadara.com/living-the-company/Job Description Summary Nadara is hiring a Data Architect with expertise in cloud data platforms to design, evolve, and optimize our enterprise data platforms. This role will be responsible for developing company’s cloud-based … data platform environment and ensure its operations are optimized to performance and scalability standards. The Data Architect will also provide technical leadership in data, analytics, and AI, collaborating with the Data, Analytics, and AI team, business stakeholders, and third-party partners to operate, manage, and develop Nadara’s cloud computing and data platform across all More ❯

Join to apply for the Data Solutions Architect -GCP role at EXL 2 days ago Be among the first 25 applicants Join to apply for the Data Solutions Architect -GCP role at EXL Get AI-powered advice on this job and more exclusive features. Senior Talent Acquisition Manager | Hiring for Data, AI, Tech & Digital Transformation | Leadership Hiring … UK & Ireland | Driving Inclusive &... EXL (NASDAQ: EXLS) is a global data and artificial intelligence ("AI") company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the world’s leading corporations in industries including … innovation, collaboration, excellence, integrity and respect. We are headquartered in New York and have more than 59,000 employees spanning six continents. For more information, visit www.exlservice.com. Role Title: Data Solutions Architect (GCP) Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent Summary of the role: The Data Solutions Architect at EXL plays a strategic, client-facing More ❯

As a Senior Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Airflow, etc.) and automation. The Senior Data Engineer will work closely with the data, Architecture, Business Analyst, Data Stewards to integrate and … align requirements, specifications and constraints of each element of the requirement. They will also need to help identify gaps in resources, technology, or capabilities required, and work with the data engineering team to identify and implement solutions where appropriate. Work type: Contract Length: initial 6 months Work structure: hybrid 2 days a week in London. Primary Responsibilities: Integrate data from multiple on prem and cloud sources and systems. Handle data ingestion, transformation, and consolidation to create a unified and reliable data foundation for analysis and reporting. Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and More ❯

As a Senior Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Airflow, etc.) and automation. The Senior Data Engineer will work closely with the data, Architecture, Business Analyst, Data Stewards to integrate and … align requirements, specifications and constraints of each element of the requirement. They will also need to help identify gaps in resources, technology, or capabilities required, and work with the data engineering team to identify and implement solutions where appropriate. Work type: Contract Length: initial 6 months Work structure: hybrid 2 days a week in London. Primary Responsibilities: Integrate data from multiple on prem and cloud sources and systems. Handle data ingestion, transformation, and consolidation to create a unified and reliable data foundation for analysis and reporting. Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations, FinTech and market data, with expertise around strategic cost … maintain our professional, supportive and entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not only lead the design and … implementation of the data infrastructure that powers advanced analytics and data science across our platforms, but also contribute to the strategic direction, roadmap, and execution of data products in collaboration with senior stakeholders. Architect & Build Scalable Data Solutions Collaborate closely with senior product stakeholders to understand data needs and architect end-to-end ingestion More ❯

will serve as a subject matter expert providing technical leadership guidance and best practices across the team. You will play a critical role in designing developing and implementing complex data solutions on cloud platforms (primarily AWS) ensuring they meet the highest standards of quality scalability and performance. Serve as a subject matter expert in cloud data engineering providing … technical guidance and mentorship to the team. Drive the design development and implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda AWS S3 AWS Redshift AWS EMR). Develop and maintain data quality checks data validation rules and data lineage documentation. Collaborate with data analysts … data scientists business stakeholders and product owners to understand their data needs and translate them into innovative and effective technical solutions. Troubleshoot and resolve complex data quality issues performance bottlenecks and production incidents. Participate in the evaluation selection and implementation of new data technologies and tools. Adhere to and champion best practices in data engineering More ❯

will serve as a subject matter expert providing technical leadership guidance and best practices across the team. You will play a critical role in designing developing and implementing complex data solutions on cloud platforms (primarily AWS) ensuring they meet the highest standards of quality scalability and performance. Serve as a subject matter expert in cloud data engineering providing … technical guidance and mentorship to the team. Drive the design development and implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda AWS S3 AWS Redshift AWS EMR). Develop and maintain data quality checks data validation rules and data lineage documentation. Collaborate with data analysts … data scientists business stakeholders and product owners to understand their data needs and translate them into innovative and effective technical solutions. Troubleshoot and resolve complex data quality issues performance bottlenecks and production incidents. Participate in the evaluation selection and implementation of new data technologies and tools. Adhere to and champion best practices in data engineering More ❯

will serve as a subject matter expert providing technical leadership guidance and best practices across the team. You will play a critical role in designing developing and implementing complex data solutions on cloud platforms (primarily AWS) ensuring they meet the highest standards of quality scalability and performance. Serve as a subject matter expert in cloud data engineering providing … technical guidance and mentorship to the team. Drive the design development and implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda AWS S3 AWS Redshift AWS EMR). Develop and maintain data quality checks data validation rules and data lineage documentation. Collaborate with data analysts … data scientists business stakeholders and product owners to understand their data needs and translate them into innovative and effective technical solutions. Troubleshoot and resolve complex data quality issues performance bottlenecks and production incidents. Participate in the evaluation selection and implementation of new data technologies and tools. Adhere to and champion best practices in data engineering More ❯

Data Engineer - STR - London, UK Job Description OVERVIEW CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index and the NASDAQ 100, CoStar Group is on a mission to digitize the world's real estate, empowering all people to discover properties, insights … our employees, and investors. By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate. STR is the global leader in hospitality data benchmarking, analytics, and marketplace insights for the global hospitality industry. STR delivers data that is confidential, accurate, and actionable to empower our clients to strategize and compete in … their markets. Learn more about STR . ROLE DESCRIPTION The role of Data Engineer will be a key role within the STR Data Operations Team, reporting to the Director, Technical Data Operations. The Data Operations team is responsible for data acquisition, data loading, data quality, data processing, data delivery, and data More ❯

Snr Data Analyst, Power BI | Cross-Asset Trading – Clearing & Market Making | London, Hybrid | £110k + Bonus, Benefits A leading global financial services firm is seeking a talented Data Analyst to join their enterprise Data team, working closely with the Clearing or Market Making business stream. This role offers the chance to be at the forefront of a … data-driven transformation within a dynamic and rapidly growing organisation. The business provides market access, trading, and infrastructure services across major global markets, with a strong presence in commodities, energy, and financial products. The technology function is central to its operations, delivering innovative data solutions and infrastructure across global teams. This opportunity offers great career progression development working … in a high-growth, fast-paced environment with global reach. You will be part of a be part of a forward-thinking technology and data team to work in a collaborative culture that values innovation. 💸The salary on offer for this Data Analyst Role, is up to £110,000 + Bonus and Benefits package. 📍The company works a More ❯

Snr Data Analyst, Power BI | Cross-Asset Trading – Clearing & Market Making | London, Hybrid | £110k + Bonus, Benefits A leading global financial services firm is seeking a talented Data Analyst to join their enterprise Data team, working closely with the Clearing or Market Making business stream. This role offers the chance to be at the forefront of a … data-driven transformation within a dynamic and rapidly growing organisation. The business provides market access, trading, and infrastructure services across major global markets, with a strong presence in commodities, energy, and financial products. The technology function is central to its operations, delivering innovative data solutions and infrastructure across global teams. This opportunity offers great career progression development working … in a high-growth, fast-paced environment with global reach. You will be part of a be part of a forward-thinking technology and data team to work in a collaborative culture that values innovation. 💸The salary on offer for this Data Analyst Role, is up to £110,000 + Bonus and Benefits package. 📍The company works a More ❯

If you want to make a life-changing impact on Customers, there's nowhere better to develop your career. Main Purpose of Role The role is crucial in transforming data by bridging data warehousing and business analysis into robust data solutions for analytical consumption for key stakeholders. The role will be responsible for working to build out … and improve the company's data ingestion, transformation, transactional and data warehousing needs directly supporting the data science and analyst teams. This role is essential to building and scaling new and existing local data streams to support PML's growing data products and services. In addition to this, the role will review and redesign … product to address resource heavy processes. Partnering with the Manager Data Capability and Head of Data and Analytics, the role will be working on varying, complex projects that leverages expertise in Power BI, to help the organisation harness the power of cloud technologies available to PMI such as Amazon Web Services (AWS), Matillion and Snowflake. The role will More ❯

Job Description Job Title: QA Tester – ETL Testing (Informatica) & Azure Data Engineering Location: Westminster, London Type: Full-time Department: Quality Assurance/Data Engineering Reporting to: Data Engineering Lead Job Summary: We are looking for a skilled and detail-oriented QA Tester with hands-on experience in ETL testing (Informatica or Microsoft Fabric) and a strong understanding … of Azure Data Engineering tools such as Azure SQL Database , Azure Blob Storage , and Azure Data Factory . The ideal candidate will possess good hands-on knowledge of writing and executing SQL queries to validate data across systems. Experience in Microsoft Fabric is considered a strong bonus. Key Responsibilities: Perform ETL/data pipeline testing using … Informatica PowerCenter or IICS . Validate data ingestion , transformation , and loading processes across Azure services. Execute source-to-target data validation , data profiling, and data reconciliation. Write and execute complex SQL queries to validate data transformations, aggregations, and business rules in Azure SQL Database and other relational platforms. Test data flows and integrations More ❯

Join to apply for the Azure Data Engineer - SC Cleared role at ShareForce . This is an exciting contract opportunity for an SC Cleared Azure Data Engineer to join an experienced team in a new customer engagement working at the forefront of data analytics and Artificial Intelligence. Our client equips ambitious organisations with enduring control of their … data and AI evolution. This role is an opportunity to lead the build of bespoke data systems for our clients. Responsibilities Design and implement scalable data pipelines and ETL processes using Azure and Databricks technologies including Delta Live Tables. Lead technical discussions with clients and stakeholders to gather requirements and propose solutions. Help clients realise the potential … of data science, machine learning, and scaled data processing within Azure/Databricks ecosystem. Mentor junior team members and support their personal development. Take ownership for the delivery of core solution components. Support with planning, requirements refinement and work estimation. Skills and Experiences Design and develop end-to-end data solutions leveraging Azure services for batch, real More ❯

Job Description I'm looking for a hands-on, highly skilled Data Solutions Architect to join a global Data & AI Consultancy in London. You will split your time between the London office, your home and client site, depending on requirements. This exciting role is perfect for an experienced Data Engineer who's progressed to an architectural level … and is ready to lead the design and delivery of innovative data solutions for a diverse range of clients. In this role, you'll be responsible for guiding technical teams in the development of end-to-end data solutions that address complex business challenges, using both on-premises and cloud-based technologies (Azure, AWS, or GCP). You … ll design scalable data architectures, including data lakes, lakehouses, and warehouses, leveraging tools such as Databricks, Snowflake, and Azure Synapse. The ideal candidate will have a deep technical background in data engineering and a passion for leading the development of best-in-class data solutions. You'll enjoy providing strategic advice to clients, ensuring solutions are More ❯

Continue with Google Continue with Google Continue with Google Continue with Google Direct message the job poster from Mastek Location: Westminster, London Type: Full-time Department: Quality Assurance/Data Engineering Reporting to: Data Engineering Lead Job Summary: We are looking for a skilled and detail-oriented QA Tester with hands-on experience in ETL testing (Informatica or … Microsoft Fabric) and a strong understanding of Azure Data Engineering tools such as Azure SQL Database , Azure Blob Storage , and Azure Data Factory . The ideal candidate will possess good hands-on knowledge of writing and executing SQL queries to validate data across systems. Experience in Microsoft Fabric is considered a strong bonus. Key Responsibilities: Perform ETL …/data pipeline testing using Informatica PowerCenter or IICS . Validate data ingestion , transformation , and loading processes across Azure services. Execute source-to-target data validation , data profiling, and data reconciliation. Write and execute complex SQL queries to validate data transformations, aggregations, and business rules in Azure SQL Database and other relational platforms. More ❯

on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from La Fosse As the Lead Enterprise Architect for Data & AI, you will be responsible for defining and driving an enterprise-wide data and information architecture strategy. Your role will ensure data platforms, governance frameworks, and information … are fully aligned with the needs of business domains such as Commercial, Finance, Supply Chain, Product, and Regulatory. You will lead the design of a scalable, trusted, and connected data architecture that enables AI/ML, advanced analytics, digital transformation, and regulatory compliance. This is a critical leadership role in advancing the organization’s data-driven enterprise vision. … grow its organizational influence. Continuously evolve the enterprise architecture practice and service portfolio. Mentor architects, product managers, and business leaders to embed architectural thinking. Principal Accountabilities: Define the enterprise data architecture vision, target state, and guiding principles, aligned with business priorities and regulatory frameworks. Lead architecture for enterprise data platforms such as Azure Synapse, Databricks, Power BI, and More ❯

technology enables customers to easily personalise their creations to keep for themselves or share as the most thoughtful of gifts. About The Role: We are looking for a Senior Data Platform Engineerto join our London-based data team and help us build a platform that accelerates a decentralised-by-design data adoption model within the business. We … care about trustable, usable data and we want you to bring your technical expertise to make that happen. You're a software engineer at heart, you thrive in the data domain and care deeply about customer outcome-focused engineering excellence. Day to day, you will build observable, scalable and resilient data services that ingest data from … source systems into consuming applications such as our data warehouse to meet the needs of analytics engineers and stakeholders. You will make significant contributions to solution designs, provide technical guidance to other team members and champion iterative approaches to software delivery. You will work within a cross-functional mission-led team, led by a product manager, an engineering manager More ❯

London – Senior Data Engineer, Consultant Ekimetrics UK Job Description About Ekimetrics Ekimetrics is a leader in data science and AI-powered solutions. Since 2006, we’ve pioneered the use of AI and data science applied to unified marketing performance, measurement and holistic business optimization aligned with sustainability goals. Our goal: Combine high-impact AI and data science solutions for sustainable business performance. At Ekimetrics, we help companies seize their data opportunities by creating new data and analytics capabilities and deploying data science solutions that power-up their revenue strategy and improve their business operations. Key figures about Ekimetrics 400+ data science experts globally 1000+ diverse projects for more than 350+ clients … offices: Paris, Hong Kong, London, and New York UK data company of the year 2023 Voted Great Place to Work 2023 Microsoft’s sustainability partner Voted as a leader in “Marketing Measurement and Optimization” by Forrester wave 2023 About the Role We have an exciting opportunity for a Senior backend engineer to join our London team! You will be More ❯

My client is based in the London area and is currently looking to recruit an experienced Fabric Data Engineer to join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by … implement and utilise the most in-demand and cutting-edge technology on the market right now. Your role will include: Collaborate closely with stakeholders to understand and interpret their data and analytics needs. Design and deploy end-to-end data solutions using Microsoft Fabric, encompassing data ingestion, transformation, and visualisation workflows. Construct and refine data models, pipelines, and ETL frameworks within the Fabric ecosystem. Leverage Fabric's suite of tools to build dynamic reports, dashboards, and analytical applications. Maintain high standards of data integrity, consistency, and system performance across the data environment. Advise on data governance, security protocols, and compliance strategies aligned with industry best practices. Diagnose and resolve technical challenges More ❯

Direct message the job poster from Selby Jennings Consultant | Data & Analytics | Selby Jennings Our client is redefining electronic trading by developing high-performance, AI-powered solutions that enable smarter, faster decision-making in dynamic markets. Our client is looking for a Senior Data Engineer to be a part of a forward-thinking team in London, working at the … intersection of AI and trading technology. You'll collaborate with leading researchers, data scientists, and engineers to build scalable data infrastructure that supports advanced analytics and machine learning. This is a greenfield opportunity with full ownership from design to deployment, allowing you to shape systems that directly impact trading and AI capabilities. In this role, you'll architect … and maintain robust data pipelines for ingesting, transforming, and storing large volumes of structured and unstructured data, including time-series datasets. You'll automate ETL processes, implement validation frameworks, and ensure high data quality and system reliability. You'll also support AI model development by optimising data retrieval, integrating scalable APIs, and working with vector databases More ❯

As the Lead Enterprise Architect for Data & AI, you will be responsible for defining and driving an enterprise-wide data and information architecture strategy. Your role will ensure data platforms, governance frameworks, and information assets are fully aligned with the needs of business domains such as Commercial, Finance, Supply Chain, Product, and Regulatory. You will lead the … design of a scalable, trusted, and connected data architecture that enables AI/ML, advanced analytics, digital transformation, and regulatory compliance. This is a critical leadership role in advancing the organization’s data-driven enterprise vision. Core Responsibilities of the Enterprise Architect Role: Bridge alignment between business and IT across a federated technology environment. Build strong stakeholder relationships … grow its organizational influence. Continuously evolve the enterprise architecture practice and service portfolio. Mentor architects, product managers, and business leaders to embed architectural thinking. Principal Accountabilities: Define the enterprise data architecture vision, target state, and guiding principles, aligned with business priorities and regulatory frameworks. Lead architecture for enterprise data platforms such as Azure Synapse, Databricks, Power BI, and More ❯

As the Lead Enterprise Architect for Data & AI, you will be responsible for defining and driving an enterprise-wide data and information architecture strategy. Your role will ensure data platforms, governance frameworks, and information assets are fully aligned with the needs of business domains such as Commercial, Finance, Supply Chain, Product, and Regulatory. You will lead the … design of a scalable, trusted, and connected data architecture that enables AI/ML, advanced analytics, digital transformation, and regulatory compliance. This is a critical leadership role in advancing the organization’s data-driven enterprise vision. Core Responsibilities of the Enterprise Architect Role: Bridge alignment between business and IT across a federated technology environment. Build strong stakeholder relationships … grow its organizational influence. Continuously evolve the enterprise architecture practice and service portfolio. Mentor architects, product managers, and business leaders to embed architectural thinking. Principal Accountabilities: Define the enterprise data architecture vision, target state, and guiding principles, aligned with business priorities and regulatory frameworks. Lead architecture for enterprise data platforms such as Azure Synapse, Databricks, Power BI, and More ❯