1 to 25 of 750 Remote Data Pipeline Jobs in London

Senior Data Engineer - (Azure/Databricks) page is loaded Senior Data Engineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 15 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our … civil union status, family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. Senior Data Engineer (Azure/Databricks Job Family Grouping: Chief Underwriting Officer Job Family: Data & Analytics Location: London How does this role contribute to our collective success? The Data … services. Implement end-to-end data pipelines, ensuring data quality, data integrity and data security. Troubleshoot and resolve data pipeline issues while ensuring data integrity and quality. Implement and enforce data security best practices, including role-based access control (RBAC), encryption, and compliance with industry More ❯

Data Platform, managing the platform, and driving its further development. This role requires proficiency in data engineering, data modelling, and data pipeline orchestration, with a proven track record of working with Azure-specific data platform tools and technologies. Strategic and forward-thinking capabilities, as well as experience in applying … and mentorship to the Data & Analytics team. Oversee the team’s Agile processes including sprints, ask prioritisation and issue resolution Define best practices for data pipeline design, development, and maintenance. Coordinate with the solution architect to ensure platform architecture meets current and future requirements. Act as a point of escalation for complex data … clean, usable datasets for reporting and analytics. Platform Administration and Optimization: Monitor and optimize Azure Synapse Analytics performance, ensuring cost efficiency and resource utilization. Implement monitoring and alerting for pipeline performance, failures, and resource consumption. Suggest and implement automation for repetitive tasks using tools like Azure Logic Apps, Power Automate, or custom scripting. Collaborate with the Data More ❯

Join to apply for the Senior Data Engineer (Databricks) role at DATAPAO Get AI-powered advice on this job and more exclusive features. This range is provided by DATAPAO. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from DATAPAO At … DATAPAO, data ignites passion, community fuels collaboration, and growth knows no bounds. We are a leading Data Engineering and Data Science consulting company, recognized for our innovation and rapid growth. We have been named Databricks EMEA Emerging Business Partner of the Year and have achieved a second consecutive appearance on the Financial Times FT1000 … Data Engineering , focusing on cloud platforms (AWS, Azure, GCP); Proven experience with Databricks (PySpark, SQL, Delta Lake, Unity Catalog); Extensive ETL/ELT and data pipeline orchestration experience (e.g., Databricks Workflows, DLT, Airflow, ADF, Glue, Step Functions); Proficiency in SQL and Python for data transformation and optimization; Knowledge of CI/CD pipelines More ❯

picking and replenishment to sorting and pack-out-Locus Robotics empowers businesses to meet peak demands and adapt to ever-changing operational needs. Are you a skilled Python Data Engineer with a passion for building scalable, production-level systems and an interest in machine learning? We want to hear from you! At Locus Robotics, we're evolving our … data infrastructure to support advanced machine learning capabilities and real-time analytics. As a key member of our team, you'll help migrate our existing codebase into machine learning territory, drive innovation across multiple deployment sites, and collaborate closely with our optimization and engineering teams. You'll develop robust Python code, analyze system performance, and contribute to deployment … to work in one of these countries without the need for work sponsorship. Responsibilities: Develop and maintain Python-based systems deployed across remote platforms. Contribute to and improve data pipelines, ensuring reliable and efficient system updates. Build and enhance features for real-time data analysis and system monitoring to ensure high uptime and efficiency. Collaborate with More ❯

to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be … or solving tough engineering challenges. You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We're technology agnostic, and we're open minded when it More ❯

Join to apply for the Senior Data Engineer (Remote) role at Circana Join to apply for the Senior Data Engineer (Remote) role at Circana At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is … entirely on what current employees say about their experience working at Circana. Learn more at www.circana.com. What will you be doing? We are seeking a skilled and motivated Data Engineer to join a growing global team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines and infrastructure on the Azure … scalability. If you have a passion for data engineering and a desire to make a significant impact, we encourage you to apply! Job Responsibilities ETL/ELT Pipeline Development: Design, develop, and optimize efficient and scalable ETL/ELT pipelines using Python, PySpark, and Apache Airflow. Implement batch and real-time data processing solutions using More ❯

We are currently looking for a Senior Data Engineer to join us remotely in the UK. We plan to set up a hub in the UK in the following 12-18 months to enable our GTM strategy, and this would be our first hire in the region. You will work with our EMEA and US customers to help … them solve their data engineering, ML, ML Ops, and cloud migration puzzles. "As a Data Engineer at DATAPAO, you will have the unique opportunity to push the boundaries of technology and lead the way in how data transforms the world. We work with customers who want to innovate and change their industries. So it … GCP); You have a proven track record working with Databricks (PySpark, SQL, Delta Lake, Unity Catalog); You have extensive experience in ETL/ELT development and data pipeline orchestration (e.g., Databricks Workflows, DLT, Airflow, ADF, Glue, and Step Functions.); You’re proficient in SQL and Python , using them to transform and optimize data like a More ❯

Join to apply for the Principal Data Engineer (Databricks) role at DATAPAO Join to apply for the Principal Data Engineer (Databricks) role at DATAPAO Get AI-powered advice on this job and more exclusive features. This range is provided by DATAPAO. Your actual pay will be based on your skills and experience — talk with your recruiter … to learn more. Base pay range $70,000.00/yr - $100,000.00/yr Direct message the job poster from DATAPAO At DATAPAO, data ignites passion, community fuels collaboration, and growth knows no bounds. We are a leading Data Engineering and Data Science consulting company, recognized for our innovation and rapid growth. We have … GCP); You have a proven track record working with Databricks (PySpark, SQL, Delta Lake, Unity Catalog); You have extensive experience in ETL/ELT development and data pipeline orchestration (e.g., Databricks Workflows, DLT, Airflow, ADF, Glue, and Step Functions.); You’re proficient in SQL and Python , using them to transform and optimize data like a More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £50,000 - £77,500 - depending on experience Department: Technology and Data We’re First Central Insurance & Technology Group (First Central for short), an innovative, market-leading insurance company. We protect the things customers love so they can get on with what matters to them in life. Data drives us. It fuels our outstanding distribution, finance, technology and legal services. Our underwriting skills are built on data expertise; it creates the insights we need to give the right cover to the right customers at the right price. But, it’s the people inside and outside our business that power us. They make us stand … career in a fast-paced and dynamic workplace? If so, today might just be your lucky day! We’re on the hunt for 2 passionate and skilled Senior Data Engineers to become key players in our cutting-edge technology and data teams. In this hands-on technical role, you’ll be responsible for building technical data More ❯

to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be … or solving tough engineering challenges. You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We're technology agnostic, and we're open minded when it More ❯

This range is provided by Noir. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Data Engineer - Leading Energy Company - London (Tech Stack: Data Engineer, Databricks, Python, PySpark, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) Company Overview: Join a dynamic team, a leading player in … the energy sector, committed to innovation and sustainable solutions. Our client are seeking a talented Data Engineer to help build and optimise our data infrastructure, enabling them to harness the power of data-driven insights to drive our business forward. Responsibilities: Design and develop a cutting-edge data warehouse capable of efficiently … ingesting and organising large volumes of data from multiple sources. Champion best practices in data architecture governance, ensuring compliance with security and privacy regulations. Conduct rigorous data quality assessments, employing cleansing and validation techniques as needed. Construct robust data pipelines for cleaning, transforming, and aggregating diverse datasets. Collaborate closely with software development More ❯

Join to apply for the Data Solutions Architect -GCP role at EXL 2 days ago Be among the first 25 applicants Join to apply for the Data Solutions Architect -GCP role at EXL Get AI-powered advice on this job and more exclusive features. Senior Talent Acquisition Manager | Hiring for Data, AI, Tech & Digital … Transformation | Leadership Hiring | UK & Ireland | Driving Inclusive &... EXL (NASDAQ: EXLS) is a global data and artificial intelligence ("AI") company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the world’s … collaboration, excellence, integrity and respect. We are headquartered in New York and have more than 59,000 employees spanning six continents. For more information, visit www.exlservice.com. Role Title: Data Solutions Architect (GCP) Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent Summary of the role: The Data Solutions Architect at EXL plays a strategic, client More ❯

job and more exclusive features. We have been serving the Microsoft community for 15 years; helping end user clients and partners engage the best permanent and contract Microsoft... Data Engineer - Leading Fashion Company - London (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) We’re recruiting on behalf of a … leading fashion brand based in London that’s recognised for combining creativity with cutting-edge technology. They’re on the lookout for a talented Data Engineer to join their growing data team. This is a fantastic opportunity to work with a household name and play a key role in shaping data-driven decisions across … the business. The Role As a Data Engineer, you’ll be responsible for building and maintaining scalable, efficient, and reliable data pipelines. You’ll work across a modern tech stack with a strong focus on Google Cloud Platform (GCP) and collaborate with various teams to ensure data flows securely and accurately throughout the organisation. More ❯

provides its customers with clear advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers differentiation, scalability and security for the business. Reporting to the COO, Technology provides digital tools, software services and infrastructure globally to all … design. The IT Group runs our enterprise-wide services to end users and actively manages the firm's infrastructure and data. Within IT, Marex Technology has established a Data team that enables the firm to leverage data assets to increase productivity and improve business decisions, as well as maintain data compliance. The Data Team encompasses Database Administration, Data Engineering, Data Analysis, Data Architecture, Data Intelligence and AI expertise. In recent years, they have developed a Data Lakehouse architecture, that is relied upon by different departments across the firm. Marex now seeks to strengthen its capabilities further and elevate the role of More ❯

through the Medallion architecture in Databricks . Data Transformation : Create and manage data models and transformations using dbt , ensuring clear lineage, version control, and modularity. Pipeline Orchestration : Develop and manage workflow orchestration using Azure Data Factory , including setting up triggers, pipelines, and integration runtimes. System Maintenance : Monitor, maintain, and optimize existing data … including notebooks, cluster configuration, and Delta Lake. Proficiency in dbt for transformation logic and version-controlled data modeling. Deep knowledge of Azure Data Factory , including pipeline orchestration and integration with other Azure services. Experience with data integration (e.g. : APIs, JSON, XML, Web Services) essential Expertise in Python and SQL for data manipulation and pipeline development. Hands-on experience implementing and maintaining Medallion Architecture (Bronze/Silver/Gold). Familiarity with CI/CD, Git version control, and agile development methodologies. Strong understanding of data warehousing principles, data modeling, and performance optimization. Experience with cron jobs , job orchestration, and error monitoring tools. Good to More ❯

and expertise are designed to support operational needs for our clients and deliver a seamless experience to customers in the moments that matter. We are looking for a Data Engineer to join our team and support with designing, implementing, and maintaining the data systems that support our Gen AI-driven applications and data-driven … Strong programming skills in Python and SQL. Knowledge of big data technologies like Hadoop, Spark, and NoSQL databases. Deep experience with ETL processes and data pipeline development. Strong understanding of data warehousing concepts and best practices. Experience with cloud platforms such as AWS and Azure. Excellent problem-solving skills and attention to detail. … Spanish language skills are a bonus. Tools and Applications Programming languages and tools: Python, SQL. Big data technologies: Hadoop, Spark, NoSQL databases. ETL and data pipeline tools: AWS Glue, Airflow. Cloud platforms: AWS, Azure. Data visualization tools and data modeling software. Version control systems and collaborative development platforms. Our Offer Impactful More ❯

Leonardo Coldharbour, England, United Kingdom Join or sign in to find your next job Join to apply for the Senior Data Engineer role at Leonardo Leonardo Coldharbour, England, United Kingdom 1 day ago Be among the first 25 applicants Join to apply for the Senior Data Engineer role at Leonardo Get AI-powered advice on this … for both civil and defence markets, in both the UK and around the world, to enhance the capabilities of its Customers. Within the Cyber & Security Division is our Data Practice which is where this role is positioned. Job Description The Opportunity: The Leonardo Cyber & Security Division, one of the three divisions in Leonardo UK, is a pivotal innovator … cross-functional teams. Detail-oriented with a focus on ensuring data accuracy, quality, and security. Proactive problem-solving mindset and ability to troubleshoot complex data pipeline issues. Desirable Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing and ETL tools like Apache Kafka More ❯

Job Title: Senior Data Engineer Location: London Victoria, Hybrid Reports to: Engineering Manager A bit about us At nudge we believe people need to be in control of their finances. nudge puts you in control of your money. Combining behavioural psychology, data, and personalised education, our financial wellness benefit empowers people to develop their financial skills … PepsiCo, to support the financial wellbeing of their employees. About the team Our team is united by the shared purpose to create brighter financial futures for everyone, everywhere. Data is at the heart of our decision-making. You’ll work closely with product, data, infosecand engineering teams. Role purpose You will be instrumental in designing and … building scalable data infrastructure, pipelines, and tooling to support advanced analytics, real-time data applications, and regulatory compliance. This is an opportunity to make a meaningful impact on the lives of thousands of people across the globe. What will you be doing? Things move fast at nudge, and we are always learning. This means we need More ❯

Job Title: Senior Data Engineer Location: London Victoria, Hybrid Reports to: Engineering Manager A bit about us At nudge we believe people need to be in control of their finances. nudge puts you in control of your money. Combining behavioural psychology, data, and personalised education, our financial wellness benefit empowers people to develop their financial skills … PepsiCo, to support the financial wellbeing of their employees. About the team Our team is united by the shared purpose to create brighter financial futures for everyone, everywhere. Data is at the heart of our decision-making. You'll work closely with product, data, infosec and engineering teams. Role purpose You will be instrumental in designing … and building scalable data infrastructure, pipelines, and tooling to support advanced analytics, real-time data applications, and regulatory compliance. This is an opportunity to make a meaningful impact on the lives of thousands of people across the globe. What will you be doing? Things move fast at nudge, and we are always learning. This means we More ❯

providing a broad range of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Scientist to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a fantastic team of technology experts. … You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data engineers, analysts, and other stakeholders to ensure data quality and reliability. About you: Our team is our strongest asset, you will be an excellent team player … skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Requirements Key Responsibilities: Lead end-to-end data science projects, from ideation and data exploration to model development and deployment. Build and optimise machine learning models for prediction, classification, recommendation, or segmentation. Collaborate with data More ❯

Data Engineer - Leading Energy Company - London (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) Company Overview: Join a dynamic team, a leading player in the energy sector, committed to innovation and sustainable solutions. Our client is seeking a talented Data Engineer to help build and optimise our … data infrastructure, enabling them to harness the power of data-driven insights to drive our business forward. Responsibilities: Design and develop a cutting-edge data warehouse capable of efficiently ingesting and organising large volumes of data from multiple sources. Champion best practices in data architecture governance, ensuring compliance with security … and privacy regulations. Conduct rigorous data quality assessments, employing cleansing and validation techniques as needed. Construct robust data pipelines for cleaning, transforming, and aggregating diverse datasets. Collaborate closely with software development and product teams to align data strategies with business objectives. Stay abreast of emerging trends and technologies in data engineering and More ❯

Product Owner – Finance & Corporate Data 3 days ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. About The Role Motability Operations is seeking an experienced Product Owner to become an integral part of our Agile development team. In this role, you’ll drive the evolution and implementation of data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between business stakeholders, data scientists, analysts, engineers, and … governance teams, you'll manage the data product backlog and ensure continuous delivery of data capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. About You Strong experience More ❯

Analytics Engineer Location: London, Hybrid (minimum 2 days per week in office) Type: Full-Time, Permanent Reports to: Engineering Manager/Lead Data Engineer Salary: £55,000-£70,000 per annum Due to the nature of our work, candidates must be eligible for Security Clearance. Join Our Mission At QuantSpark, we're transforming how data and … street brands, and premium consumer goods companies optimise inventory, enhance price competitiveness, and deliver personalised customer experiences. Asset Management: We build AI-powered investment decision support systems, alternative data integration platforms, and automated risk management solutions for prestigious asset management firms. Public Sector: We're trusted by multiple UK government departments and public sector organisations to deliver predictive … monitoring, and documentation standards that ensure our solutions are production-ready and maintainable. Mentor Rising Talent: Guide junior analytics engineers and data scientists, sharing your expertise in pipeline design, SQL optimisation, and Python development. You'll help build the next generation of analytics engineering talent at QuantSpark. Shape Client Solutions: Work directly with clients to understand their More ❯

Senior Manager at Tenth Revolution Group - Helping organisations across the UK hire the best Cloud Talent. Azure Data Engineer - £70,000 - Home based with occasional client visits. Locations: London, Edinburgh, Manchester About Us: We are a leading data consultancy, dedicated to empowering businesses with cutting-edge data solutions. Our focus is on AI readiness … Responsibilities: Develop and implement data engineering solutions using tools like Azure Data Factory, Azure Synapse, and Fabric . Build and optimize ETL/ELT pipelines , data lakes, and data warehouses. Engage with stakeholders to translate business requirements into effective data strategies . Support data governance, architecture, and best … . A solid grasp of data governance, data modeling, and business intelligence best practices. Knowledge of Agile, DevOps, Git, APIs, microservices, and data pipeline development . Familiarity with Spark, Kafka, or Snowflake is a plus. Desirable Certifications: Microsoft Certified: Fabric Analytics Engineer Associate Why Join Us? Competitive salary up to £70,000 per More ❯

based at any one of our network of 20 offices nationally, but will require travel to client sites: www.kpmg88careers.co.uk/experienced-professional/#LeBlender.OfficeLocations The KPMG Technology + Data function is a cornerstone of our business. We do work that matters to our local business and communities – supporting technical innovation and adoption of cutting-edge solutions across the … United Kingdom. Working on complex engagements including working closely with clients to design, implement, and manage scalable data solutions, this team is responsible for the delivery of cutting-edge technical solutions and trusted to get it right first time. KPMG is one of the world's largest and most respected consultancy businesses, we've supported the UK through … Azure Data Factory, Synapse Analytics, Azure Data Lake Storage, and related tools. Microsoft Fabric – experience with dataflows, lakehouses, notebooks, and workspace management. Azure Synapse Analytics – pipeline and notebook creation, performance tuning, and data transformation logic. Power BI – data modelling, DAX, and visualisation development. Delta Lake – supporting structured streaming and batch data More ❯