151 to 175 of 856 Data Pipeline Jobs in London

bank based in the city of London. **Inside IR35 - 4 days a week on site** Overview BI Developer role supporting Front Office operations with expertise in Power BI, data engineering, and stakeholder management in investment banking environment. Key Responsibilities Design and maintain Power BI dashboards for trading, risk, and regulatory reporting Build data pipelines for real … time and batch processing of financial data Partner with traders, portfolio managers, and risk teams to deliver analytics solutions Ensure compliance with regulatory reporting requirements Optimize data models for front office metrics and P&L reporting Troubleshoot data quality issues in time-sensitive trading environments Required Skills BI development with strong Power BI (DAX … Power Query, data modeling) Data engineering experience building production pipelines Python, SQL, and Spark proficiency Experience with investment banking data (trades, positions, market data, reference data) Understanding of regulatory reporting processes Proven ability to work directly with demanding front office stakeholders Experience with real-time data feeds and More ❯

Graduate Development Programme Locations: London Starting Salary: £28,000 Application Requirements: Minimum 2:1 or above in a STEM (Science, Technology, Engineering, and Math) subject Experience in analysing data Right to work in the UK unsponsored for the duration of the programme Ability to work on site 5 days a week Grayce is not on the UK Border … delivering excellence. If you have a keen attention to detail and accuracy, a knack for spotting trends and patterns, and the ability to tell a compelling story using data, you'll thrive in our environment. We value resourcefulness, resilience, and a passion for driving change. Join us and be part of a community that cares, collaborates, and thrives … together. Understanding the types of roles available to a Graduate Digital Analyst: Data Analyst: Transform complex data into actionable insights, create dynamic visualisations, and drive business decisions. Work with cutting-edge tools, collaborate with stakeholders, and develop automated reports and dashboards while refining your technical expertise in a fast-paced environment. Data Engineer: Design More ❯

multiple positions, however please only apply for the role that best aligns with your skillset and career goals. What You Will Do Work closely with our simulation engineers, data scientists and customers to develop an understanding of the physics and engineering challenges we are solving Design, build and test data pipelines for machine learning that are … reliable, scalable and easily deployable Explore and manipulate 3D point cloud & mesh data Own the delivery of technical workstreams Create analytics environments and resources in the cloud or on premise, spanning data engineering and science Identify the best libraries, frameworks and tools for a given task, make product design decisions to set us up for success … Work at the intersection of data science and software engineering to translate the results of our R&D and projects into re-usable libraries, tooling and products Continuously apply and improve engineering best practices and standards and coach your colleagues in their adoption What You Bring To The Table Experience applying Machine learning methods (including 3D graph/ More ❯

by Gartner Peer Insights as the top platform for Procurement Analytics in September 2023, we are acclaimed for our value, feature depth, quick implementation, superior service, and advanced data analytics. Role Description This is a contract hybrid role for a Power BI Consultant, located in the London Area, United Kingdom, with some work-from-home flexibility. We are … seeking a highly capable and motivated Power BI Specialist to join our data and analytics function. This role is ideal for someone with a strong background in Power BI development, data transformation, and integration, preferably with exposure to regulated sectors such as defence, government, or public services. You must be willing and eligible to obtain Security … and maintain the existing suite of Power BI dashboards. Gather and analyse future reporting requirements from stakeholders. Design, develop, and deploy new Power BI dashboards and reports. Automate data pipelines to streamline data refresh and reporting processes. Create and maintain documentation including user guides and technical specifications. Plan and prioritise future reporting needs in collaboration with More ❯

highly skilled Generative AI Architect to lead the design and implementation of advanced AI solutions tailored for professional services. This role requires expertise in AI-driven decision automation , data-driven insights , and scalable architecture to enhance business processes and client outcomes. As a key member of our team, you will architect solutions that learn, reason, and make intelligent … AI algorithms for predictive analytics, recommendation engines, and automation in professional services. Apply machine learning (ML) and deep learning (DL) techniques to enhance decision-making and business intelligence. Data Engineering & Integration Architect robust data pipelines to support AI model training and inference. Implement automated data collection, integration, cleansing, and transformation techniques to ensure high … quality data inputs. Collaborate with data engineering teams to align AI solutions with real-world business applications. AI Model Training, Evaluation & Performance Optimization Train AI models using supervised, unsupervised, and reinforcement learning techniques , refining them based on business insights . Define model performance metrics to ensure AI solutions deliver tangible value. Real-Time AI Applications & System More ❯

highly skilled Generative AI Architect to lead the design and implementation of advanced AI solutions tailored for professional services. This role requires expertise in AI-driven decision automation , data-driven insights , and scalable architecture to enhance business processes and client outcomes. As a key member of our team, you will architect solutions that learn, reason, and make intelligent … AI algorithms for predictive analytics, recommendation engines, and automation in professional services. Apply machine learning (ML) and deep learning (DL) techniques to enhance decision-making and business intelligence. Data Engineering & Integration Architect robust data pipelines to support AI model training and inference. Implement automated data collection, integration, cleansing, and transformation techniques to ensure high … quality data inputs. Collaborate with data engineering teams to align AI solutions with real-world business applications. AI Model Training, Evaluation & Performance Optimization Train AI models using supervised, unsupervised, and reinforcement learning techniques , refining them based on business insights . Define model performance metrics to ensure AI solutions deliver tangible value. Real-Time AI Applications & System More ❯

by Gartner Peer Insights as the top platform for Procurement Analytics in September 2023, we are acclaimed for our value, feature depth, quick implementation, superior service, and advanced data analytics. Role Description This is a contract hybrid role for a Power BI Consultant, located in the London Area, United Kingdom, with some work-from-home flexibility. We are … seeking a highly capable and motivated Power BI Specialist to join our data and analytics function. This role is ideal for someone with a strong background in Power BI development, data transformation, and integration, preferably with exposure to regulated sectors such as defence, government, or public services. You must be willing and eligible to obtain Security … and maintain the existing suite of Power BI dashboards. Gather and analyse future reporting requirements from stakeholders. Design, develop, and deploy new Power BI dashboards and reports. Automate data pipelines to streamline data refresh and reporting processes. Create and maintain documentation including user guides and technical specifications. Plan and prioritise future reporting needs in collaboration with More ❯

data. We want actionable insights accessible to decision makers (both business stakeholders and members of HR) to help solve business problems. As part of the Bank's federated data analytics operating model, we're seeking an analytical Associate who is passionate about the intersection of people data, technology, and business impact. You'll be instrumental in … and Microsoft Fabric. Accountabilities & Responsibilities Accountabilities and responsibilities for this role are to be carried out with a strong degree of independence, with supervision by the Principal, People Data & Analytics: Design, build & deliver analytics products Partner with HR stakeholders to design, implement, and maintain data visualisations that drive effective decision-making and business outcomes. Provide specialised … intelligence. Advanced proficiency in SQL Management Studio. Microsoft Fabric expertise, especially focused on Power BI development but also including Data Factory, Dataflow Gen2 and data pipeline creation. Demonstrated ability to design and implement data models that support business requirements. A strong analytical orientation coupled with string data manipulation skills to be More ❯

are currently manual or inefficient and suitable for automation. Design and develop automated solutions: Using appropriate tools to build automation workflows, design end-to-end solutions - such as data pipelines, report generation scripts, workflows - tailored to the needs of fund operations. Testing and implementation: Rigorously testing automation workflows to ensure they function correctly and produce accurate results before … or errors that arise and make adjustments to optimize speed and reliability. Update automations as underlying systems or requirements change (for example, adapting a workflow when a new data source becomes available). Documentation and compliance: Documenting all automated processes and workflows. This includes keeping an audit trail of what the automation does, parameters used, and results. Training … tools or workflows. Act as a support contact for troubleshooting if end-users encounter issues with the automated systems. What you will bring to the table: Expertise in data automation and workflow tools is essential. Strong skills in Alteryx for data prep and analytics, proficiency with RPA/workflow software like UiPath or Power Automate, and More ❯

IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build and manage the largest petabyte-scale data infrastructure in India for Amazon India businesses. IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all A.in businesses. The … team's charter includes 1) Providing Unified Data and Analytics Infrastructure (UDAI) for all A.in teams which includes central Petabyte-scale Redshift data warehouse, analytics infrastructure and frameworks for visualizing and automating generation of reports & insights and self-service data applications for ingesting, storing, discovering, processing & querying of the data 2) Providing … business specific data solutions for various business streams like Payments, Finance, Consumer & Delivery Experience. The Data Engineer will play a key role in being a strong owner of our Data Platform. He/she will own and build data pipelines, automations and solutions to ensure the availability, system efficiency, IMR efficiency, scaling More ❯

Sr. Data Scientist, FinOps - Global Data Analytics Amazon Finance Operations Global Data Analytics (GDA) science team seeks a Sr. Data Scientist with the technical expertise and business intuition to invent the future of Accounts Payable at Amazon. As a key member of the science team, the Data Scientist will own … analyses, methodology, and algorithms in the Procure-to-Pay lifecycle to drive free cash flow improvements for Amazon Finance Operations. This is a unique opportunity in a growing data science and economics team with a charter to optimize operations and planning with complex trade-offs between customer experience, cash flow, and operational efficiencies in our payment processes. Key … job responsibilities The Sr. Data Scientist's responsibilities include, but are not limited to the following points: - Manage relationships with business and operational stakeholders and product managers to innovate on behalf of customers, develop novel applications data science methodologies, and partner with engineers and scientists to design, develop, and scale machine learning models. - Define the vision More ❯

Senior Data Engineering Manager London - Hybrid (2 days/week, usually Tues & Fri) 12-month contract Day rate: £700 (umbrella) About the Role Join a critical data remediation programme within the Surveillance Team/Lab, part of the Markets Platform area of … a major financial services business. You will lead design and delivery of stable, scalable, and performant data solutions within a complex GCP architecture, driving simplification and improving pipeline automation to enable timely, secure data delivery to surveillance systems. Key Responsibilities Engineer stable, scalable, performant, accessible, testable, and secure data products aligned with endorsed … data integration Solid SQL expertise for querying, transforming, and troubleshooting data Experience building robust ETL pipelines from diverse source systems Familiarity with CI/CD pipeline automation and enhancement Understanding of Agile delivery frameworks, including Jira and sprint planning Knowledge of Terraform for infrastructure as code provisioning Experience with containerization technologies to deploy and manage More ❯

Senior Data Engineering Manager London - Hybrid (2 days/week, usually Tues & Fri) 12-month contract Day rate: £700 (umbrella) About the Role Join a critical data remediation programme within the Surveillance Team/Lab, part of the Markets Platform area of … a major financial services business. You will lead design and delivery of stable, scalable, and performant data solutions within a complex GCP architecture, driving simplification and improving pipeline automation to enable timely, secure data delivery to surveillance systems. Key Responsibilities Engineer stable, scalable, performant, accessible, testable, and secure data products aligned with endorsed … data integration Solid SQL expertise for querying, transforming, and troubleshooting data Experience building robust ETL pipelines from diverse source systems Familiarity with CI/CD pipeline automation and enhancement Understanding of Agile delivery frameworks, including Jira and sprint planning Knowledge of Terraform for infrastructure as code provisioning Experience with containerization technologies to deploy and manage More ❯

private and commercial banking, wealth planning and investment management. We believe in traditional relationship and service-led banking powered by modern technology. Job purpose Develop and maintain complex data systems that support the Bank's operations and reporting needs, ensuring they meet all essential data requirements, following strong engineering and automation best practices and collaborating with … Significant hands-on experience with the Azure Data Stack, critically ADF and Synapse (experience with Microsoft Fabric is a plus) Highly developed python and data pipeline development knowledge, must include substantial PySpark experience Demonstrable DevOps and DataOps experience with an understanding of best practices for engineering, test and ongoing service delivery An understanding of Infrastructure … as Code concepts (Demonstrable Terraform experience a plus) Demonstrable experience of Data Pipeline testing, including automated testing, data validation and code assurance Demonstrable experience of working within Agile Delivery projects An understanding of data formats for ingest, transformation and analytics, data security, access control and authorisation, GDPR, data privacy More ❯

TL;DR Kharon is seeking a full-time, London or Madrid-based Data Engineering Manager . Occasional in office attendance is required for this role. RESPONSIBILITIES: Lead, mentor, and scale a small high-performing, high-output data and software engineering team, fostering a culture of ownership, continuous learning, constructive feedback, and technical excellence. Be a strong … hands on contributor in day-to-day software development Own the architecture and delivery of core data … systems and infrastructure—ensuring they are scalable, maintainable, and aligned with Kharon’s platform goals. Establish and enforce best practices for data modeling, ETL/ELT development, pipeline orchestration, and observability. Drive adoption of modern data tooling (e.g., Airflow, Databricks, Spark, AWS-native services) and architectural patterns. Implement and oversee data governance practices More ❯

As a Data Specialist at this tech scaleup in London, you will analyse, collect, sort, and create data solutions that integrate across multiple products. You will steer decisions regarding data and build the models that power their products. You will take client insights and requirements and make them a reality, by developing datasets and … drive innovation into the product development process. You will interpret your client’s objectives, desires, and preferences to help the wider technical team understand the opportunities and apply data engineering responsibilities consistently. You will be working on an interesting range of projects that deliver to National Security customers and as such, you will have to hold the highest … pipelines that are tested and robust using a variety of technologies and techniques depending on the available technologies (Nifi, Spark) Build analytics tools that utilise the data pipeline to provide actionable insights into client requirements, operational efficiency, and other key business performance metrics. Complete onsite client visits and provide excellent customer support service. Problem-solve in a More ❯

As a Data Specialist at this tech scaleup in London, you will analyse, collect, sort, and create data solutions that integrate across multiple products. You will steer decisions regarding data and build the models that power their products. You will take client insights and requirements and make them a reality, by developing datasets and … drive innovation into the product development process. You will interpret your client’s objectives, desires, and preferences to help the wider technical team understand the opportunities and apply data engineering responsibilities consistently. You will be working on an interesting range of projects that deliver to National Security customers and as such, you will have to hold the highest … pipelines that are tested and robust using a variety of technologies and techniques depending on the available technologies (Nifi, Spark) Build analytics tools that utilise the data pipeline to provide actionable insights into client requirements, operational efficiency, and other key business performance metrics. Complete onsite client visits and provide excellent customer support service. Problem-solve in a More ❯

Job Title: Data Engineer (with AI Engineering Experience) Location: Hybrid (UK-based) Outside IR35 Contract role - 6 months rolling Industry: Energy/Wholesale Markets & Trading We’re looking for a skilled Data Engineer with Artificial Intelligence (AI) experience to join a cutting-edge team within one of the UK’s leading energy companies. This role sits … within the organisation’s Wholesale Market Services and Trading division, a key area focused on enabling smarter, data-driven decision-making in fast-paced energy markets. You’ll play a pivotal role in designing and delivering complex, cloud-native data solutions that support trading operations, risk management, market forecasting, and AI-led optimisation initiatives. Key Responsibilities … Design, build, and maintain robust data pipelines and cloud-based infrastructure to support large-scale data processing and analytics workloads. Collaborate with data scientists and AI engineers to productionise machine learning models and support intelligent automation solutions. Contribute to the development and enhancement of the enterprise data platform with scalable, high-quality More ❯

Job Title: Data Engineer (with AI Engineering Experience) Location: Hybrid (UK-based) Outside IR35 Contract role - 6 months rolling Industry: Energy/Wholesale Markets & Trading We’re looking for a skilled Data Engineer with Artificial Intelligence (AI) experience to join a cutting-edge team within one of the UK’s leading energy companies. This role sits … within the organisation’s Wholesale Market Services and Trading division, a key area focused on enabling smarter, data-driven decision-making in fast-paced energy markets. You’ll play a pivotal role in designing and delivering complex, cloud-native data solutions that support trading operations, risk management, market forecasting, and AI-led optimisation initiatives. Key Responsibilities … Design, build, and maintain robust data pipelines and cloud-based infrastructure to support large-scale data processing and analytics workloads. Collaborate with data scientists and AI engineers to productionise machine learning models and support intelligent automation solutions. Contribute to the development and enhancement of the enterprise data platform with scalable, high-quality More ❯

About the Role The Data Engineer plays a key role in shaping and delivering Global Switch’s modern data platform, enabling insights and analytics across a global data centre organisation. Reporting to the Head of Data, this role is central to the development and optimisation of scalable data pipelines and … solutions within Microsoft Fabric, supporting the company’s transformation into a data-driven enterprise. This is an exciting opportunity for a technically skilled and business-savvy professional who thrives on building data products that empower decision-making. You’ll work closely with cross-functional teams to understand stakeholder needs and deliver high-quality, cloud-native data solutions that drive value across the organisation. Key Responsibilities Design, develop, and maintain scalable data pipelines within the Modern Data Platform. Collaborate with business and technical teams to gather requirements and translate them into effective data products. Implement robust data models and ensure data integrity, performance, and reliability. More ❯

About the Role The Data Engineer plays a key role in shaping and delivering Global Switch’s modern data platform, enabling insights and analytics across a global data centre organisation. Reporting to the Head of Data, this role is central to the development and optimisation of scalable data pipelines and … solutions within Microsoft Fabric, supporting the company’s transformation into a data-driven enterprise. This is an exciting opportunity for a technically skilled and business-savvy professional who thrives on building data products that empower decision-making. You’ll work closely with cross-functional teams to understand stakeholder needs and deliver high-quality, cloud-native data solutions that drive value across the organisation. Key Responsibilities Design, develop, and maintain scalable data pipelines within the Modern Data Platform. Collaborate with business and technical teams to gather requirements and translate them into effective data products. Implement robust data models and ensure data integrity, performance, and reliability. More ❯

Job Description An exciting opportunity has arisen for an experienced data engineering leader to drive innovation and build a best-in-class data infrastructure at a leading private markets firm. This role will lead a high-performing team in designing and scaling data platforms, with a strong emphasis on Azure Databricks , to enhance investment … decision-making and operational efficiency. The Role As Head of Data Engineering , you will be responsible for shaping and executing the firm’s data strategy, working closely with stakeholders across technology, investment, and transformation teams. Your expertise in data architecture, cloud platforms, and engineering best practices will be instrumental in building scalable, high-performance … data solutions that power analytics and business intelligence. Key Responsibilities Lead and develop the data engineering team, fostering a culture of technical excellence and innovation. Architect and build scalable data pipelines, integrating structured and unstructured data sources to support investment research and reporting. Drive the firm’s cloud-based data More ❯

Data Engineer (Databricks Focus) London, hybrid working 6 months What you'll be doing: As a Data Engineer, you'll be instrumental in the post-organisational change data landscape. Your key responsibilities will include: Designing and implementing robust data pipelines for efficient data collection, processing, and storage. Leading the migration … of existing files and data to new systems. Ensuring data quality, integrity, and security throughout the migration process. Collaborating closely with stakeholders across the business to understand their data needs and translate them into technical solutions. Contributing to the development of best practices for data management and governance. What you'll bring … Extensive experience as a Data Engineer, with a proven track record of delivering impactful data solutions. Deep and recent experience with Azure, Databricks, and Azure Data Factory. You've not just touched these technologies; you've used them extensively in recent projects. Strong proficiency in Python for data manipulation and automation. Hands More ❯

Data Engineer (Databricks Focus) London, hybrid working 6 months What you'll be doing: As a Data Engineer, you'll be instrumental in the post-organisational change data landscape. Your key responsibilities will include: Designing and implementing robust data pipelines for efficient data collection, processing, and storage. Leading the migration … of existing files and data to new systems. Ensuring data quality, integrity, and security throughout the migration process. Collaborating closely with stakeholders across the business to understand their data needs and translate them into technical solutions. Contributing to the development of best practices for data management and governance. What you'll bring … Extensive experience as a Data Engineer, with a proven track record of delivering impactful data solutions. Deep and recent experience with Azure, Databricks, and Azure Data Factory. You've not just touched these technologies; you've used them extensively in recent projects. Strong proficiency in Python for data manipulation and automation. Hands More ❯

achieving on-time delivery in a cost-effective manner to deliver a smile for our customers. Amazon Logistics is looking for a customer focused, analytically and technically skilled Data Engineer to build advanced data and reporting solutions for AMZL leadership and BI teams. This position will be responsible for building and managing real time data … AWS and building analytical tools to support our growing Amazon Logistics business in Japan. The successful candidate will be able to effectively extract, transform, load and visualize critical data to improve the latency and accuracy of the existing data pipelines and drive faster analytics through data. This individual will work with business, software development and science … teams to understand their data requirements and ensure all the teams have reliable data that drives effective business analytics. This role requires an individual with software development and data warehouse skills. The successful candidate will be a self-starter comfortable with ambiguity, with strong attention to detail, and enjoy working with large scale of More ❯