201 to 225 of 283 Data Pipeline Jobs in London

Key Responsibilities: Design, build, and deploy AI/ML models for real-world business use cases. Work with NLP, computer vision, and generative AI frameworks where applicable. Develop data pipelines and integrate models into production systems. Collaborate with data scientists, engineers, and product teams to define AI solutions. Ensure scalability, performance, and ethical AI practices. Required … Skills & Experience: Strong experience in Python, TensorFlow, PyTorch, Scikit-learn or similar frameworks. Solid understanding of machine learning, deep learning, NLP, or computer vision. Hands-on with data engineering, model deployment (MLOps), and cloud platforms (AWS, Azure, GCP). Strong problem-solving, algorithmic, and analytical skills. Knowledge of big data tools (Spark, Hadoop) is a plus. More ❯

strategies on Solana and adjacent ecosystems. While you'll work within a Solana-first environment, most of your contributions will be in architectural design, APIs, smart contract integrations, data pipelines, and compliance flows rather than low-level Rust development (though familiarity is a plus). What you'll do: Design tokenization architectures for RWAs on Solana as well More ❯

Job Title: Software Engineer – (AI Automation & LLM ) Location: London- Hybrid role Duration: 31st December 2025- possible extension Role: We're looking for a skilled Data Engineer/Software Engineer to support a pioneering AI research project focused on Large Language Model (LLM) agents and intelligent automation. You’ll play a central role in preparing and filtering text, image … and video datasets used to train advanced AI systems, helping to ensure data quality, relevance, and safety.. Key Responsibilities Data Onboarding: Convert raw datasets into structured formats suitable for automated processing. Filtering: Apply data … cleaning, quality checks, and filtering pipelines to identify and mitigate risks in datasets. Post-Processing: Integrate filtering results to modify original datasets, repackage them, and prepare for re-ingestion. Pipeline Engineering: Design, build, and maintain scalable and efficient data pipelines. Collaboration: Work closely with researchers and technical teams to refine processes and contribute to ongoing AI automation More ❯

be part of a collaborative, high-performing team that values technical excellence, an ownership mindset, and humility. The ideal candidate is an experienced engineer with strong Python skills, data engineering expertise, and comfort working in fast-paced trading environments. Key Responsibilities Building and maintaining resilient treasury systems for trading, liquidity management, and funding operations using Python as the … core language Engaging directly with traders and treasury stakeholders during live market situations, rapidly understanding requirements and delivering solutions on the fly Designing, managing, and optimizing data pipelines for real-time and historical treasury data with focus on accuracy, reliability, and performance Contributing to deployment, monitoring, and scaling of systems while working with operations teams to … in software engineering, ideally in front office finance , fintech , high-frequency trading , or technology-driven startups Expert-level Python skills - designing, debugging, and optimizing complex applications Very strong data capabilities with Pandas , NumPy , SQL , real-time data processing, and ETL Familiarity with DevOps practices including Linux , cloud platforms , CI/CD , and containerization (Docker/Kubernetes More ❯

Job title: Data Engineer Client: Award Winning FinTech Firm Rate: Up to £675 p/d Duration: 6-Month Rolling Contract | Long-Term Engagement Location: London Skills: Python/Azure/Databricks/Snowflake The Role: Design and build powerful data pipelines that fuel real-time decisions, machine learning, and next-gen analytics at scale. Transform … raw data into trusted, usable assets - the foundation for everything from executive dashboards to product innovation. Own the data flow from ingestion to insight - using modern tools like Python, Azure, and Databricks. What you need: 7+ years of hands-on experience in data engineering roles. Advanced skills in Python for data pipelines … transformation, and orchestration. Deep understanding of the Azure ecosystem (e.g., Data Factory, Blob Storage, Synapse, etc.) Proficiency in Databricks (or strong equivalent experience with Apache Spark ). Proven ability to work within enterprise-level environments with a focus on clean, scalable, and secure data solutions. If you are the right fit - contact me directly at bbirch More ❯

Job title: Data Engineer Client: Award Winning FinTech Firm Rate: Up to £675 p/d Duration: 6-Month Rolling Contract | Long-Term Engagement Location: London Skills: Python/Azure/Databricks/Snowflake The Role: Design and build powerful data pipelines that fuel real-time decisions, machine learning, and next-gen analytics at scale. Transform … raw data into trusted, usable assets - the foundation for everything from executive dashboards to product innovation. Own the data flow from ingestion to insight - using modern tools like Python, Azure, and Databricks. What you need: 7+ years of hands-on experience in data engineering roles. Advanced skills in Python for data pipelines … transformation, and orchestration. Deep understanding of the Azure ecosystem (e.g., Data Factory, Blob Storage, Synapse, etc.) Proficiency in Databricks (or strong equivalent experience with Apache Spark ). Proven ability to work within enterprise-level environments with a focus on clean, scalable, and secure data solutions. If you are the right fit - contact me directly at bbirch More ❯

Job title: Data Engineer Client: Award Winning FinTech Firm Rate: Up to £675 p/d Duration: 6-Month Rolling Contract | Long-Term Engagement Location: London Skills: Python/Azure/Databricks/Snowflake The Role: Design and build powerful data pipelines that fuel real-time decisions, machine learning, and next-gen analytics at scale. Transform … raw data into trusted, usable assets - the foundation for everything from executive dashboards to product innovation. Own the data flow from ingestion to insight - using modern tools like Python, Azure, and Databricks. What you need: 7+ years of hands-on experience in data engineering roles. Advanced skills in Python for data pipelines … transformation, and orchestration. Deep understanding of the Azure ecosystem (e.g., Data Factory, Blob Storage, Synapse, etc.) Proficiency in Databricks (or strong equivalent experience with Apache Spark ). Proven ability to work within enterprise-level environments with a focus on clean, scalable, and secure data solutions. If you are the right fit - contact me directly at bbirch More ❯

Job title: Data Engineer Client: Award Winning FinTech Firm Rate: Up to £675 p/d Duration: 6-Month Rolling Contract | Long-Term Engagement Location: London Skills: Python/Azure/Databricks/Snowflake The Role: Design and build powerful data pipelines that fuel real-time decisions, machine learning, and next-gen analytics at scale. Transform … raw data into trusted, usable assets - the foundation for everything from executive dashboards to product innovation. Own the data flow from ingestion to insight - using modern tools like Python, Azure, and Databricks. What you need: 7+ years of hands-on experience in data engineering roles. Advanced skills in Python for data pipelines … transformation, and orchestration. Deep understanding of the Azure ecosystem (e.g., Data Factory, Blob Storage, Synapse, etc.) Proficiency in Databricks (or strong equivalent experience with Apache Spark ). Proven ability to work within enterprise-level environments with a focus on clean, scalable, and secure data solutions. If you are the right fit - contact me directly at bbirch More ❯

Data Engineer, Commodities £135,000 Basic + Extensive Benefits, London My Commodities Trading Client are looking for a Data Engineer to join the trade surveillance team, develop ingestion pipelines and frameworks to support strategic decision making. The team has recently built a new data lake house and ingestion infrastructure. It is entering a phase … and re-engineering to enhance the speed, ease, and quality of ingestion across the portfolio. Key Requirements: Strong proficiency in Python and PySpark Successful track history in a Data Engineering role including Database Management (ideally SQL), Data Orchestration (ideally Apache Airflow or Dagster), Containerisation (ideally Kubernetes and Docker) .Data Pipelines (big data technologies and More ❯

New Role: Data Science Engineer (LLM Focus) Salary: £55,000-£75,000 + share options Hybrid/Remote: Flexible but with regular London meetings? Location: UK-based (preferably London) We're looking for a Data Science Engineer to join a fast-moving team working on NLP pipelines and data at scale. This is a … great opportunity for someone passionate about impactful data work and modern AI tools. What We're Looking For: 1+ years' experience in data science or engineering.? Strong Python skills and experience with LLMs/NLP.? Experience building scalable data pipelines.? Bonus: GCP, Docker, geospatial data, Postgres/PostGIS If you're a … hands-on data scientist/engineer looking for your next step, we'd love to hear from you. Interested? Apply now! Oscar Associates (UK) Limited is acting as an Employment Agency in relation to this vacancy. To understand more about what we do with your data please review our privacy policy in the privacy section of More ❯

while promoting Audit Quality. As a crucial member of the team, you will collaborate with a talented mix of Cloud & DevOps Engineers, Product Owners/Managers, Solution Architects, Data Engineers, Business Analysts, and Testing Specialists. Together, we build, deliver, and manage a portfolio of truly exciting products. In recent years, our products' size and scale have rapidly expanded … components of the audit technology landscape. You will develop integrations with internal and external APIs, build cloud-native components on Azure - while also contributing to innovative AI and data-driven solutions, leveraging technologies such as Databricks, data pipelines, and large language models (LLMs) to power next-generation applications. You’ll collaborate closely with engineering peers, architects … integration with Microsoft Graph APIs and other third-party systems. Security Compliance: Implement robust authentication and authorization mechanisms and enforce security best practices to safeguard API communication and data integrity. Cloud Engineering: Design and implement components using Azure services such as Function Apps, API Management, Application Gateway, Azure AI Foundry, Databricks and Service Bus. DevOps & CI/CD More ❯

while promoting Audit Quality. As a crucial member of the team, you will collaborate with a talented mix of Cloud & DevOps Engineers, Product Owners/Managers, Solution Architects, Data Engineers, Business Analysts, and Testing Specialists. Together, we build, deliver, and manage a portfolio of truly exciting products. In recent years, our products' size and scale have rapidly expanded … components of the audit technology landscape. You will develop integrations with internal and external APIs, build cloud-native components on Azure - while also contributing to innovative AI and data-driven solutions, leveraging technologies such as Databricks, data pipelines, and large language models (LLMs) to power next-generation applications. You’ll collaborate closely with engineering peers, architects … integration with Microsoft Graph APIs and other third-party systems. Security Compliance: Implement robust authentication and authorization mechanisms and enforce security best practices to safeguard API communication and data integrity. Cloud Engineering: Design and implement components using Azure services such as Function Apps, API Management, Application Gateway, Azure AI Foundry, Databricks and Service Bus. DevOps & CI/CD More ❯

while promoting Audit Quality. As a crucial member of the team, you will collaborate with a talented mix of Cloud & DevOps Engineers, Product Owners/Managers, Solution Architects, Data Engineers, Business Analysts, and Testing Specialists. Together, we build, deliver, and manage a portfolio of truly exciting products. In recent years, our products' size and scale have rapidly expanded … components of the audit technology landscape. You will develop integrations with internal and external APIs, build cloud-native components on Azure - while also contributing to innovative AI and data-driven solutions, leveraging technologies such as Databricks, data pipelines, and large language models (LLMs) to power next-generation applications. You’ll collaborate closely with engineering peers, architects … integration with Microsoft Graph APIs and other third-party systems. Security Compliance: Implement robust authentication and authorization mechanisms and enforce security best practices to safeguard API communication and data integrity. Cloud Engineering: Design and implement components using Azure services such as Function Apps, API Management, Application Gateway, Azure AI Foundry, Databricks and Service Bus. DevOps & CI/CD More ❯

while promoting Audit Quality. As a crucial member of the team, you will collaborate with a talented mix of Cloud & DevOps Engineers, Product Owners/Managers, Solution Architects, Data Engineers, Business Analysts, and Testing Specialists. Together, we build, deliver, and manage a portfolio of truly exciting products. In recent years, our products' size and scale have rapidly expanded … components of the audit technology landscape. You will develop integrations with internal and external APIs, build cloud-native components on Azure - while also contributing to innovative AI and data-driven solutions, leveraging technologies such as Databricks, data pipelines, and large language models (LLMs) to power next-generation applications. You’ll collaborate closely with engineering peers, architects … integration with Microsoft Graph APIs and other third-party systems. Security Compliance: Implement robust authentication and authorization mechanisms and enforce security best practices to safeguard API communication and data integrity. Cloud Engineering: Design and implement components using Azure services such as Function Apps, API Management, Application Gateway, Azure AI Foundry, Databricks and Service Bus. DevOps & CI/CD More ❯

reporting, P&L attribution, and compliance systems for Marketing IM Develop tools for real-time dashboards, scenario analysis, and risk monitoring (market, credit, operational) Build and maintain APIs, data pipelines, and automation for risk analytics and reporting Implement scalable solutions to monitor risks across inventories, derivatives, FX, and counterparty credit Enhance and integrate commercial off-the-shelf (COTS … Knowledge of market, credit, and operational risk, compliance, and trade lifecycle Proven in delivering complex risk and compliance solutions Strong leadership and stakeholder management skills Bonus: Python, Azure Data Factory/Databricks, data analysis, and COTS risk platforms (e.g., CubeLogic, deltaconX) Package £100,000 Base Salary 15% non-contributory pension Hybrid working (3 days per week More ❯

reporting, P&L attribution, and compliance systems for Marketing IM Develop tools for real-time dashboards, scenario analysis, and risk monitoring (market, credit, operational) Build and maintain APIs, data pipelines, and automation for risk analytics and reporting Implement scalable solutions to monitor risks across inventories, derivatives, FX, and counterparty credit Enhance and integrate commercial off-the-shelf (COTS … Knowledge of market, credit, and operational risk, compliance, and trade lifecycle Proven in delivering complex risk and compliance solutions Strong leadership and stakeholder management skills Bonus: Python, Azure Data Factory/Databricks, data analysis, and COTS risk platforms (e.g., CubeLogic, deltaconX) Package £100,000 Base Salary 15% non-contributory pension Hybrid working (3 days per week More ❯

pipelines and AI infrastructure. Develop platform-level test solutions and automation frameworks using Python, Terraform, and modern cloud-native practices. Contribute to the platform’s CI/CD pipeline by integrating automated testing, resilience checks, and observability hooks at every stage. Lead initiatives that drive testability, platform resilience, and validation as code across all layers of the ML … provision cloud infrastructure. Strong understanding of software engineering best practices: code quality, reliability, performance optimization, and observability. Preferred Qualifications Exposure to machine learning workflows, model lifecycle management, or data engineering platforms. Experience with distributed systems, event-driven architectures (e.g., Kafka), and big data platforms (e.g., Spark, Databricks). Familiarity with banking or financial domain use cases … including data governance and compliance-focused development. Knowledge of platform security, monitoring, and resilient architecture patterns. More ❯

S&P Global About the Role Job Title: Director, Revenue Impact Modelling & Performance Analytics Experience Level: Senior Core Skills: Tableau, Power BI, Python, SQL, Demand generation, Marketing strategy, Data Pipelines Employment Type: Full Time Locations to Work: Remote London, UK Status: Not Available Position Roles: Head of Revenue Operations What the job involves Part of the Enterprise Marketing … part of S&P Global's enterprise marketing transformation, this role ensures that investments, tactics, and campaigns are accountable to measurable business impact. The Director will work across data, analytics, and campaign teams to define how marketing success is … measured and how its impact on revenue is forecasted, visualized, and optimized. Responsibilities and Impact: Revenue Attribution & Impact Modeling: Design and operationalize attribution frameworks that connect marketing activity to pipeline and revenue across touchpoints. Build and maintain predictive models to forecast marketing-influenced revenue, campaign lift, and investment ROI. Partner with Sales Operations and Finance to validate impact models More ❯

application platform for enterprise. Soon, all your digital information will be stored in one place. Everything you do, whether that be sending emails, building presentations, having meetings, pulling data, or doing research, will all be underpinned by an AI model that belongs to you. Using Model ML, you'll simply talk to your laptop or phone to get … agent infrastructure, and evaluation frameworks (Evals). Build real-world AI use cases by integrating fine-tuned models and large language model APIs into user-facing products. Create data pipelines for AI model training, evaluation, and continuous improvement. Mentor junior developers and promote engineering best practices. Required Qualifications 5+ years of professional software engineering experience. Proven experience with More ❯

Banking Clients. Support the implementation & testing of various risk change programs within the firm, times series checks & implementation including sanity check, validating, imputing Support in developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting The role involves designing and implementing an effective data and controls framework for various Risk programs Work on … cleansing historical time series, imputing-backfill missing values, implementing strategic controls for ensuring time series data quality Review & optimize the VaR back testing process, root cause findings of VBT exceptions Partner with technology, reconciliation unit, and data governance team, addressing exceptions and managing down applicable risk reduction metrics. Liaise with stakeholders (Department business team, IT, cross … department teams) involved in Data lineage work effort to manage multiple hands off and entailing stitching activities to build end-to-end data lineage Help risk manager to analyse & quantify the change impact, this may include digging through large data sets to understand the pattern/issue, replicating the calculation independently using banks pricing More ❯

Banking Clients. Support the implementation & testing of various risk change programs within the firm, times series checks & implementation including sanity check, validating, imputing Support in developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting The role involves designing and implementing an effective data and controls framework for various Risk programs Work on … cleansing historical time series, imputing-backfill missing values, implementing strategic controls for ensuring time series data quality Review & optimize the VaR back testing process, root cause findings of VBT exceptions Partner with technology, reconciliation unit, and data governance team, addressing exceptions and managing down applicable risk reduction metrics. Liaise with stakeholders (Department business team, IT, cross … department teams) involved in Data lineage work effort to manage multiple hands off and entailing stitching activities to build end-to-end data lineage Help risk manager to analyse & quantify the change impact, this may include digging through large data sets to understand the pattern/issue, replicating the calculation independently using banks pricing More ❯

Banking Clients. Support the implementation & testing of various risk change programs within the firm, times series checks & implementation including sanity check, validating, imputing Support in developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting The role involves designing and implementing an effective data and controls framework for various Risk programs Work on … cleansing historical time series, imputing-backfill missing values, implementing strategic controls for ensuring time series data quality Review & optimize the VaR back testing process, root cause findings of VBT exceptions Partner with technology, reconciliation unit, and data governance team, addressing exceptions and managing down applicable risk reduction metrics. Liaise with stakeholders (Department business team, IT, cross … department teams) involved in Data lineage work effort to manage multiple hands off and entailing stitching activities to build end-to-end data lineage Help risk manager to analyse & quantify the change impact, this may include digging through large data sets to understand the pattern/issue, replicating the calculation independently using banks pricing More ❯

Banking Clients. Support the implementation & testing of various risk change programs within the firm, times series checks & implementation including sanity check, validating, imputing Support in developing and optimizing data pipelines for risk calculations, trade analytics and regulatory reporting The role involves designing and implementing an effective data and controls framework for various Risk programs Work on … cleansing historical time series, imputing-backfill missing values, implementing strategic controls for ensuring time series data quality Review & optimize the VaR back testing process, root cause findings of VBT exceptions Partner with technology, reconciliation unit, and data governance team, addressing exceptions and managing down applicable risk reduction metrics. Liaise with stakeholders (Department business team, IT, cross … department teams) involved in Data lineage work effort to manage multiple hands off and entailing stitching activities to build end-to-end data lineage Help risk manager to analyse & quantify the change impact, this may include digging through large data sets to understand the pattern/issue, replicating the calculation independently using banks pricing More ❯

beginning: Tether Power: Driving sustainable growth, our energy solutions optimize excess power for Bitcoin mining using eco-friendly practices in state-of-the-art, geo-diverse facilities. Tether Data: Fueling breakthroughs in AI and peer-to-peer technology, we reduce infrastructure costs and enhance global communications with cutting-edge solutions like KEET , our flagship app that redefines secure … and private data sharing. Tether Education : Democratizing access to top-tier digital learning, we empower individuals to thrive in the digital and gig economies, driving global growth and opportunity. Tether Evolution : At the intersection of technology and human potential, we are pushing the boundaries of what is possible, crafting a future where innovation and human capabilities merge in … researchers to co-design video model architectures (e.g. DiTs, VAEs, spatio-temporal transformers) and training schedules across pretraining and fine-tuning stages. Optimize distributed data loading and pipeline throughput for training at scale, ensuring robustness across model variants and modality combinations. Manage infrastructure to support experiment tracking, model versioning, and cross-team deployment workflows, integrating with production More ❯

CRM & Data Strategy Analyst (Luxury/Retail) Salary: £46,000 + benefits Location: London (Hybrid – 2 days per week in office) A highly regarded brand in the luxury retail space is looking for a CRM & Data Strategy Analyst to join its Customer Experience team. This role will sit within a collaborative data strategy function … segmentation, and analytics to help drive acquisition and engagement. ROLE AND RESPONSIBILITIES Support the CRM and analytics function within the Customer Experience team. Pull, analyse, and present customer data to inform decision-making and campaign performance. Translate complex data into clear, actionable insights with strong storytelling. Set up and optimise data pipelines and customer More ❯