876 to 900 of 1,235 Data Pipeline Jobs in the UK

About Us At Two, we are redefining B2B payments by creating innovative, data-driven solutions that power seamless commerce for businesses worldwide. Our Risk Engine is at the core of this mission, utilising cutting-edge machine learning and AI to drive fraud prevention, credit risk management, and business … scalability. We are seeking a visionary VP of Data Science to lead our team and help shape the future of our Risk Engine and data science initiatives. About the Role As the VP of Data Science, you will spearhead Two's data science strategy, innovation, and execution. Reporting directly to the CEO, you will lead and mentor a team of 7-10 data scientists, collaborating across functions to deliver state-of-the-art solutions. Your leadership will ensure our Risk Engine evolves as a product, stays ahead of More ❯

where applicable. Enhance and optimize systems for equity factor modelling, portfolio construction, trading, and reporting. Pipelines (20%): Identify and implement performance optimizations for data pipelines and processing workflows. Production (20%): Oversee the maintenance and operational stability of investment process systems and production jobs. Communication (20%): Ensure comprehensive documentation … query optimization and execution plan analysis. Experience with auditing, and CI CD processes, Bitbucket (Github), Team City, setup and create pipelines. Proficiency in data modelling, data management processes, and data profiling. Experience in developing APIs and working with WebSockets. Knowledge of React, Django, FastAPI More ❯

and partnerships, their growth trajectory is steep, and they’re building a best-in-class technical team to scale even faster. Right now, Data Engineering is their #1 priority. They’re actively hiring for: Data Engineer Lead/Head of Data Engineering About the … in combining technical excellence with creative innovation Why They’re Hiring: Their AI researchers and scientists are stretched thin, pulled into building foundational data pipelines when they should be focused on modeling. They're standing up a dedicated Data Engineering team - and they need top talent … think video datasets at petabyte scale) Curate datasets from messy, unstructured sources - with a focus on automation Architect ingestion systems and build scalable data infrastructure Partner deeply with Infra, AI Research, and Product teams Play a key role supporting projects like foundational model development and synthetic data More ❯

and partnerships, their growth trajectory is steep, and they’re building a best-in-class technical team to scale even faster. Right now, Data Engineering is their #1 priority. They’re actively hiring for: Data Engineer Lead/Head of Data Engineering About the … in combining technical excellence with creative innovation Why They’re Hiring: Their AI researchers and scientists are stretched thin, pulled into building foundational data pipelines when they should be focused on modeling. They're standing up a dedicated Data Engineering team - and they need top talent … think video datasets at petabyte scale) Curate datasets from messy, unstructured sources - with a focus on automation Architect ingestion systems and build scalable data infrastructure Partner deeply with Infra, AI Research, and Product teams Play a key role supporting projects like foundational model development and synthetic data More ❯

company, is seeking a skilled Databricks Engineer to join their team on a contract basis . This role involves designing, developing, and optimising data infrastructure to support their innovative retail operations. Key responsibilities include: Designing and implementing data pipelines using Databricks Optimising ETL processes Collaborating with … data scientists and analysts Ensuring data security and governance Requirements: Proven experience with Databricks, Spark, and SQL Familiarity with cloud platforms (AWS, Azure, Google Cloud) Strong problem-solving skills Excellent communication skills Preferred Qualifications: Experience in the retail sector Knowledge of data visualisation tools More ❯

Design and implement complex data pipelines and architectures. Utilising dbt and Prefect to automate and run your data pipelines. Collaborate with cross-functional teams to align data engineering efforts. Engaging with clients to identify available data and help them achieve business goals. … Key Candidate Requirements Knowledge Advanced proficiency in programming languages and frameworks used in data engineering. Expertise in optimising and scaling data infrastructure. Strong understanding of data modelling, schema design, and database optimisation. Skills Experience with data orchestration tools and workflow management. Excellent … with customers, Cortex was launched in 2024 to better serve the digitally diverse sports industry as a quick-to-deploy SaaS platform for data and revenue driven sports marketing. Cortex products are used by multiple top tier sports organisations and clubs including; Arsenal FC, Formula 1, ECB, the More ❯

Data Engineer Remote (to +/- 2 hrs of UK Time Zone) We are looking for the right expertise and £ is negotiable Are you a skilled Data Engineer with a passion for financial markets? We're working with a pioneering tech-driven company building innovative financial … data solutions. This is an exciting opportunity to join a collaborative and forward-thinking engineering team working on a cutting-edge data platform for financial datasets. Youll help shape how complex market data is processed, structured, and made accessible for analytics, research, and insight … generation. What youll be doing: Designing and maintaining data pipelines Working with time-series and structured/unstructured datasets Applying your industry know-how within financial data to ensure continual product development Tech youll work with: Functional programming i.e. Ruby, Python, Elixir PostgreSQL OpenAPI integrations Various More ❯

architectures for AI-powered applications and infrastructure. You will play a critical role in identifying and mitigating security risks associated with AI, ensuring data privacy, and promoting ethical AI practices. This role requires a deep understanding of both traditional security principles and the unique challenges posed by AI … technologies. What you'll be doing: AI Security Architecture: Design and implement secure architectures for AI/ML models, data pipelines, and related infrastructure. Develop security policies and procedures specific to AI systems. Evaluate and select security tools and technologies for AI environments. Risk Assessment and Management: Conduct … to identify vulnerabilities and threats specific to AI systems. Develop and implement risk mitigation strategies for AI-related security issues, including adversarial attacks, data poisoning, and model bias. Monitor and report on AI security risks and compliance. Data Security and Privacy: Ensure the security and privacy More ❯

office of JP Morgan Chase. AI2 tackle business critical priorities using innovative machine learning techniques and technologies with a focus on AI for Data, Software, Cybersecurity & Controls and Technology Infrastructure. The team partners closely with all lines of business and engineering teams across the firm to execute long … term projects in these areas that require significant machine learning development to support JPMC businesses as they grow. We are looking for excellent data engineers to help us with the design, development, deployment, delivery, and maintenance of AI products to our clients. In this role, you will be … from data analysis, experimentation, model training, model evaluation, deployment, operationalization, and tuning to visualization. Improve and maintain our automated CI/CD pipeline while collaborating with our stakeholders, various testing partners and model contributors. Increase our deployment velocity, including the process for deploying models and data More ❯

Data Scientist Up to 45,000 Location (Remote) Company: This UK-based start-up has grown rapidly in just two years. With a team of 30 people, they are scaling quickly, supported by recent funding and a strong growth pipeline. They specialise in predictive analytics, tracking KPIs for … a wide range of companies and industries. Their insights empower investors to make informed decisions by providing performance data ahead of public reports. Responsibilities: Clean and process data to ensure accuracy and usability. Build and maintain linear regression models for KPI tracking. Access APIs and integrate … software tools to enhance workflows. Collaborate with the revenue team to generate insightful reports. Support internal product development by improving data pipelines and analysis. Requirements: 1-2 years in data science or a related field, or a Master’s degree. Strong Python programming (essential), SQL, and More ❯

Data Engineer – Remote (to +/- 2 hrs of UK Time Zone) We are looking for the right expertise and £ is negotiable Are you a skilled Data Engineer with a passion for financial markets? We're working with a pioneering tech-driven company building innovative financial … data solutions. This is an exciting opportunity to join a collaborative and forward-thinking engineering team working on a cutting-edge data platform for financial datasets. You’ll help shape how complex market data is processed, structured, and made accessible for analytics, research, and … insight generation. What you’ll be doing: Designing and maintaining data pipelines Working with time-series and structured/unstructured datasets Applying your industry know-how within financial data to ensure continual product development Tech you’ll work with: Functional programming i.e. Ruby, Python, Elixir PostgreSQL More ❯

Data Engineer – Remote (to +/- 2 hrs of UK Time Zone) We are looking for the right expertise and £ is negotiable Are you a skilled Data Engineer with a passion for financial markets? We're working with a pioneering tech-driven company building innovative financial … data solutions. This is an exciting opportunity to join a collaborative and forward-thinking engineering team working on a cutting-edge data platform for financial datasets. You’ll help shape how complex market data is processed, structured, and made accessible for analytics, research, and … insight generation. What you’ll be doing: Designing and maintaining data pipelines Working with time-series and structured/unstructured datasets Applying your industry know-how within financial data to ensure continual product development Tech you’ll work with: Functional programming i.e. Ruby, Python, Elixir PostgreSQL More ❯

Senior Data Scientist Department: Intelligence Collection Employment Type: Full Time Location: London, UK Reporting To: Stephen Hazelton Description Do you want to be part of the future of value transfer? Are you excited about solving problems that have never been solved before? Are you looking for a values … to build. Prioritise based on efficiency, unit economics and value to our business. Work in a highly collaborative environment with engineers, blockchain analysts, data scientists, researchers. Your shared goal is creating intelligence, you contribute in different ways. Be deeply opinionated about where we're spending our time (as … will be a great fit here if you: Are highly curious and sceptical. Have experience digging into huge datasets, spotting quirks in the data and pulling the thread - finding the truth. Can focus only on analysis or models which will be useful for our business - cut through the More ❯

Want to use Data to positively impact young people’s lives? If you love architecting/building data pipelines & want make your mark on a fast growth start-up, you may be interested in a Data Engineer role I have with a profitable challenger … business transforming Finance for young people, with data at the heart of everything we do. You’d lead the Data function, processing 30k requests monthly across 20k users. You’ll have autonomy on the roadmap, including: Greenfield project to introduce real-time data streaming … ingesting user data every 15s An industry-first initiative to move annual payments to a quarterly D2C subscription, saving users money Broad career progression opportunity, as they expand into new sectors Salary to £75k salary + Shares, 25 days holiday (rising to 30), Flexible hours, hybrid More ❯

ECOM are partnered with an exciting software development company based in Manchester who are looking for a Principal Data Engineer. You will join an innovative technology company at the forefront of their industry. As a Principal Data Engineer, you'll be part of a dynamic team … dedicated to pushing the boundaries of technology and continually improving their platform. Role Overview: Seeking a talented & experienced data engineer to help continue develop, shape, and innovate the data foundations across the business, which will positively impact the customer’s experience. As a principal in the … team, you’ll be instrumental in the development of more junior colleagues. Responsibilities: - Design, develop and continually improve the data platform. - Collaborate with cross-functional teams, including software engineers and data scientists, to integrate data architecture and pipelines across the business in an agile More ❯

on experience with RAG (Retrieval-Augmented Generation) and deploying LLM solutions • Proven ability to build AI workflows and design effective prompts • Experience defining data pipelines and building microservices for deployment on AWS or Kubernetes • Bonus points for prior experience mentoring or leading a small team 📍Location: London More ❯

on experience with RAG (Retrieval-Augmented Generation) and deploying LLM solutions • Proven ability to build AI workflows and design effective prompts • Experience defining data pipelines and building microservices for deployment on AWS or Kubernetes • Bonus points for prior experience mentoring or leading a small team 📍Location: London More ❯

an early-stage startup or high-growth technology company Familiarity with cloud platforms and infrastructure as code (AWS, GCP, Terraform, etc.) Experience with data pipelines, event-driven architectures, or real-time systems What’s on Offer Early-stage equity as a bonus and between £50-£80k. Opportunity to More ❯

an early-stage startup or high-growth technology company Familiarity with cloud platforms and infrastructure as code (AWS, GCP, Terraform, etc.) Experience with data pipelines, event-driven architectures, or real-time systems What’s on Offer Early-stage equity as a bonus and between £50-£80k. Opportunity to More ❯

a strong background in MLOps principles, cloud technologies (AWS), and a passion for building robust and efficient systems. You will collaborate closely with data scientists, engineers, and product teams to deliver high-quality ML solutions that directly impact our business. The mission of the Data Science … practices Cloud Infrastructure Management: Manage and optimize our AWS cloud infrastructure for machine learning, ensuring cost-effectiveness, security, and high availability CI/CD Pipeline Development: Develop and maintain robust CI/CD pipelines for continuous integration and deployment of ML models and related infrastructure Monitoring and Observability: Build … systems for our ML infrastructure and models, leveraging tools like DataDog to ensure system health and performance Collaboration and Mentorship: Collaborate effectively with data scientists, engineers, and other stakeholders. Provide guidance and support to junior team members Performance Optimization: Continuously optimize ML model performance, data pipelines More ❯

Senior Data Scientist - Python - SQL - Blockchain - Hybrid (London) - £75k-£95k (Equity Offered) Currently working with a client in the Crypto industry who is looking for a motivated senior data scientist to join their team and help prevent financial crimes and allow cryptocurrencies to be used for … good. Responsibilities: Work in a highly collaborative environment with engineers, blockchain analysts, data scientists, researchers. Your shared goal is creating intelligence, you contribute in different ways. Be deeply opinionated about where we're spending our time, and how we can increase the value of our intelligence. Own your … model? Participate in a collegiate group of blockchain experts, share your knowledge across our business wherever it is effective. Requirements: Is comfortable querying data with SQL and Python. Can optimise queries for huge datasets. Has a solid understanding of blockchain ecosystem elements like DeFi, Exchanges, Wallets, Smart Contracts More ❯

Senior Data Scientist - Python - SQL - Blockchain - Hybrid (London) - £75k-£95k (Equity Offered) Currently working with a client in the Crypto industry who is looking for a motivated senior data scientist to join their team and help prevent financial crimes and allow cryptocurrencies to be used for … good. Responsibilities: Work in a highly collaborative environment with engineers, blockchain analysts, data scientists, researchers. Your shared goal is creating intelligence, you contribute in different ways. Be deeply opinionated about where we're spending our time, and how we can increase the value of our intelligence. Own your … model? Participate in a collegiate group of blockchain experts, share your knowledge across our business wherever it is effective. Requirements: Is comfortable querying data with SQL and Python. Can optimise queries for huge datasets. Has a solid understanding of blockchain ecosystem elements like DeFi, Exchanges, Wallets, Smart Contracts More ❯

the business. Platform Architecture: Oversee the design, architecture, and development of scalable, high-performance, and secure platforms, including cloud infrastructure, microservices, APIs, and data pipelines. Scalability & Reliability: Ensure the platform is highly available and scalable to meet the demands of a growing customer base and evolving business requirements. … Implement strategies to prevent downtime and manage disaster recovery. Collaboration: Collaborate closely with product engineering, data science, security, and other cross-functional teams to drive cohesive, integrated solutions that meet both technical and business requirements. Break down silos between teams and departments, ensuring seamless communication and shared accountability … high uptime and optimized performance. Security & Compliance: Partner with security teams to ensure that the platform complies with industry regulations and standards, including data protection, privacy, and security best practices (e.g., GDPR, SOC 2, etc.). Cost Management: Optimize platform operations and infrastructure for cost-efficiency, particularly in More ❯

an MLOps Engineer, you will be responsible for building, deploying, and maintaining scalable machine learning infrastructure in AWS. You will work closely with data scientists, DevOps teams, and software engineers to ensure that machine learning models can be successfully operationalised, monitored, and updated in real-time environments. Key … full machine learning lifecycle, integrating models into CI/CD pipelines (CodePipeline, Jenkins, GitLab CI) for seamless deployment and version control. Collaborate with data scientists and engineers to transition models from development to production, optimizing workflows and resource usage. Manage and optimize data pipelines, ensuring data … testing, and inference at scale, supporting model performance improvements. Design cloud-native, cost-efficient machine learning solutions that scale based on real-time data and increasing workloads. Required Skills & Experience: Hands-on experience with AWS services such as SageMaker, Lambda, EKS, EC2, CloudFormation, and DynamoDB for deploying and More ❯

of new Trading desks across both the Systematic HFT and Discretionary businesses they're now looking to hire an experienced Software Engineer/Data Engineer to work closely with Trading, Quant Research, and parallel Technology teams. This is a fast-paced, collaborative and innovative environment, suited to individuals … both autonomously and as part of a vibrant rapidly expanding group. Your focus will be the design, building and implementation of advanced Big Data solutions, to enable the capture, ingestion, storage, and provision of Terabyte sized Alternate Datasets. Tools you'll create include ETL/ELT Data Pipelines and Frameworks APIs Data Store Candidate's suitable for this role, will ideally have 3-8 yrs' of blended Data Engineering and Software Engineering skills, include ETL/ELT pipelines for High throughput (and Low Latency Data) Expert Python skills including More ❯