101 to 125 of 163 Data Pipeline Jobs in the City of London

build seamless user experiences What will the Senior Product Engineer bring? Strong Back End development expertise with Node.js and Typescript Experience designing secure, scalable Back End systems (authentication, data pipelines, APIs) Familiarity with modern cloud infrastructure (GCP or AWS) Ability to communicate technical ideas clearly and influence team direction A passion for building high-quality products that customers More ❯

A growing global macro hedge fund is seeking a Technology Associate/Data Engineer to join its lean, high-impact technology team in London. The firm combines an entrepreneurial culture with institutional backing and is known for empowering talented individuals to take ownership, innovate, and shape its future. This is a hands-on engineering role at the intersection … of technology, data, and business operations . You’ll work directly with teams across Trading, Risk, Operations, Finance, and Compliance to build tools, automate processes, and enhance the firm’s data and reporting infrastructure. The successful candidate will be someone who combines strong technical skills with curiosity, pragmatism, and drive — someone who takes pride in engineering … fundamentals, thrives in a small team, and wants to see the commercial impact of their work. Key Responsibilities Develop, maintain, and enhance data pipelines and ETL processes using Python and SQL. Manage and integrate API connections and FTP data feeds into internal systems. Build and support dashboards and reports to provide visibility across trading and operations. More ❯

A growing global macro hedge fund is seeking a Technology Associate/Data Engineer to join its lean, high-impact technology team in London. The firm combines an entrepreneurial culture with institutional backing and is known for empowering talented individuals to take ownership, innovate, and shape its future. This is a hands-on engineering role at the intersection … of technology, data, and business operations . You’ll work directly with teams across Trading, Risk, Operations, Finance, and Compliance to build tools, automate processes, and enhance the firm’s data and reporting infrastructure. The successful candidate will be someone who combines strong technical skills with curiosity, pragmatism, and drive — someone who takes pride in engineering … fundamentals, thrives in a small team, and wants to see the commercial impact of their work. Key Responsibilities Develop, maintain, and enhance data pipelines and ETL processes using Python and SQL. Manage and integrate API connections and FTP data feeds into internal systems. Build and support dashboards and reports to provide visibility across trading and operations. More ❯

where execution speed and technical depth matter. What You’ll Do Design and implement large-scale agentic AI systems and intelligent orchestration layers. Work across the stack, from data pipelines to model deployment and real-time inference. Build tools and infrastructure that empower ML teams to deploy and iterate faster. Collaborate directly with founders on architecture, strategy, and More ❯

where execution speed and technical depth matter. What You’ll Do Design and implement large-scale agentic AI systems and intelligent orchestration layers. Work across the stack, from data pipelines to model deployment and real-time inference. Build tools and infrastructure that empower ML teams to deploy and iterate faster. Collaborate directly with founders on architecture, strategy, and More ❯

and optimal ‘next task’ Build fully-automated pipelines for dictionary building; including span identification, word sense distribution, and sense granularity decision Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries and train models to determine the difficulty of … words, idioms, phrasal verbs etc. Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather more test results, analyse them, and build prediction models based on these results … Optimise and fine-tune machine learning models for performance, scalability, and accuracy Essential skills 🙏 Strong expertise in NLP Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Strong understanding of neural networks, CNNs, RNNs, LSTMs, and transformers Experience building automated data pipelines Hands-on experience with LLM More ❯

and optimal ‘next task’ Build fully-automated pipelines for dictionary building; including span identification, word sense distribution, and sense granularity decision Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries and train models to determine the difficulty of … words, idioms, phrasal verbs etc. Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create new types of tests for language learners to gather more test results, analyse them, and build prediction models based on these results … Optimise and fine-tune machine learning models for performance, scalability, and accuracy Essential skills 🙏 Strong expertise in NLP Complete end-to-end experience - from finding and cleaning data all the way to monitoring models in production Strong understanding of neural networks, CNNs, RNNs, LSTMs, and transformers Experience building automated data pipelines Hands-on experience with LLM More ❯

client is looking for a seasoned analytics leader to head it's global Product Analytics function. You will define the vision, scale a high-performing team, and ensure data-driven insights drive product strategy and business growth. This role requires a mix of technical depth, leadership excellence, and the ability to turn data into clear, actionable … for senior stakeholders. Key Responsibilities Team Leadership & Growth Lead and expand the Product Analytics team across multiple domains and global locations. Hire, coach, and develop analysts into effective data storytellers who deliver actionable insights. Foster a culture of ownership, collaboration, and high performance. Analytics Strategy & Execution Define and execute the analytics strategy, making data a competitive … advantage. Partner with senior leadership to ensure analytics directly influence business and product direction. Manage project intake, prioritize initiatives, and allocate resources against strategic priorities. Data-Driven Insights & Enablement Define and maintain critical business metrics to track performance and inform decisions. Design and run experiments, build dashboards, and create visualizations that communicate results at scale. Provide technical mentorship More ❯

Role: Business Analyst – Retention Data (EMEA) 📍 Location: Hybrid – London (3 days office/2 days remote) ⏳ Contract Length: 12 months minimum 💰 Day Rate: £260/day (Inside IR35) I’m hiring for a Business Analyst – Retention Data to join a leading global tech company known for empowering businesses with cutting-edge financial tools and services. This … contract (minimum) with hybrid working 3 days per week in the London office, 2 days remote . ** MUST HAVE ** 1: Within your experience and clearly on your CV: Data Insight, what impact did you make. 2: We are looking for someone who can display on their CV that has analysed data they have pulled and can … more than just a reporting role, it’s an opportunity to use your skills in SQL, Python, and BI tools (e.g., Tableau/Qlik) to influence strategy, close data gaps, and directly impact customer outcomes. Key Responsibilities: Build and automate scalable reporting solutions focused on customer retention Create and present dashboards combining internal and external data More ❯

for a driven and curious Graduate AI Engineer to join our hybrid-working team in London . You’ll be part of a collaborative group of engineers and data scientists developing and deploying cutting-edge AI solutions that make a real impact. This is a fantastic opportunity for a recent graduate or early-career professional with up to … one year of experience who’s passionate about machine learning, data, and building intelligent systems that solve real-world problems. In this role, you’ll: 🧠 Design, train, and evaluate machine learning and deep learning models for real-world applications 🛠 Support the development and optimisation of AI pipelines — from data preprocessing to model deployment 📊 Experiment with techniques … across NLP, computer vision, and predictive analytics 🤝 Collaborate with data engineers and software developers to integrate AI solutions into scalable products 💡 Research emerging AI trends and contribute fresh ideas to improve models and workflows What’s in it for you? 📈 Career Growth – Develop your technical expertise through hands-on mentorship and continuous learning opportunities. ⚙ Real-World Impact – Work More ❯

for a driven and curious Graduate AI Engineer to join our hybrid-working team in London . You’ll be part of a collaborative group of engineers and data scientists developing and deploying cutting-edge AI solutions that make a real impact. This is a fantastic opportunity for a recent graduate or early-career professional with up to … one year of experience who’s passionate about machine learning, data, and building intelligent systems that solve real-world problems. In this role, you’ll: 🧠 Design, train, and evaluate machine learning and deep learning models for real-world applications 🛠 Support the development and optimisation of AI pipelines — from data preprocessing to model deployment 📊 Experiment with techniques … across NLP, computer vision, and predictive analytics 🤝 Collaborate with data engineers and software developers to integrate AI solutions into scalable products 💡 Research emerging AI trends and contribute fresh ideas to improve models and workflows What’s in it for you? 📈 Career Growth – Develop your technical expertise through hands-on mentorship and continuous learning opportunities. ⚙ Real-World Impact – Work More ❯

Miryco Consultants are working on behalf of a market leading investment manager to hire a Data & AI Risk Analyst to join their second line Technology Risk team. This is a fantastic opportunity for a risk professional early in their career to specialise in a highly topical area, whilst gaining wider experience of working in a high-performance culture. … Responsibilities: Support the review and monitoring of risks related to data platforms, cloud environments, and emerging AI technologies. Assist in analysing technology incidents, change activities, and control testing to identify potential risk exposures. Contribute to the development of risk reporting, dashboards, and governance materials. Help assess how AI, automation, and data tools are being used across … the business from a risk perspective. Work with senior risk managers and engineers to promote strong data governance and AI control practices. Stay up to date with developments in AI, data protection, and tech regulation to help shape risk oversight. Experience & Skills: Early career professional or recent graduate with experience or academic background in data More ❯

with an organisation that’s passionate about your learning journey and committed to your professional career and personal development. Lead Technology Integration Workstream Drive the financial planning and data integration workstream within a broader transformation or modernization program. Align integration strategy with enterprise financial systems, ensuring data accuracy and consistency across planning, reporting, and forecasting platforms. … maintain a detailed roadmap covering milestones, dependencies, and risk mitigation plans. Oversee day-to-day execution, ensuring timely delivery and adherence to scope, quality, and compliance standards. Drive Data Integration, Migration, and Validation Lead the design and execution of data migration, validation, and reconciliation processes to support accurate financial and operational reporting. Collaborate with data and technology teams to ensure robust, secure data pipelines between core systems (e.g., ERP, EPM, data warehouse). Cross-Functional Coordination Serve as the bridge between Finance, Operations, Technology, and Data teams to ensure alignment on priorities, requirements, and timelines. Communicate effectively with stakeholders at all levels, translating technical concepts into actionable More ❯

with an organisation that’s passionate about your learning journey and committed to your professional career and personal development. Lead Technology Integration Workstream Drive the financial planning and data integration workstream within a broader transformation or modernization program. Align integration strategy with enterprise financial systems, ensuring data accuracy and consistency across planning, reporting, and forecasting platforms. … maintain a detailed roadmap covering milestones, dependencies, and risk mitigation plans. Oversee day-to-day execution, ensuring timely delivery and adherence to scope, quality, and compliance standards. Drive Data Integration, Migration, and Validation Lead the design and execution of data migration, validation, and reconciliation processes to support accurate financial and operational reporting. Collaborate with data and technology teams to ensure robust, secure data pipelines between core systems (e.g., ERP, EPM, data warehouse). Cross-Functional Coordination Serve as the bridge between Finance, Operations, Technology, and Data teams to ensure alignment on priorities, requirements, and timelines. Communicate effectively with stakeholders at all levels, translating technical concepts into actionable More ❯

This team leverages technical expertise in actuarial modelling, statistical analysis, and risk management solutions to support a high-impact team of 90+ underwriters. You will build and maintain data pipelines and data models to elevate the Analytics team and help answer the most difficult business challenges. Key requirements Experience in the London or Lloyd's insurance … markets is essential Have an Advanced degree in Statistics, Computer Science, Mathematics or a related field or relevant industry industry experience Have knowledge of programming and data manipulation skills such as SQL and Python, and version control (Github) is essential Experience building multi-step ETL jobs/data pipelines and working with job scheduling systems is … a plus Demonstrated ability to thrive with minimal oversight and process. You connect the dots across business needs and independently drive projects forward Have strong data visualization skills and experience with Power BI is a bonus Have experience with cloud technologies, preferably Microsoft Azure More ❯

unlock the value of technology and build a more sustainable, more inclusive world. Your Role We are looking for a skilled Spark/Scala Developer to join our data engineering team. The ideal candidate will have hands-on experience in designing, developing, and maintaining large-scale data processing pipelines using Apache Spark and Scala. You will … work closely with data scientists, analysts, and engineers to build efficient data solutions and enable data-driven decision-making. Key Responsibilities: Develop, optimize, and maintain data pipelines and ETL processes using Apache Spark and Scala. Design scalable and robust data processing solutions for batch and real-time data. Collaborate with … cross-functional teams to gather requirements and translate them into technical specifications. Perform data ingestion, transformation, and cleansing from various structured and unstructured sources. Monitor and troubleshoot Spark jobs, ensuring high performance and reliability. Write clean, maintainable, and well-documented code. Participate in code reviews, design discussions, and agile ceremonies. Implement data quality and governance best More ❯

unlock the value of technology and build a more sustainable, more inclusive world. Your Role We are looking for a skilled Spark/Scala Developer to join our data engineering team. The ideal candidate will have hands-on experience in designing, developing, and maintaining large-scale data processing pipelines using Apache Spark and Scala. You will … work closely with data scientists, analysts, and engineers to build efficient data solutions and enable data-driven decision-making. Key Responsibilities: Develop, optimize, and maintain data pipelines and ETL processes using Apache Spark and Scala. Design scalable and robust data processing solutions for batch and real-time data. Collaborate with … cross-functional teams to gather requirements and translate them into technical specifications. Perform data ingestion, transformation, and cleansing from various structured and unstructured sources. Monitor and troubleshoot Spark jobs, ensuring high performance and reliability. Write clean, maintainable, and well-documented code. Participate in code reviews, design discussions, and agile ceremonies. Implement data quality and governance best More ❯

opportunity to take on a high-impact, hands-on leadership role within a scaling global SaaS company that’s using AI to reinvent how internal business systems and data work together. As a Staff Software Engineer (AI/ML) , you’ll be the technical lead for a newly formed AI Engineering function , designing and delivering the internal AI … and data infrastructure that supports smarter decision-making across the organisation. You’ll build and scale AI-powered backend systems that connect enterprise data platforms (CRM, analytics, and communication tools) with large language models — creating intelligent tools and insights that enhance the way teams operate. This is a role with real influence: you’ll own the … adopted across the company. What You’ll Do Lead the design, architecture, and implementation of internal AI/ML systems for business intelligence. Build robust APIs, microservices, and data pipelines to power intelligent, data-driven tools. Develop retrieval-augmented generation (RAG) systems using vector databases for contextual AI. Set the technical direction for backend and AI More ❯

opportunity to take on a high-impact, hands-on leadership role within a scaling global SaaS company that’s using AI to reinvent how internal business systems and data work together. As a Staff Software Engineer (AI/ML) , you’ll be the technical lead for a newly formed AI Engineering function , designing and delivering the internal AI … and data infrastructure that supports smarter decision-making across the organisation. You’ll build and scale AI-powered backend systems that connect enterprise data platforms (CRM, analytics, and communication tools) with large language models — creating intelligent tools and insights that enhance the way teams operate. This is a role with real influence: you’ll own the … adopted across the company. What You’ll Do Lead the design, architecture, and implementation of internal AI/ML systems for business intelligence. Build robust APIs, microservices, and data pipelines to power intelligent, data-driven tools. Develop retrieval-augmented generation (RAG) systems using vector databases for contextual AI. Set the technical direction for backend and AI More ❯

enterprise-scale systems. Role & Responsibilities: Lead the design and delivery of enterprise applications and reporting systems Develop tools for dashboards, analytics, and operational monitoring Build and maintain APIs, data pipelines, and automation for business processes Implement scalable solutions to improve operational efficiency and data quality Enhance and integrate commercial off-the-shelf (COTS) platforms where required … automation, and Agile delivery Knowledge of compliance, regulatory reporting, and enterprise operational processes Proven experience delivering complex software solutions Strong leadership and stakeholder management skills Bonus: Python, Azure Data Factory/Databricks, data analysis, and COTS platforms Package: £85,000 15% non-contributory pension Hybrid working (3 days per week) Performance-based bonus scheme Comprehensive benefits More ❯

a Technical Business Analyst with deep knowledge of insurance pricing and underwriting systems to bridge the gap between actuarial, product and engineering teams. You’ll gather requirements, design data flows, and help implement pricing models, APIs and analytical capabilities that drive better underwriting decisions. Key Responsibilities: Define and document requirements for pricing system integrations, model deployment and API … workflows. Translate pricing models (Excel/Python/R) into technical specifications for developers and data engineers. Collaborate with underwriters and actuaries to improve model governance, version control and reporting. Support UAT, model validation and release testing. Deliver insights and metrics around model performance, quote success and underwriting efficiency. Partner with insurers and MGAs to streamline pricing and … a Business Analyst or Technical Analyst role within insurance, reinsurance or InsurTech. Experience with pricing or rating systems, underwriting workflows or model integration projects. Strong understanding of insurance data structures, rating factors and model governance. Skilled in SQL and BI tools (Power BI, Tableau, Looker). Comfortable working with APIs, data pipelines and collaborating with developers. More ❯

a Technical Business Analyst with deep knowledge of insurance pricing and underwriting systems to bridge the gap between actuarial, product and engineering teams. You’ll gather requirements, design data flows, and help implement pricing models, APIs and analytical capabilities that drive better underwriting decisions. Key Responsibilities: Define and document requirements for pricing system integrations, model deployment and API … workflows. Translate pricing models (Excel/Python/R) into technical specifications for developers and data engineers. Collaborate with underwriters and actuaries to improve model governance, version control and reporting. Support UAT, model validation and release testing. Deliver insights and metrics around model performance, quote success and underwriting efficiency. Partner with insurers and MGAs to streamline pricing and … a Business Analyst or Technical Analyst role within insurance, reinsurance or InsurTech. Experience with pricing or rating systems, underwriting workflows or model integration projects. Strong understanding of insurance data structures, rating factors and model governance. Skilled in SQL and BI tools (Power BI, Tableau, Looker). Comfortable working with APIs, data pipelines and collaborating with developers. More ❯

Hiring: Data Engineer | Mission-Driven Fintech | Remote (UK based) 🚀 Propel are proud to be partnering with a rapidly scaling global fintech that’s transforming financial access for immigrants and international communities across the world. 📈 As their lending business continues to grow, they're looking for a Data Engineer to help scale the data infrastructure … that powers smarter, fairer credit decisions. 🧠 If you're passionate about building robust data pipelines, enabling real-time underwriting, and turning complex datasets into production-ready insights — this is your chance to work at the heart of a mission-driven business. ✅ What you'll bring: - 4+ years as a Data Engineer (ideally in fintech/lending … Strong SQL, Python, Snowflake, dbt, Dagster - Experience with credit bureau data, open banking APIs - A love for clean, scalable data systems in fast-moving environments Sound like you or someone you know? 📩 Drop me a message or apply directly – I’d love to tell you more More ❯

of 12 months ending December 2024 totaled $13.8 billion. Experience : Minimum 10+ Years Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Specialization in designing and implementing large-scale data pipelines, ETL processes, and distributed systems Should be able to work independenty with minimal help/guidance Good Understanding of Airflow,Data Fusion and Data Flow Strong Background and experience in Data Ingestions,Transformation,Modeling and Performance tuning. One migration Experience from Cornerstone to GCP will be added advantage Suppport the design and development of BigData echosystem Experience in building complex SQL Queries Strong Communication Skills More ❯

engineer seeking a role where your expertise directly drives business success and personal rewards. Ideal candidates will have some Banking/Financial Background and Trade Floor/Market Data Support experience and whilst predominantly Windows candidates must have some Linux with any E-Trading experience highly beneficial. Role Overview: Provide day-to-day Technical Support of Traders and … CI/CD, containerization, infrastructure as code) Cloud platforms experience beyond basic administration (AWS, Azure, GCP) Experience integrating AI or automation into operational workflows (e.g., monitoring, alerting, or data pipelines) Some knowledge of Atlassian Jira & Confluence Interest in emerging technologies (AI/ML, blockchain, IoT, edge computing) Open-source contributions or personal tech projects you're proud of … Other Highly Desirable Skills: Previous Application Support - Ideally Trading/Market Data - Futures & Options Trading/Settlement Systems advantageous Some Networking - Routers, Switches and Firewalls including Cisco - able to configure and troubleshoot mid-range switches and set up/troubleshoot VLANs Strong Linux/Unix System Administration Beneficial - RedHat, Ubuntu, Solaris. Core understanding of Databases - SQL Server/ More ❯