251 to 275 of 383 Data Ingestion Jobs in England

You will need to be self-directed, action-oriented, and comfortable making high-impact decisions quickly. Your focus will include consulting on new product developments, refining complex real-time data pipelines handling millions of data points, and driving operational excellence across our SaaS platform. Key Responsibilities: Production Ownership: Manage and optimise our live software environment, ensuring stability, scalability … Leadership: Consult on new feature and product development, integrating these into the existing production infrastructure with minimal disruption. Performance Optimisation: Continuously monitor, benchmark, and enhance system performance and reliability. Data Pipeline Management: Oversee and improve our extensive real-time data ingestion pipelines, ensuring they are resilient, scalable, and future proof. Process Innovation: Identify and implement improvements across … on ability to execute technical solutions. Passion for continuous learning, improvement, and operational excellence. Deep technical expertise in: Databases such as MySQL, Singlestore, and BigQuery. Real-time, high-throughput data pipelines. Cloud platforms, particularly Google Cloud. What we offer: Supportive, friendly colleagues who work together to achieve shared goals and contribute directly to mission-critical systems that underpin the More ❯

and ensure the environment is compliant. Evaluate and pilot emerging capabilities such as Microsoft Copilot and AI-driven productivity tools. Oversee the operational integrity, performance, and availability of core data platforms and pipelines that support reporting, analytics, and AI readiness across the firm. Collaborate closely with the Data & AI teams to ensure cloud infrastructure supports scalable, secure, and … reliable data ingestion, transformation, and delivery. Budgeting & Licensing Own and manage the platform budget, ensuring efficient use of resources and cost optimisation. Manage and forecast consumption charges, ensuring compliance and maximising license utilisation. Liaise with procurement, finance, and vendors for renewals and cost planning. Governance, Risk & Compliance Define and enforce policies for workload management and governance across our … cloud estate. Maintain compliance with internal policies and regulatory requirements. Ensure data governance best practices across cloud environment. Stakeholder Engagement Collaborate with business units, Technology senior leadership team, and product teams to gather requirements and improve platform services. Champion change management initiatives that drive behavioural adoption of digital tools across the firm. Act as an evangelist for Modern cloud More ❯

and ensure the environment is compliant. Evaluate and pilot emerging capabilities such as Microsoft Copilot and AI-driven productivity tools. Oversee the operational integrity, performance, and availability of core data platforms and pipelines that support reporting, analytics, and AI readiness across the firm. Collaborate closely with the Data & AI teams to ensure cloud infrastructure supports scalable, secure, and … reliable data ingestion, transformation, and delivery. Budgeting & Licensing Own and manage the platform budget, ensuring efficient use of resources and cost optimisation. Manage and forecast consumption charges, ensuring compliance and maximising license utilisation. Liaise with procurement, finance, and vendors for renewals and cost planning. Governance, Risk & Compliance Define and enforce policies for workload management and governance across our … cloud estate. Maintain compliance with internal policies and regulatory requirements. Ensure data governance best practices across cloud environment. Stakeholder Engagement Collaborate with business units, Technology senior leadership team, and product teams to gather requirements and improve platform services. Champion change management initiatives that drive behavioural adoption of digital tools across the firm. Act as an evangelist for Modern cloud More ❯

Data Engineer – Crypto Client, London, Hybrid, £Competitive We're hiring on behalf of a leading crypto client for an experienced Data Engineer to join their fast-growing team in London. This is an exciting opportunity to work on cutting-edge blockchain data infrastructure in a highly dynamic environment. What We're Looking For: 5+ years of engineering … experience Strong expertise in data engineering: – Proficient in Python , Spark – Advanced SQL skills Proven experience with data ingestion pipelines Hands-on with cloud platforms – ideally AWS Solid experience working with Big Data and time series databases You’ll be part of a team shaping the future of decentralized finance through robust, scalable data systems. Apply More ❯

Data Engineer – Crypto Client, London, Hybrid, £Competitive We're hiring on behalf of a leading crypto client for an experienced Data Engineer to join their fast-growing team in London. This is an exciting opportunity to work on cutting-edge blockchain data infrastructure in a highly dynamic environment. What We're Looking For: 5+ years of engineering … experience Strong expertise in data engineering: – Proficient in Python , Spark – Advanced SQL skills Proven experience with data ingestion pipelines Hands-on with cloud platforms – ideally AWS Solid experience working with Big Data and time series databases You’ll be part of a team shaping the future of decentralized finance through robust, scalable data systems. Apply More ❯

Design, implement, and support full life-cycle data engineering projects including large data ingestion, persistence, transformation, and retrieval. Design, develop, and maintain multiple code bases to service realtime data over a distributed data pipeline. Responsible for Kubernetes deployments and namespaces, MemSQL and Oracle databases, Victoria Metrics instances, on-prem S3, and codebases in Python, Typescript … and Kotlin. Maintain and manage pipeline between real-time data from streaming/non-streaming data sources such as Apache Pulsar/Oracle/MemSQL to application data stores and services. JOB REQUIREMENTS MINIMUM EDUCATION: Bachelor's Degree in Computer Science, CIS, MIS or Information Technology. MINIMUM EXPERIENCE: Five (5) years of experience as Data Engineer … Engineer, Oracle Engineer, Systems Engineer, or Software Engineer. ALTERNATE EDUCATION: Master's Degree in Computer Science, CIS, MIS, or Information Technology. ALTERNATE EXPERIENCE: Three (3) years of experience as Data Engineer, Database Engineer, Oracle Engineer, Systems Engineer, or Software Engineer. SPECIAL REQUIREMENTS: The required five (5) years of experience with a Bachelor's degree or three (3) years of More ❯

across various asset classes. They have grown into a global firm with offices in major financial hubs, including New York, Chicago, London, and Hong Kong. They have a very Data-Driven Culture with a heavy focus on technology, data science, and research. They're hiring for their enterprise data team who are building a cloud native data platform used by data analysts, scientists, and quantitative investors. The platform involves technologies like Docker, Kubernetes, REST APIs, and multi-language client libraries. Key Responsibilities: Build cloud-based, distributed data solutions. Understand and prioritize investment data needs. Collaborate with users and team members to refine requirements. Design high-performance data ingestion and delivery systems. … and infrastructure-as-code . API design experience; front-end experience with React is a plus. Cloud experience (especially AWS ) is highly valued. Additional Requirements: Experience working within the data space within a Hedge Fund Environment Happy to work onsite 4 days a week in central London Educated to Degree Level, ideally Computer Science or similar. More ❯

across various asset classes. They have grown into a global firm with offices in major financial hubs, including New York, Chicago, London, and Hong Kong. They have a very Data-Driven Culture with a heavy focus on technology, data science, and research. They're hiring for their enterprise data team who are building a cloud native data platform used by data analysts, scientists, and quantitative investors. The platform involves technologies like Docker, Kubernetes, REST APIs, and multi-language client libraries. Key Responsibilities: Build cloud-based, distributed data solutions. Understand and prioritize investment data needs. Collaborate with users and team members to refine requirements. Design high-performance data ingestion and delivery systems. … and infrastructure-as-code . API design experience; front-end experience with React is a plus. Cloud experience (especially AWS ) is highly valued. Additional Requirements: Experience working within the data space within a Hedge Fund Environment Happy to work onsite 4 days a week in central London Educated to Degree Level, ideally Computer Science or similar. More ❯

onsite) About Our Client: Our client is a leading name in digital publishing, known for high-impact journalism and a bold approach to audience engagement. As they deepen their data maturity, they’re investing in digital analytics infrastructure to power smarter decisions across subscriptions, marketing, and content. With a major GA4 migration underway, this is a critical time to … shape their long-term data architecture. The Marketing and Digital Analytics Engineer will own the analytics and tracking layer across digital marketing channels, with a sharp focus on implementing and scaling GA4. You’ll manage data ingestion from ad platforms like Google Ads and Meta, building pipelines and clean schemas that empower the business with accurate attribution … and actionable insights. Essential Skills: Deep hands-on GA4 experience, including setup, tracking plans, and migration best practices Strong SQL and data pipeline experience (dbt, Airflow, or similar) Proven ability to ingest and unify data from Google Ads, Meta Ads, and other adtech sources Comfortable working with marketing stakeholders to define event tracking and campaign analytics Experience in More ❯

onsite) About Our Client: Our client is a leading name in digital publishing, known for high-impact journalism and a bold approach to audience engagement. As they deepen their data maturity, they’re investing in digital analytics infrastructure to power smarter decisions across subscriptions, marketing, and content. With a major GA4 migration underway, this is a critical time to … shape their long-term data architecture. The Marketing and Digital Analytics Engineer will own the analytics and tracking layer across digital marketing channels, with a sharp focus on implementing and scaling GA4. You’ll manage data ingestion from ad platforms like Google Ads and Meta, building pipelines and clean schemas that empower the business with accurate attribution … and actionable insights. Essential Skills: Deep hands-on GA4 experience, including setup, tracking plans, and migration best practices Strong SQL and data pipeline experience (dbt, Airflow, or similar) Proven ability to ingest and unify data from Google Ads, Meta Ads, and other adtech sources Comfortable working with marketing stakeholders to define event tracking and campaign analytics Experience in More ❯

turning down headhunters for years. Whatever your priorities – work/life balance, career progression, sustainability, volunteering – you’ll find like-minded people driving change at Howden. Position: Master & Reference Data Management Steward Howden is evolving its Master and Reference data capability to provide a wider service to the organisation, so that trusted and enriched master and reference data entities are in place, enabling effective business operations and providing richer analytical capabilities. The Group Data Management function is accountable for mastering the Group’s common critical data domains covering Party, Lloyd’s Market, Industry, Business Unit, Product and Geography utilising Howden’s strategic master data management solution, Reltio. The overall goal is to ensure the … critical data is appropriately governed through data stewardship and mastered to create a unique and enriched golden record. This enables the business to perform its critical operational processes more efficiently and provide greater insights to support new business opportunities. The job holder will also act as an SME supporting Howden’s use of external company enrichment data More ❯

does not have a signed agreement with Sensor Tower. About this role: Sensor Tower is the leading provider of market intelligence and insights for the mobile app ecosystem. Our data-driven solutions empower businesses, developers, and marketers to make informed decisions and stay ahead in the competitive mobile landscape. We're looking for a Software Engineer to join our … Data Fetching Team, which is responsible for building and maintaining the systems that collect public data from third-party sources. In this role, you'll contribute to the development and upkeep of reliable and compliant data ingestion pipelines that support key data flows across the company. You'll work alongside other engineers on the Fetcher … Team to ensure the accuracy, stability, and scalability of our data collection processes. Your work will support internal stakeholders across product, analytics, and business teams. What you will focus on Participate in the full development life cycle for data ingestion projects, including software design, implementation, quality testing, and release. Engage in code reviews, champion best practices, and More ❯

Data Architect Manager Reference: FEB20250883 Expiry date: 12:39, Fri, 28th Mar 2025 Location: Hightown House Benefits: Pension, Bonus, Car Parking, On Site Gym Hemel Hempstead – Hybrid (3 days in the office) Hightown is about to start building its new cloud data environment and transitioning from its on-premises estate to enable faster and more powerful insights. This … is a new role to manage a newly created team to lead that journey, but it will be hands-on and technology-driven. We’re looking for a data professional who is well-rounded, highly experienced, and has solid data architecture, data ingestion, and data warehousing experience. This is an exciting opportunity for an individual … who wants to create something special. The successful candidate will confidently lead and mentor a team of data developers whilst designing and managing Hightown’s data environment. Key Responsibilities: Architecting and designing solutions in a cloud-native data environment. Guide and coach data developers to foster a collaborative and innovative environment to drive success. Develop and More ❯

Join to apply for the AI Data Engineering Lead role at Moonvalley Continue with Google Continue with Google Join to apply for the AI Data Engineering Lead role at Moonvalley Get AI-powered advice on this job and more exclusive features. Sign in to access AI-powered advices Continue with Google Continue with Google Continue with Google Continue … edge generative AI models designed to power Superbowl-worthy commercials and award-winning cinematic experiences. Our inaugural, cutting-edge HD model, Marey, is built on exclusively licensed and owned data for professional use in Hollywood and enterprise applications. Our team is an unprecedented convergence of talent across industries. Our elite AI scientists from Deepmind, Google, Microsoft, Meta & Snap, have … we’ve raised over $70M from world-class investors including General Catalyst, Bessemer, Khosla Ventures & YCombinator – and we’re just getting started. Role Summary We’re looking for a Data Engineering Lead to architect and scale the data pipelines that power our next-generation generative video models. This role is central to our mission of training models exclusively More ❯

Job Description Find out if this opportunity is a good fit by reading all of the information that follows below. Join JPMorgan Chase's Chief Data & Analytics Office (CDAO) and be part of a mission to modernize compliance through scalable and explainable AI. As a Machine Learning Engineer, you'll design and build systems that answer critical data usage questions with prediction, logic, proof, and intelligent automation. Work at the intersection of applied machine learning, AI reasoning systems, and data governance to tackle complex problems and build ML solutions that make decisions. As a Machine Learning Engineer within JPMorgan Chase's Chief Data & Analytics Office (CDAO), you will design and build systems that answer critical … data usage questions with prediction, logic, proof, and intelligent automation. You will work at the intersection of applied machine learning, AI reasoning systems, and data governance to tackle complex problems and build ML solutions that make decisions. You will build and integrate ML models into structured backend services, write production-ready Python code, and assist in building automated More ❯

role As an Engineering Manager, you will lead across several product teams managing up to ~10 engineers (including Tech Leads). This role will support our vegetation modelling and data ingestion domains as we seek to improve our underlying models and expand the number of data sources we can reliably turn into vegetation intelligence. Our product teams … are cross functional and will typically include: product managers, designers, engineers, data scientists and subject matter experts relating to the teams domain. You will be accountable for the technical and delivery outcomes of your area. You will challenge your teams to achieve ambition goals whilst providing a high level of support through growing engineering talent and creating a highly … dive deep technically when required and leverage your extensive experience as an engineer to drive good technical decisions and solutions. What you will do Enable our Vegetation Modelling and Data Ingestion teams to become highly productive cross-functional teams that ship a high quality product on a daily basis. Grow the teams by attracting great talent from your More ❯

You will need to be self-directed, action-oriented, and comfortable making high-impact decisions quickly. Your focus will include consulting on new product developments, refining complex real-time data pipelines handling millions of data points, and driving operational excellence across our SaaS platform. Key Responsibilities: Production Ownership: Manage and optimise our live software environment, ensuring stability, scalability … Leadership: Consult on new feature and product development, integrating these into the existing production infrastructure with minimal disruption. Performance Optimisation: Continuously monitor, benchmark, and enhance system performance and reliability. Data Pipeline Management: Oversee and improve our extensive real-time data ingestion pipelines, ensuring they are resilient, scalable, and future proof. Process Innovation: Identify and implement improvements across … SaaS environment. Experience in high-growth startup or scale-up businesses is highly desirable. Deep technical expertise in: Databases such as MySQL, Singlestore, and BigQuery. Real-time, high-throughput data pipelines. Cloud platforms, particularly Google Cloud. Strong understanding of software engineering best practices, feature deployment processes and testing. Ability to drive rapid decision-making, manage competing priorities, and deliver More ❯

The ideal candidate will have extensive hands-on experience building and implementing ELK solutions from the ground up-not just monitoring existing systems. Key Responsibilities: Design, build, and implement data ingestion pipelines using Logstash and Kafka Set up and configure the ELK Stack (Elasticsearch, Logstash, Kibana), including Fleet and Integrations Collaborate with stakeholders to analyze data and … insights Ensure performance, availability, and reliability of the ELK environment Maintain and support the ELK stack and its integrations Apply domain knowledge in security and cloud environments to enhance data pipeline resilience and compliance Mandatory Skills & Qualifications: 8+ years of hands-on experience with Elasticsearch , Logstash , and Kibana Proven track record of implementing and maintaining ELK stacks Experience designing … and developing data pipelines Strong exposure to cloud platforms (e.g., AWS, Azure, GCP) Proficiency with Kafka for data streaming and ingestion Background or familiarity in the security domain Deep understanding of ELK ecosystem components including Fleet , Beats , and advanced Kibana dashboards Strong problem-solving and analytical skills Desirable: Experience with Elastic Security or Observability solutions Certification in More ❯

Miami, London, and Singapore to develop risk analytics solutions for our businesses (fixed income, commodities, equities, etc.) Build, enhance, and maintain existing Java REST services and related systems Develop data ingestion pipelines and core data systems to provide risk management with programmatic access to analytics as well as via web interfaces Create and manage cloud applications on … and Risk Managers Required skills/experience: Strong analytical and mathematical skills, with interest and/or exposure to quantitative finance Good understanding of various design patterns, algorithms, and data structures Substantial experience with modern Java Experience with REST APIs and cloud services Relational SQL database development experience Unix/Linux command-line experience Ability to work independently in … a fast-paced environment Detail-oriented, organized, demonstrating thoroughness and strong ownership of work Desirable skills/experience: Experience working with Python and data analysis libraries (pandas, polars, numpy) Experience with financial mathematics, statistics, and a broad understanding of financial instruments and services Experience in JavaScript development, especially with AngularJS or ReactJS AWS cloud services: EC2, S3, Aurora, Redshift More ❯

Design, build, and refine dashboards focusing on profit and loss, margin analysis, cost control, and operational KPIs across the Group. Enhance existing dashboards to integrate with the new Microsoft Data Links repository, replacing scheduled refreshes with live data feeds. Use Power Query (M language) for data ingestion and transformation. Develop advanced DAX measures, including time intelligence … calculations, dynamic reporting layers, and calculated tables. Manage the full dashboard development lifecycle, from stakeholder engagement and data modelling to prototyping, visualisation, and deployment. Collaborate with the incoming FP&A Manager, Group Financial Controller, and finance leads across business units to gather requirements and shape outputs. Ensure dashboards are user-friendly, commercially relevant, and actionable for both finance and … non-finance users. Work alongside internal ERP and data teams (who manage SQL and connectors) to maintain data consistency with Unit4 and Tagetik systems. Provide ad-hoc support for wider reporting and transformation projects, including benchmarking and Group-level insights. The Successful Applicant Demonstrated experience in designing finance-focused dashboards using Power BI, preferably in a group or More ❯

We are currently looking for a Power BI Self-Service Lead to join the innovative and dynamic Data Tech team. You'll be part of a renowned organisation, working on solutions that serve a wide audience of loyal customers and colleagues. With strong ethical values and technology leaders who truly understand data platforms and management, this is an … exciting time to join as we evolve into a digital-first, data-led organisation. As Power BI Self-Service Lead, you'll play a key role in this transformation, reporting directly to our Data Platform Manager. The Opportunity In this role, you'll drive responsible usage of our newly built data platform, ensuring it evolves with cutting … and enhancing our Lab proposition, you'll foster a culture of innovation, develop governance frameworks, and implement tools that provide consistent, supportable solutions for activities such as self-service data ingestion and transitioning processes from Lab to Factory. Key responsibilities include: Drive Innovation : Lead the development and delivery of our Lab proposition to elevate practitioner self-service and More ❯

looking for a Backend Engineer . You will: Develop and support AI pipelines with computer vision ML-derived geospatial assets leveraging Kubernetes cloud services in GCP and Azure. Massive data ingestion pipelines to ensure a continuous and reliable flow of image/video/GIS data into cloud-based datastores. Massive geospatial asset curation, management, and conversion … Bring to The Team: BS in computer science or equivalent degree or relevant professional work experience. At least 5 years’ experience as a software engineer with specific experience in data engineering. Understanding of Kubernetes and deployment of distributed data pipelines include key concerns with building distributed data pipelines such as concurrency, idempotent operation, and consistency models Experience … architecting and implementing cloud-native distributed systems with a focus on data pipelines handling 10s to 100s of TB of data per month. Experience integrating with 3rd party APIs with varied structures and building\maintaining RESTful APIs (.NET Core, FastAPI) to enable seamless access to data for internal teams and external consumers, ensuring high availability and security. More ❯

Systems Development Engineer, Amazon Security Platform Engineering Job ID: 2784653 | Amazon Data Services Ireland Limited At Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. Our organization is responsible for creating and maintaining a high bar for security across all of Amazon’s products and services. The Amazon Security Platform Engineering team develops scalable self … service systems to collect security relevant logs from internal and third party systems. The scalable data collection services developed by this team provide seamless integration with internal tooling to ensure the logs collected are helping to drive security decisions protecting the business. We are looking for a Systems Development Engineer who is excited about designing and building solutions to … building a highly respected security service to tackle new challenges at a large scale. In this role, you will deliver high quality, scalable logging solutions to support Petabytes of data deployed around the world. You will collaborate with product owners and customers to deliver the best features, using resources and technologies efficiently. You will also help to engage other More ❯

Systems Development Engineer, Amazon Security Platform Engineering Job ID: 2784653 | Amazon Data Services Ireland Limited At Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. Our organization is responsible for creating and maintaining a high bar for security across all of Amazon’s products and services. The Amazon Security Platform Engineering team develop scalable self … service systems to collect security relevant logs from internal and third party systems. The scalable data collection services developed by this team provide seamless integration with internal tooling to ensure the logs collected are helping to drive security decisions protecting the business. We are looking for a Systems Development Engineer who is excited about designing and building solutions to … building a highly respected security service to tackle new challenges at a large scale. In this role, you will deliver high quality, scalable logging solutions to support Petabytes of data deployed around the world. You will collaborate with product owners and customers to deliver the best features, using resources and technologies efficiently. You will also help to engage other More ❯

to join the new Quantitative Systematic Team here at Engelhart. Based in the London office, we are a small team comprising quant researchers and developers, building a portfolio of data-driven trading strategies and underlying technical infrastructure. The role requires strong Python and mathematical skills, along with the ability to deliver robust code that will run our strategies. From … a programming perspective, the role offers numerous exciting challenges to solve and learn from, including performance optimization when dealing with large volumes of data, building cloud-native applications, and developing versatile reporting and visualization frameworks. As this is a greenfield development project, the role also provides exposure to all stages of systematic trading; from data ingestion to … we are looking for somebody with the following experience and skills : Around 2 to 5 years of experience in a similar role. Strong Python skills. Experience with the Python data ecosystem, specifically pandas. Knowledge of cloud technologies, ideally AWS and Azure. Familiarity with CI solutions. Knowledge of Docker and Kubernetes is a plus Experience in finance is beneficial, particularly More ❯