276 to 300 of 419 Data Ingestion Jobs in the UK

turning down headhunters for years. Whatever your priorities – work/life balance, career progression, sustainability, volunteering – you’ll find like-minded people driving change at Howden. Position: Master & Reference Data Management Steward Howden is evolving its Master and Reference data capability to provide a wider service to the organisation, so that trusted and enriched master and reference data entities are in place, enabling effective business operations and providing richer analytical capabilities. The Group Data Management function is accountable for mastering the Group’s common critical data domains covering Party, Lloyd’s Market, Industry, Business Unit, Product and Geography utilising Howden’s strategic master data management solution, Reltio. The overall goal is to ensure the … critical data is appropriately governed through data stewardship and mastered to create a unique and enriched golden record. This enables the business to perform its critical operational processes more efficiently and provide greater insights to support new business opportunities. The job holder will also act as an SME supporting Howden’s use of external company enrichment data More ❯

does not have a signed agreement with Sensor Tower. About this role: Sensor Tower is the leading provider of market intelligence and insights for the mobile app ecosystem. Our data-driven solutions empower businesses, developers, and marketers to make informed decisions and stay ahead in the competitive mobile landscape. We're looking for a Software Engineer to join our … Data Fetching Team, which is responsible for building and maintaining the systems that collect public data from third-party sources. In this role, you'll contribute to the development and upkeep of reliable and compliant data ingestion pipelines that support key data flows across the company. You'll work alongside other engineers on the Fetcher … Team to ensure the accuracy, stability, and scalability of our data collection processes. Your work will support internal stakeholders across product, analytics, and business teams. What you will focus on Participate in the full development life cycle for data ingestion projects, including software design, implementation, quality testing, and release. Engage in code reviews, champion best practices, and More ❯

edge generative AI models designed to power Superbowl-worthy commercials and award-winning cinematic experiences. Our inaugural, cutting-edge HD model, Marey, is built on exclusively licensed and owned data for professional use in Hollywood and enterprise applications. Our team is an unprecedented convergence of talent across industries. Our elite AI scientists from Deepmind, Google, Microsoft, Meta & Snap, have … we've raised over $70M from world-class investors including General Catalyst, Bessemer, Khosla Ventures & YCombinator - and we're just getting started. Role Summary: We're looking for a Data Engineering Lead to architect and scale the data pipelines that power our next-generation generative video models. This role is central to our mission of training models exclusively … on clean, high-quality data . You will lead the design of data ingestion pipelines, data annotations, and high-throughput, distributed systems that support large-scale data processing and curation. You'll work closely with researchers, engineers, and infrastructure teams to ensure that our data pipeline is not just performant, but trusted, traceable, and More ❯

Data Architect Manager Reference: FEB20250883 Expiry date: 12:39, Fri, 28th Mar 2025 Location: Hightown House Benefits: Pension, Bonus, Car Parking, On Site Gym Hemel Hempstead – Hybrid (3 days in the office) Hightown is about to start building its new cloud data environment and transitioning from its on-premises estate to enable faster and more powerful insights. This … is a new role to manage a newly created team to lead that journey, but it will be hands-on and technology-driven. We’re looking for a data professional who is well-rounded, highly experienced, and has solid data architecture, data ingestion, and data warehousing experience. This is an exciting opportunity for an individual … who wants to create something special. The successful candidate will confidently lead and mentor a team of data developers whilst designing and managing Hightown’s data environment. Key Responsibilities: Architecting and designing solutions in a cloud-native data environment. Guide and coach data developers to foster a collaborative and innovative environment to drive success. Develop and More ❯

Join to apply for the AI Data Engineering Lead role at Moonvalley Continue with Google Continue with Google Join to apply for the AI Data Engineering Lead role at Moonvalley Get AI-powered advice on this job and more exclusive features. Sign in to access AI-powered advices Continue with Google Continue with Google Continue with Google Continue … edge generative AI models designed to power Superbowl-worthy commercials and award-winning cinematic experiences. Our inaugural, cutting-edge HD model, Marey, is built on exclusively licensed and owned data for professional use in Hollywood and enterprise applications. Our team is an unprecedented convergence of talent across industries. Our elite AI scientists from Deepmind, Google, Microsoft, Meta & Snap, have … we’ve raised over $70M from world-class investors including General Catalyst, Bessemer, Khosla Ventures & YCombinator – and we’re just getting started. Role Summary We’re looking for a Data Engineering Lead to architect and scale the data pipelines that power our next-generation generative video models. This role is central to our mission of training models exclusively More ❯

Job Description Find out if this opportunity is a good fit by reading all of the information that follows below. Join JPMorgan Chase's Chief Data & Analytics Office (CDAO) and be part of a mission to modernize compliance through scalable and explainable AI. As a Machine Learning Engineer, you'll design and build systems that answer critical data usage questions with prediction, logic, proof, and intelligent automation. Work at the intersection of applied machine learning, AI reasoning systems, and data governance to tackle complex problems and build ML solutions that make decisions. As a Machine Learning Engineer within JPMorgan Chase's Chief Data & Analytics Office (CDAO), you will design and build systems that answer critical … data usage questions with prediction, logic, proof, and intelligent automation. You will work at the intersection of applied machine learning, AI reasoning systems, and data governance to tackle complex problems and build ML solutions that make decisions. You will build and integrate ML models into structured backend services, write production-ready Python code, and assist in building automated More ❯

role As an Engineering Manager, you will lead across several product teams managing up to ~10 engineers (including Tech Leads). This role will support our vegetation modelling and data ingestion domains as we seek to improve our underlying models and expand the number of data sources we can reliably turn into vegetation intelligence. Our product teams … are cross functional and will typically include: product managers, designers, engineers, data scientists and subject matter experts relating to the teams domain. You will be accountable for the technical and delivery outcomes of your area. You will challenge your teams to achieve ambition goals whilst providing a high level of support through growing engineering talent and creating a highly … dive deep technically when required and leverage your extensive experience as an engineer to drive good technical decisions and solutions. What you will do Enable our Vegetation Modelling and Data Ingestion teams to become highly productive cross-functional teams that ship a high quality product on a daily basis. Grow the teams by attracting great talent from your More ❯

You will need to be self-directed, action-oriented, and comfortable making high-impact decisions quickly. Your focus will include consulting on new product developments, refining complex real-time data pipelines handling millions of data points, and driving operational excellence across our SaaS platform. Key Responsibilities: Production Ownership: Manage and optimise our live software environment, ensuring stability, scalability … Leadership: Consult on new feature and product development, integrating these into the existing production infrastructure with minimal disruption. Performance Optimisation: Continuously monitor, benchmark, and enhance system performance and reliability. Data Pipeline Management: Oversee and improve our extensive real-time data ingestion pipelines, ensuring they are resilient, scalable, and future proof. Process Innovation: Identify and implement improvements across … SaaS environment. Experience in high-growth startup or scale-up businesses is highly desirable. Deep technical expertise in: Databases such as MySQL, Singlestore, and BigQuery. Real-time, high-throughput data pipelines. Cloud platforms, particularly Google Cloud. Strong understanding of software engineering best practices, feature deployment processes and testing. Ability to drive rapid decision-making, manage competing priorities, and deliver More ❯

The ideal candidate will have extensive hands-on experience building and implementing ELK solutions from the ground up-not just monitoring existing systems. Key Responsibilities: Design, build, and implement data ingestion pipelines using Logstash and Kafka Set up and configure the ELK Stack (Elasticsearch, Logstash, Kibana), including Fleet and Integrations Collaborate with stakeholders to analyze data and … insights Ensure performance, availability, and reliability of the ELK environment Maintain and support the ELK stack and its integrations Apply domain knowledge in security and cloud environments to enhance data pipeline resilience and compliance Mandatory Skills & Qualifications: 8+ years of hands-on experience with Elasticsearch , Logstash , and Kibana Proven track record of implementing and maintaining ELK stacks Experience designing … and developing data pipelines Strong exposure to cloud platforms (e.g., AWS, Azure, GCP) Proficiency with Kafka for data streaming and ingestion Background or familiarity in the security domain Deep understanding of ELK ecosystem components including Fleet , Beats , and advanced Kibana dashboards Strong problem-solving and analytical skills Desirable: Experience with Elastic Security or Observability solutions Certification in More ❯

Miami, London, and Singapore to develop risk analytics solutions for our businesses (fixed income, commodities, equities, etc.) Build, enhance, and maintain existing Java REST services and related systems Develop data ingestion pipelines and core data systems to provide risk management with programmatic access to analytics as well as via web interfaces Create and manage cloud applications on … and Risk Managers Required skills/experience: Strong analytical and mathematical skills, with interest and/or exposure to quantitative finance Good understanding of various design patterns, algorithms, and data structures Substantial experience with modern Java Experience with REST APIs and cloud services Relational SQL database development experience Unix/Linux command-line experience Ability to work independently in … a fast-paced environment Detail-oriented, organized, demonstrating thoroughness and strong ownership of work Desirable skills/experience: Experience working with Python and data analysis libraries (pandas, polars, numpy) Experience with financial mathematics, statistics, and a broad understanding of financial instruments and services Experience in JavaScript development, especially with AngularJS or ReactJS AWS cloud services: EC2, S3, Aurora, Redshift More ❯

Design, build, and refine dashboards focusing on profit and loss, margin analysis, cost control, and operational KPIs across the Group. Enhance existing dashboards to integrate with the new Microsoft Data Links repository, replacing scheduled refreshes with live data feeds. Use Power Query (M language) for data ingestion and transformation. Develop advanced DAX measures, including time intelligence … calculations, dynamic reporting layers, and calculated tables. Manage the full dashboard development lifecycle, from stakeholder engagement and data modelling to prototyping, visualisation, and deployment. Collaborate with the incoming FP&A Manager, Group Financial Controller, and finance leads across business units to gather requirements and shape outputs. Ensure dashboards are user-friendly, commercially relevant, and actionable for both finance and … non-finance users. Work alongside internal ERP and data teams (who manage SQL and connectors) to maintain data consistency with Unit4 and Tagetik systems. Provide ad-hoc support for wider reporting and transformation projects, including benchmarking and Group-level insights. The Successful Applicant Demonstrated experience in designing finance-focused dashboards using Power BI, preferably in a group or More ❯

We are currently looking for a Power BI Self-Service Lead to join the innovative and dynamic Data Tech team. You'll be part of a renowned organisation, working on solutions that serve a wide audience of loyal customers and colleagues. With strong ethical values and technology leaders who truly understand data platforms and management, this is an … exciting time to join as we evolve into a digital-first, data-led organisation. As Power BI Self-Service Lead, you'll play a key role in this transformation, reporting directly to our Data Platform Manager. The Opportunity In this role, you'll drive responsible usage of our newly built data platform, ensuring it evolves with cutting … and enhancing our Lab proposition, you'll foster a culture of innovation, develop governance frameworks, and implement tools that provide consistent, supportable solutions for activities such as self-service data ingestion and transitioning processes from Lab to Factory. Key responsibilities include: Drive Innovation : Lead the development and delivery of our Lab proposition to elevate practitioner self-service and More ❯

looking for a Backend Engineer . You will: Develop and support AI pipelines with computer vision ML-derived geospatial assets leveraging Kubernetes cloud services in GCP and Azure. Massive data ingestion pipelines to ensure a continuous and reliable flow of image/video/GIS data into cloud-based datastores. Massive geospatial asset curation, management, and conversion … Bring to The Team: BS in computer science or equivalent degree or relevant professional work experience. At least 5 years’ experience as a software engineer with specific experience in data engineering. Understanding of Kubernetes and deployment of distributed data pipelines include key concerns with building distributed data pipelines such as concurrency, idempotent operation, and consistency models Experience … architecting and implementing cloud-native distributed systems with a focus on data pipelines handling 10s to 100s of TB of data per month. Experience integrating with 3rd party APIs with varied structures and building\maintaining RESTful APIs (.NET Core, FastAPI) to enable seamless access to data for internal teams and external consumers, ensuring high availability and security. More ❯

The Role Design, build and run the software and data that power our platform—from user interfaces to APIs and data ingestion—while keeping security front of mind. Key Responsibilities Build and maintain our Vue 3 platform plus supporting APIs, microservices, database and semantic layers. Write clean, well‐tested code and review peers’ work. Day to day … operation of systems, including availability, security and data integrity Collaborate daily with product, data and DevOps teams in short agile sprints. Skills & Experience Production experience with Vue.js, JavaScript/TypeScript, HTML and CSS. Proficiency in at least one back‐end language (Python, Java, C#, Node). Strong SQL and familiarity with relational & NoSQL databases. Experience designing and consuming … relationships with peers. Communicative: speak up in discussions, share ideas and listen actively. Leadership mindset: take initiative, mentor others and drive best practices. The Opportunity Shape an industry‐leading data platform used across the UK and US. Small, supportive team where every engineer has real impact. Rapid growth means space to develop your skills and career. Why Broker Insights More ❯

Systems Development Engineer, Amazon Security Platform Engineering Job ID: 2784653 | Amazon Data Services Ireland Limited At Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. Our organization is responsible for creating and maintaining a high bar for security across all of Amazon’s products and services. The Amazon Security Platform Engineering team develops scalable self … service systems to collect security relevant logs from internal and third party systems. The scalable data collection services developed by this team provide seamless integration with internal tooling to ensure the logs collected are helping to drive security decisions protecting the business. We are looking for a Systems Development Engineer who is excited about designing and building solutions to … building a highly respected security service to tackle new challenges at a large scale. In this role, you will deliver high quality, scalable logging solutions to support Petabytes of data deployed around the world. You will collaborate with product owners and customers to deliver the best features, using resources and technologies efficiently. You will also help to engage other More ❯

Systems Development Engineer, Amazon Security Platform Engineering Job ID: 2784653 | Amazon Data Services Ireland Limited At Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. Our organization is responsible for creating and maintaining a high bar for security across all of Amazon’s products and services. The Amazon Security Platform Engineering team develop scalable self … service systems to collect security relevant logs from internal and third party systems. The scalable data collection services developed by this team provide seamless integration with internal tooling to ensure the logs collected are helping to drive security decisions protecting the business. We are looking for a Systems Development Engineer who is excited about designing and building solutions to … building a highly respected security service to tackle new challenges at a large scale. In this role, you will deliver high quality, scalable logging solutions to support Petabytes of data deployed around the world. You will collaborate with product owners and customers to deliver the best features, using resources and technologies efficiently. You will also help to engage other More ❯

to join the new Quantitative Systematic Team here at Engelhart. Based in the London office, we are a small team comprising quant researchers and developers, building a portfolio of data-driven trading strategies and underlying technical infrastructure. The role requires strong Python and mathematical skills, along with the ability to deliver robust code that will run our strategies. From … a programming perspective, the role offers numerous exciting challenges to solve and learn from, including performance optimization when dealing with large volumes of data, building cloud-native applications, and developing versatile reporting and visualization frameworks. As this is a greenfield development project, the role also provides exposure to all stages of systematic trading; from data ingestion to … we are looking for somebody with the following experience and skills : Around 2 to 5 years of experience in a similar role. Strong Python skills. Experience with the Python data ecosystem, specifically pandas. Knowledge of cloud technologies, ideally AWS and Azure. Familiarity with CI solutions. Knowledge of Docker and Kubernetes is a plus Experience in finance is beneficial, particularly More ❯

. This role will support our web products including Core Analytics, Wildfire, and Program Planning. Our product teams are cross functional and will typically include: product managers, designers, engineers, data scientists and subject matter experts relating to the teams domain. You will be accountable for the technical and delivery outcomes of your area. You will challenge your teams to … deep technically when required and leverage your extensive experience as an engineer to drive good technical decisions and solutions. What you will do Enable our Vegetation Management Experience and Data Ingestion teams to become highly productive cross-functional teams that ship a high quality product on a daily basis. Grow the teams by attracting great talent from your … technology At least 2 years experience leading and managing engineers across multiple teams Experience working with the following (or similar) technologies: React/Typescript, Python/fastAPI, Postgres DB, Data pipelines) Comfortable working in a build it, run it environment (GCP, cloud run, grafana, k8s) - or similar. Strong leadership skills with the ability to mentor and coach engineers at More ❯

Ability to troubleshoot technical issues and resolve problems. Bachelor’s degree in Computer Science, Information Technology, or related field. Proficiency in configuring Sprinklr Modern Care's/CCaas including data ingestion, workflow automation, and reporting. Experience with integrating Sprinklr Modern Care with external systems, including CRM systems, ticketing systems, and custom applications. Desirable skills/knowledge/experience … and direct experience working with social media management software. Knowledge of industry-standard frameworks (e.g., Contact center, ITIL). Certification in Sprinklr Modern Care or related technologies. Experience with data analytics and reporting tools. Familiarity with cloud-based technologies and software-as-a-service (SaaS) solutions. Rewards & Benefits TCS is consistently voted a Top Employer in the UK and More ❯

Job Description This role is focused on advancing systematic investing through quantitative research and robust data solutions. Key responsibilities include: Data Ingestion & Cleansing: Developing pipelines to integrate and clean data. Data Analysis: Applying statistical techniques to uncover actionable insights. Data Infrastructure: Maintaining automated systems for data collection and retrieval. Candidates should have strong skills … in SQL and Python, experience in data science (ideally with a quantitative advanced degree), and an ability to communicate complex findings effectively. While similar to a Data Analyst, this position demands deeper technical expertise, a focus on financial data, and a blend of data engineering and quantitative research skills. #J-18808-Ljbffr More ❯

Farmweb, allowing us to scale by leveraging our combined financial strength and importantly ensure our people feel the benefits of our joint capabilities. We are currently recruiting for a Data Integration Lead to join our established and experienced CIO team here at RSA on a hybrid basis. Your Role The Data Platform Integration Lead is accountable for data ingestion from OnPrem and cloud sources into Azure based Enterprise data platform. Acting as the primary steward, Integration lead manages ingestion workstream delivery. Provides low level technical planning, oversight and team leadership. You will Document data integration processes, including pipeline designs, configurations, and troubleshooting guides. You will Coordinate with infrastructure teams to ensure proper connectivity … between on-premises systems and Azure cloud environments. The role will require you to stay updated on Azure Data Factory and Databricks features and recommend enhancements to improve ingestion workflows. There will also be an element of Troubleshooting and resolving pipeline failures, minimizing downtime and ensuring data availability. About You You have a Proven track record in More ❯

Join JPMorgan Chase's Chief Data & Analytics Office (CDAO) and be part of a mission to modernize compliance through scalable and explainable AI. As a Machine Learning Engineer, you'll design and build systems that answer critical data usage questions with prediction, logic, proof, and intelligent automation. Work at the intersection of applied machine learning, AI reasoning systems … and data governance to tackle complex problems and build ML solutions that make decisions. As a Machine Learning Engineer within JPMorgan Chase's Chief Data & Analytics Office (CDAO), you will design and build systems that answer critical data usage questions with prediction, logic, proof, and intelligent automation. You will work at the intersection of applied machine learning … AI reasoning systems, and data governance to tackle complex problems and build ML solutions that make decisions. You will build and integrate ML models into structured backend services, write production-ready Python code, and assist in building automated workflows. You will collaborate with VP engineers and cross-functional partners to understand requirements and execute implementation. Your role involves participating More ❯

edge generative AI models designed to power Superbowl-worthy commercials and award-winning cinematic experiences. Our inaugural, cutting-edge HD model, Marey, is built on exclusively licensed and owned data for professional use in Hollywood and enterprise applications. Our team is an unprecedented convergence of talent across industries. Our elite AI scientists from DeepMind, Microsoft, Snap, and Meta have … raised over $70M from world-class investors including General Catalyst, Bessemer, Khosla Ventures, and YCombinator – and we’re just getting started. Role Summary: We're looking for an ML Data Engineer to build the data pipelines driving our next-generation generative video models. This role is central to our mission of training models exclusively on clean, high-quality … data. You'll develop data ingestion pipelines, captioning systems, and high-throughput, distributed architectures for large-scale data processing and curation. You’ll be responsible for solving some of the toughest challenges in data quality and model performance — from training and shipping quality scoring models to analyzing large-scale datasets and uncovering new challenges. What you More ❯

Check you match the skill requirements for this role, as well as associated experience, then apply with your CV below. Join JPMorgan Chase's Chief Data & Analytics Office (CDAO) and be part of a mission to modernize compliance through scalable and explainable AI. As a Machine Learning Engineer, you'll design and build systems that answer critical data usage questions with prediction, logic, proof, and intelligent automation. Work at the intersection of applied machine learning, AI reasoning systems, and data governance to tackle complex problems and build ML solutions that make decisions. As a Machine Learning Engineer within JPMorgan Chase's Chief Data & Analytics Office (CDAO), you will design and build systems that answer critical … data usage questions with prediction, logic, proof, and intelligent automation. You will work at the intersection of applied machine learning, AI reasoning systems, and data governance to tackle complex problems and build ML solutions that make decisions. You will build and integrate ML models into structured backend services, write production-ready Python code, and assist in building automated More ❯

Software Development Engineer, Analytics & Data Management, Advertising Core Services Would you like to build highly available, scalable and distributed microservices for the Advertising Data Lake? Does Petabyte scale excite you? The Spektr team owns the central data lake for Advertising, with services for data ingestion, analysis, cataloging and infrastructure. Spektr provides customers with self-serve … tools to analyze Petabytes of data such as campaigns, ad-serving, billing, clicks, impressions and more generated across the Ads pipeline. This enables engineers, business analysts, ML engineers, research scientists, economists and data experts to perform analysis, measurement and reporting decisions over high quality data. Spektr Datalake team is building the next version of its core platform for … 5x growth. An SDE on this team has a unique opportunity to design the core infra services to scale for Petabytes of data per day with 99.9% uptime, minimal error rates and low operational footprint. Services built by you will utilize technologies such as Java, AWS Lambda, Kinesis, Spark, Redis, EMR, Athena and more to build highly distributed data More ❯