351 to 375 of 452 Data Ingestion Jobs in the UK

A Bank, based in the City of London, is currently seeking an ETL Developer to help deliver infrastructure data processing solutions for the business. The company is seeking an experienced ETL Application Developer with experience of Extract/Transform/Load, SQL Server and data-processing of infrastructure-sourced capacity metrics. This role is critical to strengthening operational … monitoring is in place to highlight and mitigate potential system outages in a timely fashion to minimise potential disruptions. Key tasks include; Developing scripts, and ETL to obtain such data from the providers and working with a DBA to load this data into SQL Server from an application server. This person will also help normalise raw infrastructure and … monitoring data into structured formats suitable for graphing and trending Other tasks include automating regular data ingestion processing. Key Skills; Demonstrate evidence of working on similar data analysis and capture projects in the financial or other sector of equal complexity. Strong proficiency in one or more ETL tools Strong proficiency in data extraction methods usingRESTful More ❯

Job Description A Bank, based in the City of London, is currently seeking an ETL Developer to help deliver infrastructure data processing solutions for the business. The company is seeking an experienced ETL Application Developer with experience of Extract/Transform/Load, SQL Server and data-processing of infrastructure-sourced capacity metrics. This role is critical to … monitoring is in place to highlight and mitigate potential system outages in a timely fashion to minimise potential disruptions. Key tasks include; Developing scripts, and ETL to obtain such data from the providers and working with a DBA to load this data into SQL Server from an application server. This person will also help normalise raw infrastructure and … monitoring data into structured formats suitable for graphing and trending Other tasks include automating regular data ingestion processing. Key Skills; Demonstrate evidence of working on similar data analysis and capture projects in the financial or other sector of equal complexity. Strong proficiency in one or more ETL tools Strong proficiency in data extraction methods usingRESTful More ❯

Other EU work permit required: Yes Job Reference: b81240d71528 Job Views: 5 Posted: 25.06.2025 Expiry Date: 09.08.2025 Job Description: Job Purpose To contribute to the growing research in Geospatial Data Science at the College of Science and Engineering, working with Professor Ana Basiri and the Geospatial Data Science Group at the University of Glasgow. The successful candidate will … geospatial AI tools, deliver high-impact research, and contribute to team development through research outputs, proposals, supervision, and presentations. Main Duties and Responsibilities Develop innovative GeoAI solutions combining geospatial data with APIs like GPT, Codex, etc., for data tasks and AI-driven applications. Study and develop applications using Large Language Models through fine-tuning and integration. Apply techniques … such as prompt engineering, data ingestion, and transformation. Collaborate with the Geospatial Data Science team and external partners across industry, government, and third sectors. Enhance research profile through publications, societal impact, and research indicators. Present work at conferences, seminars, and workshops. Support FAIR principles by making data and code repositories accessible and reproducible. Pursue personal and More ❯

Engineering: Contribute to security engineering projects, transitions, and transformations. Work closely with security operations and associated security incident response systems Stay informed about emerging threats and security best practices. Data Ingestion and Enrichment: Configure Elasticsearch pipelines for data ingestion from various sources, primarily from Kafka Enhance data enrichment by integrating threat intelligence feeds and contextual … work towards achieving these. Skills Required for the Role Security and Compliance with Elastic Security: Set up access controls, authentication, and encryption using Elastic Security features. Ensure compliance with data protection regulations. Detection Rule Development: Ability to create, test, and optimise detection rules to identify suspicious activities and potential threats based on the MITRE ATT&CK Framework Performance Tuning … with Elasticsearch and Logstash: Fine-tune query performance using Elasticsearch indices and mappings. Monitor Logstash pipelines and optimize resource utilization. Kibana Visualization and Monitoring: Leverage Kibana for data visualization, dashboards, and real-time monitoring. Create custom visualizations to track data quality metrics and system performance. Elastic integration Integration of the SIEM with critical systems to provide alerting, monitoring More ❯

a major transformation initiative. This is a high-impact role supporting a flagship payroll platform used by thousands of businesses. 🎯 Key Objectives Platform Uplift – Enhance the Payroll Reporting API, data ingestion layer, and ETL pipeline to meet top-tier engineering and reliability standards. UK Delivery – Launch features specifically tailored for UK payroll compliance and user experience. Strategic Vision … Help define the long-term architecture of payroll reporting, aligning with broader global data and AI goals. 🛠️ Tech Stack : React, .NET, AWS 🧠 You’ll bring : Proven expertise in React and .NET in production environments Strong experience with system design, observability, and performance optimisation Great communication and stakeholder engagement skills Background in financial, payroll, or reporting systems is a bonus More ❯

Technical Account Manager - OTC Pricing Location London Business Area Data Ref # 10044326 Description & Requirements At Bloomberg, our products are fueled by powerful information. We combine data and context to paint the whole picture for our clients, around the clock, from around the world. In Data, we're responsible for delivering this data, news, and analytics … problem-solving skills to identify workflow efficiencies and implement technology solutions to enhance our systems, products, and processes. The Content Acquisition (CA) team is an integral part of the Data department. We manage, acquire, and integrate content and data from exchanges, brokers, sell-side, buy-side, and other providers to drive the value of the Bloomberg Terminal and … downstream enterprise products. We lead the governance, cost, and quality of data we acquire, collaborating across the company to develop data acquisition strategies in line with our key partners' agendas. Within CA, our Client Service team acquires and manages content that becomes available to our global client base. For clients who use Bloomberg daily, having seamless access to More ❯

Hotwire (Turbo, Stimulus), View Components, Sidekiq, PostgreSQL, Redis, Serverless, AWS (Fargate, Aurora, ElastiCache), GitHub In this role, you'll get to: Design, implement and deliver software such as ingestion pipelines, API and a greenfield internal operations application. Align technical solutions with business goals that enable us to meet our goals Prioritise and organise the team's backlog; this refers … and self-motivation to take on tasks with loose requirements and see them through to successful completion. Nice to haves: Experience working with large datasets and building tools for data ingestion and processing. You enjoy learning new technologies and are passionate about experimenting to figure out how to build things better. We are continually evolving our benefits package … or other protected characteristics as required by law and as a matter of our company values. GDPR Notice When you apply to a job on this site, the personal data contained in your application will be collected by Ophelos ("Controller"), which is located at 1 Finsbury Ave, London EC2M 2PF and can be contacted by emailing . Controller's More ❯

energy systems), its current lease terms and use, its current value and future "green premium," and the value of energy flexibility in a future grid. We gather all this data and build machine learning models to find the optimum retrofits across a portfolio of buildings. To make this possible, we're building a diverse team of people passionate about … also be proficient in standard front-end technologies such as JavaScript, HTML5, and CSS3. Some experience in Python, including writing code that has gone into production. Demonstrated experience with data ingestion from various sources, including APIs and data downloads. Familiarity with database technologies (preferably PostgreSQL experience). Experience with cloud-based deployment and management, preferably with GCP. More ❯

Implement and manage Azure SQL databases for high availability and performance. Oversee SAP on Azure deployments to ensure seamless integration and operation. Manage Azure Event Hub for real-time data ingestion and processing. Utilize AzureIAC-Terraform for infrastructure as code deployments. Develop and maintain PowerShell scripts for automation and management tasks. Design and implement Azure Landing Zones for … secure environments. Manage Azure Virtual Machines for optimal performance and cost-efficiency. Provide solutions as an Azure Solution Architect to meet business requirements. Implement Azure Recovery Services Vault for data protection and disaster recovery. Lead Azure Migration Projects to ensure smooth transitions to the cloud. Manage Azure App Service for hosting web applications and APIs. Oversee Azure AKS for More ❯

Hotwire (Turbo, Stimulus), View Components, Sidekiq, PostgreSQL, Redis, Serverless, AWS (Fargate, Aurora, ElastiCache), GitHub In this role, you'll get to: Design, implement and deliver software such as ingestion pipelines, API and a greenfield internal operations application. Align technical solutions with business goals that enable us to meet our goals Prioritise and organise the team's backlog; this refers … and self-motivation to take on tasks with loose requirements and see them through to successful completion. Nice to haves: Experience working with large datasets and building tools for data ingestion and processing. You enjoy learning new technologies and are passionate about experimenting to figure out how to build things better. We are continually evolving our benefits package More ❯

for building and supporting RBCs award winning suite of client algorithmic trading solutions. As part of this group, you will be responsible for building our core algo trading framework, data ingestion APIs, coding algo strategies and intelligent signals to drive best execution outcomes across asset classes. This is an exciting and coveted opportunity for someone passionate about technology More ❯

quantitative and systematic hedge fund with a global presence, known for their scientific and technology-driven approach to investing across all major liquid asset classes. They're seeking a Data Scraping Specialist to join their world-class data and technology team. In this role, you will be responsible for developing and maintaining web scraping tools, integrating diverse data … and ensuring the reliability and quality of large-scale datasets used for the research and trading platforms. Ideal Candidate: 2+ years of hands-on experience with web scraping and data ingestion pipelines. Polygot developer, with experience in Python. Familiarity with structured and unstructured data formats. Solid understanding of software engineering best practices. Strong communication skills. Experience with … financial data, especially equities/derivatives, is a plus. More ❯

quantitative and systematic hedge fund with a global presence, known for their scientific and technology-driven approach to investing across all major liquid asset classes. They're seeking a Data Scraping Specialist to join their world-class data and technology team. In this role, you will be responsible for developing and maintaining web scraping tools, integrating diverse data … and ensuring the reliability and quality of large-scale datasets used for the research and trading platforms. Ideal Candidate: 2+ years of hands-on experience with web scraping and data ingestion pipelines. Polygot developer, with experience in Python. Familiarity with structured and unstructured data formats. Solid understanding of software engineering best practices. Strong communication skills. Experience with … financial data, especially equities/derivatives, is a plus. More ❯

I've partnered with a start-up in the health-tech space who are looking to hire a Data Engineer on a contract basis. The role focuses on data ingestion pipelines with a heavy focus on Kafka and Spark. Experience needed: Kafka Spark ETL/Data Processing Python/Scala Up to £400 p/d More ❯

Social network you want to login/join with: Data Platform Engineer- Leading Quant-Driven Market-Maker, London col-narrow-left Client: Oxford Knight Location: London, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Reference: 1d7fe75d851b Job Views: 4 Posted: 29.06.2025 Expiry Date: 13.08.2025 col-wide Job Description: Data Platform Engineer Location … a small, high-impact team responsible for the firm's most critical datasets - including corporate actions, fundamentals, and index membership data. Rather than chasing breadth, this team focuses on data depth: building a clean, unified, and intelligent data layer that underpins all major decisions across the business. We build distributed pipelines to ingest, clean, and expose daily datasets … to internal teams. This is an engineering-first team with strong autonomy - ideal for someone who enjoys taking ownership of data quality, system design, and intelligent automation. What You'll Do Own and improve automated data ingestion and processing pipelines Design and maintain distributed systems for reliable, scalable data access Identify and fix data anomalies More ❯

Product Owner - Sport Data £42,770 - £64,150 Hybrid - 2 days a week in London, Basingstoke or Bristol Join Our Team at Hawk-Eye Innovations Hi, I'm Dan Payne, Product Director here at Hawk-Eye Innovations, and I'm excited to invite you to join our team as a Product Owner. If you're passionate about creating cutting … will help define and translate user and business requirements into actionable work and be an essential part of enhancing our tracking services, related products and features. Your understanding of data ingestion and delivery technology, product, value and business, as well as experience collaborating with multiple stakeholders and leads, are some of the skills you may expect to use … in this role. Your week might include: Helping drive the future of Hawk-Eye's data delivery services, serving as the voice of the user, client and business goals Working with users as well as external and internal stakeholders to analyse their needs and translate those into product requirements Contributing to the Vision, Roadmap and ROI of the product More ❯

each other and our clients, and it is deeply rooted throughout our work, to elevate and bring to life our differences throughout the platform world. Job Description THE TEAM Data Solutions is a Groupe wide practice for the delivery of end-to-end Data and Reporting Solutions for our key Global Network Clients. Data Solutions works with … key external and internal stakeholders to understand and analyse technical reporting requirements, define business rules for data ingestion, and lead the development of Publicis propriety data technology. As a Data Solutions Director, you will manage the Juniors, Managers and Senior Managers in the Data Solutions practice. You will be the team lead on communications between … Responsibilities ROLE SUMMARY Team Provide support managing client team relationships for some of Publicis Groupe's major Global Network Clients, working collaboratively across the network Act as support to Data Solutions team members providing leadership oversight on the global reporting solutions we deploy across our top accounts Collaborating closely with essential Team Leads to enhance technical processes, developments, and More ❯

Product Owner – Sport Data £42,770 – £64,150 Hybrid – 2 days a week in London, Basingstoke or Bristol Join Our Team at Hawk-Eye Innovations Hi, I’m Dan Payne, Product Director here at Hawk-Eye Innovations, and I’m excited to invite you to join our team as a Product Owner. If you’re passionate about creating cutting … will help define and translate user and business requirements into actionable work and be an essential part of enhancing our tracking services, related products and features. Your understanding of data ingestion and delivery technology, product, value and business, as well as experience collaborating with multiple stakeholders and leads, are some of the skills you may expect to use … in this role. Your week might include: ● Helping drive the future of Hawk-Eye’s data delivery services, serving as the voice of the user, client and business goals ● Working with users as well as external and internal stakeholders to analyse their needs and translate those into product requirements ● Contributing to the Vision, Roadmap and ROI of the product More ❯

all over the world. The Opportunity: We are looking for a talented individual to play an important role in our global expansion program by helping set the strategy for data acquisition as well as, managing and supporting, both new and existing, data partners. You will have your own portfolio of prospect and existing partners to own and manage … players of all types) and you will collaborate with several key internal teams to maximise success. In summary, you will be accountable for creating and delivering against multi-market data partnership plans and for developing new engagement opportunities with existing partners. This is a broad and varied role which pulls on skills in traditional account management, product and marketing … strategy, commercial positioning, data analysis and reporting. You will work with a diverse range of stakeholders, to manage multiple partnerships, oversee the delivery of agreed deliverables, and to track and monitor the overall success of these partnerships. The Partnership Manager Role: Identify Partner opportunities through research, creative thinking, and industry campaigns Lead or support the initial engagement process and More ❯

truth, learn fast, and iterate faster Meritocracy Like a professional sports team, we focus on contribution and reward excellence. Key Responsibilities • Architect and develop our Rust-based client for data ingestion • Design and implement core platform features: Data ingestion connectors Logs management systems Observability interfaces Error resolution tools • Drive core architecture decisions and lead deployment on … Brings 1-2 years of experience in building complex software systems • Proven ability to solve challenging engineering problems • Demonstrates deep technical expertise in high-performance computing, observability, cloud infrastructure, data engineering, or data science • Proficient in low-level programming like Rust, C, or other technologies • Track record of taking calculated technical risks and learning from failures • Ability to … priorities • Proven track record of shipping complex products at high velocity • Brings a strong product mindset, ensuring technical solutions align with business priorities Bonus points • Proficient in high-performance data infrastructure • Experienced in technical leadership as a manager or project lead • Early-stage startup experience Our Tech Stack • Rust: We prioritise speed and efficiency for our core systems • Nextflow More ❯

A BIT ABOUT FLOCK At Flock we do insurance very differently. We're nearing 1 billion connected, insured miles. Meaning our real-time, data-driven approach enables us to price connected vehicle insurance and assess risk better than ever before, giving fleet owners the insights they need to improve safety. We don’t just pay claims; we help our … ROLE Join Flock as a Full Stack Engineer within our Safety Team, where you'll play a pivotal role in building the next generation of our telemetry and safety data platform. WHAT WE THINK IS MOST EXCITING ABOUT THE ROLE: Impactful Front-End Work in a Data-Rich Environment You'll lead the development of powerful, user-friendly … features in our customer Portal using React. As we unlock new levels of insight through a brand-new telemetry ingestion pipeline, your work will directly shape how millions of GPS datapoints are surfaced, visualized, and interacted with by our customers. Work at the Intersection of Data and UX Partner closely with data engineers, backend developers, and product More ❯

build a top-tier engineering organisation from the ground up. What you’ll own Tech vision & roadmap – Translate product goals into a clear architecture from MVP to full platform. Data collection at scale – Design compliant pipelines that pull from X/Twitter, Meta, Reddit, YouTube and third-party sources. Infrastructure & ML – Deliver real-time + batch processing, embedding AI … models directly into production. Social-media intelligence – Craft novel metrics for hidden-influencer detection, bridge mapping and predictive analytics. Team leadership – Hire, mentor and inspire a lean group of data scientists & engineers. What you’ll bring 5+ years’ senior engineering leadership in SaaS, data or analytics scale-ups. Deep experience with API data ingestion, distributed systems More ❯

build, maintain and optimize our code base. Responsibilities : Develop risk management and research applications using Python Build and maintain interactive dashboards using Dash or similar UI framework Develop robust data ingestion logic Collaborate with investment professionals in your immediate team, and technologists across the business. Qualifications: Bachelors or Masters in computer science or related field of study (either … already graduated or in their final year of study). Proficiency in Python or similar language, ideally with an understanding of data manipulation (e.g. pandas, numpy) and visualization libraries (e.g. Plotly, Dash). Experience in designing and programming SQL databases. Experience of collaborating on codebases and using software development tools like git and Jenkins. Experience with AWS based system More ❯

stack with the immediate needs of risk takers. The tech stack primarily uses Python, with heavy reliance on cloud resources and containerization. Responsibilities: Ensure stability of daily production, including data ingestion, processing, and production services Maintain the team’s infrastructure (SQL databases, Linux servers, CI, services, etc.) Enforce best coding practices and guide team members Translate user ideas … in improving their code Skills and Experience Required: Minimum 5+ years of development experience (more preferred) Deep understanding of Python Experience managing SQL databases, especially dealing with time series data Technical background in Maths, Computer Science, or Engineering; finance experience not mandatory Advanced academic background (Masters or PhD) in STEM fields Previous experience in Fixed Income Benefits & Incentives: Competitive More ❯

Hyperion Application Engineer, Financial Governance, Close & Consolidation We are looking for an Oracle Hyperion Financial Management (HFM) Consultant to design, implement, and maintain solutions that enable large-scale data ingestion and computation. The Consultant will work across Amazon engineering and business teams, in planning, designing, executing, and implementing solutions across the globe. Our systems process large-scale data More ❯