24 Data Ingestion Jobs in the UK excluding London

Data Scientist - Hybrid/Bristol Job Title : Mid-Level Data Scientist Location : Hybrid/Bristol Remuneration : £50,000 - £60,000 per annum Contract Type : Permanent Responsibilities : Play a pivotal role in crafting, enhancing, and managing intricate data ingestion pipelines, ensuring their efficiency, scalability, and dependability. Integrate … advanced machine learning elements into data pipelines to elevate data processing and analytical capabilities. Devise and implement data quality metrics and dashboards for monitoring, ensuring the fidelity and precision of ingested data. Collaborate closely with data scientists, engineers, and cross-functional team members in an agile … development setting to meet project objectives and deadlines. Harness modern NLP techniques to enrich data comprehension and processing. Stay abreast of the latest advancements in data science and engineering to continuously refine our systems and methodologies. About Us : Situated in Bristol, UK, our client operates at the forefront more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description This is an exciting opportunity for an experienced developer of large-scale data solutions. You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer. The ideal candidate will have a proven track record … as a senior/self-starting data engineer in implementing data ingestion and transformation pipelines for large scale organisations. We are seeking someone with deep technical skills in a variety of technologies, specifically SPARK performance\tuning\optimisation and Databricks, to play an important role in developing and more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description This is an exciting opportunity for an experienced developer of large-scale data solutions. You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer. The ideal candidate will have a proven track record … as a senior/self-starting data engineer in implementing data ingestion and transformation pipelines for large scale organisations. We are seeking someone with deep technical skills in a variety of technologies, specifically SPARK performance\tuning\optimisation and Databricks, to play an important role in developing and more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description This is an exciting opportunity for an experienced developer of large-scale data solutions. You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer. The ideal candidate will have a proven track record … as a senior/self-starting data engineer in implementing data ingestion and transformation pipelines for large scale organisations. We are seeking someone with deep technical skills in a variety of technologies, specifically SPARK performance\tuning\optimisation and Databricks, to play an important role in developing and more »

Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business … Analysts and Data Architects with discovery and best practices. Self-directed and comfortable supporting the data needs of multiple teams, systems and products. What’s required ? Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure. Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark. Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis. Strong analytic skills related to working with unstructured datasets. Build processes supporting data transformation, data structures, metadata, dependency and workload more »

The role As a Data Engineer at Storm you will work alongside other software and cloud infrastructure engineers to design, build and maintain data pipelines, data management solutions and analytics components for our client’s projects across the healthcare, justice and local government sectors. About you We … know that many Data Engineer's will come from a variety of backgrounds, and we encourage and value people who bring unique perspectives and knowledge to our team. Your previous experience will include working daily with disparate data sources, ingesting, transforming and processing data streams into actionable … use or for onward processing. You will have a proven track record of delivery and a passion for adherence to best practices in the data engineering discipline. You will be passionate about data in all its forms and see the value in transforming data into insights. You more »

benefits Please note: you need to have the right to work in the UK – no sponsorship, unfortunately About the job Reporting to the Senior Data & Analytics Lead, the BI Developer will be responsible for driving the direction and maintaining the business data model ensuring it aligns with business … activities and processes. The role will work closely with key internal and external stakeholders in organising and creating a data model that makes data and information accessible with appropriate channels of access controls. Fostering a relationship of trust and playing an advisory role in the use of data to improve business performance. The role will require playing a highly collaborative role by overseeing cross-functional data governance while ensuring the adoption and adherence to data quality are understood by stakeholders. Key Responsibilities Responsible for designing effective, efficient data models to support various types of more »

Data Engineer/Architect (GCP) Google Cloud Platform | Fully Remote | £55,000 The Role: My client are a leading digital consultancy, specializing in delivering innovative solutions to businesses worldwide. With a focus on leveraging cutting-edge technologies and strategic insights, they empower our clients to thrive in the digital … age. Position Overview: We are seeking a talented Data Engineer/Architect with expertise in Google Cloud Platform (GCP) to join our team. This position is fully remote, with the option to work from offices based in Cardiff, United Kingdom. As a Data Engineer/Architect, you will … play a pivotal role in designing, implementing, and optimizing data solutions that drive business value for our clients. You will collaborate closely with cross-functional teams to understand business requirements, architect scalable data solutions, and ensure the successful delivery of projects. Key Responsibilities: Architect end-to-end data more »

to £100,000 dependent on experience, plus bonus and other benefits. An overview of the role: We're seeking talented individuals to join a Data & AI Strategy team of a consultancy that we're supporting, where you'll design and build strategies and operating models to transform organizations across … all industries through data & AI. All Managers and Senior Managers work as trusted advisors with senior clients, leading teams of consultants and technical specialists on large and complex projects. We're looking for candidates with consulting experience in sectors such as Transport, Energy, Utilities, Government, Defence, Consumer Products & Retail … the opportunity to take on leadership roles within the consultancy practice, honing your skills before taking them to clients. Why this role? As a Data & AI Operating Model Manager, you will play a leadership role in setting organisations up for the fourth industrial revolution, helping them to effectively leverage more »

Title: Snowflake Data Engineer - 6-Month Contract (Inside IR35) Remote Pay rate: (Apply online only) per day dependent on skill set Position Overview: As a Snowflake Data Engineer, you will play a pivotal role in designing, developing, and maintaining our Snowflake data platform. Your expertise will be … critical in ensuring efficient data ingestion, transformation, and storage, enabling seamless data access and analytics across the organization. This position offers an excellent opportunity to work with cutting-edge technology and make a significant impact in a fast-paced environment. Responsibilities: Collaborate with stakeholders to understand data requirements and translate them into technical solutions within Snowflake. Design and implement scalable data pipelines for ingestion, transformation, and loading of data into Snowflake. Optimize performance and efficiency of Snowflake data warehouse through tuning, indexing, and partitioning strategies. Develop and maintain documentation, including data more »

to change the status quo, we’ll help you make your moment. Join Team Purple. Join IFS. Job Description As a Principal/Senior Data Engineer, you will spearhead our data initiatives, transforming raw data into strategic assets that propel our business forward. This role is designed … those who excel in a dynamic environment, offering the freedom to innovate and the responsibility to deliver. Core Responsibilities: Identify and harness high-value data opportunities within our product suite, converting raw data into impactful features and reusable assets. Act as the authoritative voice on data technology … steering our organization towards cutting-edge platforms and methodologies. Architect and execute comprehensive data projects, ensuring robust scalability and performance from conception to deployment . Collaborate with a team of ML Engineers, Data Scientists, and other key stakeholders to design, implement, and maintain data pipelines that fuel more »

Data Engineer - Manchester - £35,000 - Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into their central Microsoft Azure repository. … Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Configure and troubleshoot Microsoft Azure, manage data ingestion Develop ETL scripts using Python, handle web scraping, APIs, and relational databases Familiarity with Power BI (you will not have to use … Power BI, but being aware of how to collaborate with people that do is important) Work closely with data analysts and scientists, contribute to data models and algorithms, and participate in data events Working knowledge of Git If you have the required skills and experience and would more »

customers Your world of expertise In this role you will be part of the Standalone Applications team who manage several key operational systems for data ingestion, data processing and product generation. For example; satellite data reception and radar data processing. These systems not only provide … essential data used for the models that run on the supercomputer, but also use model data from the supercomputer to produce essential products used by forecasters and customers. As our Application Operations Engineer, the key duties are: Provide support, as part of the team, to a range of more »

Central to this role will be the development of end-to-end data management and analysis capabilities to deliver novel biologics drugs driven by industry -leading biologics R&D data . You will become part of an interdisciplinary Bioinformatics team, working at the heart of research and development … creating an active learning system, in which model predictions guide lab experiments, lab automation generates high-throughput data for model training , and predictive models are updated as new data are generated . ASTRAZENECA With one of the broadest and deepest Oncology pipelines in the industry , there are many … closely with our R&D scientists in fields of software engineering , lab automation, computational modelling and machine learning , with access to biologics R&D data across AstraZeneca constantly generating new data to both build and inform predictive models . This role provides the opportunity for a motivated Bioinformatician more »

a small team within our larger Bioinformatics team. The team is made up of various disciplines and is responsible for driving the application of data management, automation data ingestion and analysis. The successful candidate will help recruit, shape and lead a team to improve and deliver on … our vision of an end-to-end data workflow, In-silico Antibody design and optimisation, with the exciting goal of moving us toward higher throughput and more efficient discovery platforms. ABOUT ASTRAZENECA AstraZeneca is a global, science-led, patient-focused biopharmaceutical company that focuses on the discovery, development, and … working with a diverse group of scientists in both wet and dry labs, the right candidate will assist with the design and prototyping of data capture, data curation and the automation of data flow for high throughput processes to ensure impact in pipeline projects across all therapeutic more »

Senior Data Engineer Location: Hybrid, with 2 days per month to be onsite (Abingdon) We have the pleasure to be representing a business that is on a mission to increase the number of people who can live longer, healthier lives and reduce unnecessary medical costs while doing so. To … help with the success of this strategy They are recruiting for a Senior Data Engineer that will take a pivotal role in driving the Data team forward. Responsibilities: Lead Cloud Data Warehouse Project : Take charge of leading the Cloud data warehouse project through its next phase … of development, ensuring its scalability, reliability, and performance meet the highest standards. Ownership of Data Management : Assume ownership of all aspects of data management, serving as the go-to person for any data queries from the internal team. Your expertise will ensure seamless data operations and more »

Data Engineer 📍 Bristol, UK (Hybrid, 3 days/week in office) 💰 £38-45k dependent on experience 🚀 About us Digital i is where tech and TV collide! We’re a TV analytics company based in Bristol UK, specialising in unravelling unique insights from viewing data for both video … winning project redefining audience measurement on a global scale. Now, with big expansion plans on the horizon, we're on the hunt for a Data Engineer to help shape the next era of video on demand analytics. 💼 About the role We’re looking for a Data Engineer to … team to help develop the next generation of our industry-leading video on demand analytics platform. Your mission? Dive deep into the world of data pipelines, crafting and refining the systems that transform raw viewing data into actionable insights. Picture this: cleaning, analysing, and orchestrating meticulous quality checks more »

Data Engineering Lead Do you enjoy leading a team that develops high-quality code? Are you A highly visible champion with a ‘can do’ attitude and enthusiasm that inspires others? About the Business LexisNexis Risk Solutions provides customers with solutions and decision tools that combine public and industry specific … content with advanced technology and analytics to assist them in evaluating and predicting risk and enhancing operational efficiency. We use the power of data and advanced analytics to help our customers make better, timelier decisions. By bringing clarity to information, we ultimately help make communities safer, insurance rates more … You can learn more about LexisNexis Risk solutions at the link below, https://risk.lexisnexis.com/. About our Team As a Lead Data Engineer you will be leading and liaising with dynamic, passionate across functional teams, where collaboration as a team is key. About the Role As more »

business rules independently to model various business planning and forecasting requirements within the Oracle EPM Cloud Build integrations with discrete Oracle and non-oracle data sources and applications for upstream and downstream data ingestion and flow. Building Data Management setup and configuration for consumption and outflow … of data to/from EPM Automate business processes using EPM Automate scripting and Rest APIs for near to real time business event based scenarios Support the execution of Unit/SIT and UAT testing phases System integration and connectivity (Authentication, SSO) Strong understanding of the LBG Engineering and … security landscape & standards Extensive SQL knowledge for ETL and migration of data Oh, and if you have any prior experience working within a finance function or with Oracle OFSAA, Fusion systems that would be handy, but please apply if you don't! About working for us Our focus is more »

The successful candidate will work closely with the BI Manager to to deliver and maintain end-to-end business intelligence solutions for Keepmoat., from data ingestion to analysis and visualisation through reports and dashboards that drive insights and improve decision-making across the organisation. Duties will include working … the hands-on development of metrics, reports, and dashboards. Responsibilities will also include the maintenance and optimisation of the Power BI service and championing data quality throughout the business. The ideal candidate will have 2-3+ years of proven professional experience in Business Intelligence/Analytics (Power BI … . They will have experience with Microsoft BI stack, relational database and SQL experience alongside experience working with ETL and/or data integration tools (preferably Informatica). Experience working in an agile environment (preferably with Azure DevOps) is also essential. Experience within the housebuilding industry, as well as more »

Job Description Software Engineering Lead Data- SQL Server, Oracle, Python, Hadoop, ETL Do you enjoy leading a team that develops high-quality code? Are you A highly visible champion with a ‘can do’ attitude and enthusiasm that inspires others? About the Business : LexisNexis Risk Solutions is the essential partner … solve difficult problems in the areas of Anti-Money Laundering/Counter Terrorist Financing, Identity Authentication & Verification, Fraud and Credit Risk mitigation and Customer Data Management. You can learn more about LexisNexis Risk at the link below, risk.lexisnexis.com About the Role: This is a Lead Data Engineer/… Software Engineering Lead role where you will be responsible for overseeing and guiding a team of Software Engineer, Data Engineers and QAs specialising in Data Ingestion. In addition to writing code on complex systems and applications, this position provides direction on project plans, schedules, and methodologies. The role more »

Job Description: Software Developer - Data Science & AI Programme We are a globally renowned research-intensive university committed to delivering the highest quality teaching and learning experiences. Positioned at the forefront of economic, social, and cultural development in the North East of England, we prioritize attracting and retaining exceptional talent … to drive our ongoing success. Role Overview: Join the Data Science & AI Programme at one of the Norths leading higher education institutions. Supported by £27M of NIHR funding, the IO integrates horizon scanning analysts, evidence synthesis researchers, and data scientists into a cohesive hub focused on observing and … on health innovation. Key Responsibilities: As a Software Developer, you will contribute significantly to enhancing and maintaining OpenScan, our in-house developed, cloud-based data science engine. Your role involves refining the data ingestion pipeline, responsible for aggregating, standardizing, and analyzing health data from diverse sources more »

and test software components of varying size and complexity. Design and execute unit, link and integration test plans and document test results. Create test data and environments as necessary to support the required level of testing. Work closely with the quality assurance team and assist with integration testing, system … software development experience within an industry setting. Ability to work in both Windows and UNIX/Linux operating systems. Good understanding of software/data design methods and data structures. Experience of API (REST) development, Docker, and Kubernetes. Familiarity with IntelliJ, Subversion and Maven. Exposure to one or … work within a hybrid Agile methodology. Understand the design and development approaches required to build a scalable infrastructure/platform for large amounts of data ingestion, aggregation, integration and advanced analytics. Knowledge of general database concepts, plus experience of one of the following platforms: MySQL or Cassandra. Experience more »

Support Tier 1&2 SOC analysts. Actively support SOC capability development and continuous improvement. Contributes to the improvement of SOC processes, detection mechanisms, tooling, data ingestion and analysis. Perform Threat Hunting supported by the Cyber Threat Intelligence function. Contributes to the SOC strategy and evolution. Provides recommendations to more »