Data Ingestion Jobs in the Midlands

23 of 23 Data Ingestion Jobs in the Midlands

Data Architect

Leicester, England, United Kingdom
NEXT Retail Ltd
Job Description Data Architect Data Architects at Next work closely with the Next Architect teams to identify potential technology innovations, make recommendations that support business growth and drive efficiencies, align business requirements with Next strategy, and are responsible for designing, managing, and deploying an organisation’s data and analytics infrastructure. The position requires strong problem-solving skills … detailed knowledge of corporate and legal data standards, and an understanding of information systems. The Data Architect is also expected to plan and manage their own work efficiently. About the Team An Architect at Next Technology is an IT specialist with a focus on enterprise IT design, implementing complex solutions and specifying the design of services that support … IT strategy, organisational roadmaps, and Next Technology Solutions standards. About the Role Set technical direction and roadmap for the data platform (Data Engineering and Analytics) and provide technical leadership in collaboration with key technical and business stakeholders. Define, document, share (explain/present), and maintain solution architectures and high-level design patterns for the data platform in More ❯
Posted:

Data Engineer

Derby, England, United Kingdom
Hybrid / WFH Options
Cooper Parry
About the role... Do you get satisfaction out of all things data? Interested in pushing your career to the next level at one of the Sunday Times Top 100 Best Companies to Work For? Cooper Parry are seeking a skilled and proactive Data Engineer to join our growing Data & Analytics team. You will play a critical role … in designing, building, and maintaining robust, scalable data infrastructure on the Azure and Microsoft stack, enabling enterprise-wide analytics, reporting, and data science initiatives. This role offers the opportunity to shape the foundation of our future "lab and factory" model of analytics and ML delivery. A day in the life of a CP Data Engineer... Design and … build end-to-end data pipelines and integrations using Azure Data Factory, Azure Synapse and related tools Monitor data pipeline schedules and resolve issues related to job failures, data delays, or quality problems Develop and support a Lakehouse architecture, including structured and unstructured data ingestion, processing, and consumption layers Implement and optimise semantic models More ❯
Posted:

Senior Data Engineer

West Bromwich, England, United Kingdom
Hybrid / WFH Options
Leonardo UK Ltd
services for both civil and defence markets, in both the UK and around the world, to enhance the capabilities of its Customers. Within the Cyber & Security Division is our Data Practice which is where this role is positioned. Leonardo’s Data practice works across a diverse array of sectors including Defence, Telecommunications, Energy and Finance to help secure … national infrastructure in the UK and beyond What you will do as a Senior Data Engineer This is a highly rewarding and hands on role with exposure across both traditional and cutting edge enterprise IT as well as bespoke Operational Technology systems. You will be working in a dynamic environment with a team that is motivated to deliver innovative … grow our practice and solve some of the most challenging, exciting and critical challenges to the UK’s digital landscape. This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring compliance with strict security More ❯
Posted:

DV Cleared - Data Engineer - ELK & NiFi

Birmingham, England, United Kingdom
Matchtech
Job summary We are seeking 3 Data Engineers to join our defence & security client on a contract basis. Key skills required for this role DV cleared, Data Engineer, ETL, Elastic Stack, Apache NiFi Important DV Cleared - Data Engineer - ELK & NiFi - Outside IR35 Location: Worcester Duration: 6 months initial contract Security: Active DV clearance required In this role … you will help design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. These positions are onsite in Worcester and require active UK DV clearance. Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack and Apache NiFi. Implement data ingestion, transformation … and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. More ❯
Posted:

Microsoft Fabric Consultant

Derby, England, United Kingdom
Hybrid / WFH Options
JR United Kingdom
improve and innovate in everything they do, helping clients become self-sufficient through out-of-the-box capabilities supported by smart, execution-focused practitioners. The Role Are you a data enthusiast passionate about transforming raw data into meaningful insights? We’re seeking a talented Fabric/Data Consultant with expertise in Azure and Power BI to join … our dynamic team. This role is ideal for someone who enjoys working with cutting-edge technology, developing robust data architectures, and leading strategic business intelligence initiatives. If you’re excited about helping organizations unlock their data’s full potential, we want to hear from you. Proven experience in data engineering with exposure to Azure Synapse, Azure Data Factory, or Databricks. Familiarity with Microsoft Fabric or a strong willingness to learn and adapt to its ecosystem. Proficiency in Python programming focused on data manipulation and engineering. Interest in data science with a drive to expand into predictive analytics, machine learning, or statistical modeling. Strong analytical and problem-solving skills with a passion for optimizing workflows. More ❯
Posted:

Enterprise BI & Analytics Architect

Stratford-upon-Avon, England, United Kingdom
Enable International
page to learn how you can be part of our journey. Job summary As an Enterprise BI & Analytics Architect at Enable, you will design and implement a cohesive internal data ecosystem that powers scalable reporting and analytics across the organization. You will lead the design of our enterprise BI architecture, define data governance practices, and ensure data quality, consistency, and accuracy. Collaborating with leadership, technical teams, and business stakeholders, you will deliver trusted insights and foster a data-driven culture. Reporting directly to the COO, you’ll play a critical role in defining and enabling Enable’s analytics strategy. Duties and responsibilities Lead the design and implementation of Enable’s enterprise BI and analytics architecture. … Develop and maintain authoritative data models and BI layers, consolidating data from multiple systems into a centralized platform (Snowflake). Define and implement data governance frameworks, ensuring high data quality, consistency, security, and compliance across all internal reporting. Chair and lead Enable’s cross-functional Data Council, aligning teams on data definitions, metrics, and More ❯
Posted:

IT Data Engineering Manager

Burton-on-Trent, England, United Kingdom
Greene King
This job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board. Company Description Job Description The IT Data Engineering Manager will play a pivotal role in advancing the data maturity of the Data & AI department by owning and delivering the data engineering roadmap. They will manage the … Data Engineering team, providing best practices and specialized support as an expert and consultant to deliver solutions that enable the business to maximize value. The IT Data Engineering Manager will be responsible for the entire engineering lifecycle, from data ingestion to transformation to serving. They will support the development and optimization of the environment and platforms … to ensure ongoing growth and adherence to industry best practices. Define and implement data engineering strategies and best practices Oversee data platform architecture for scalability and reliability Lead and manage a team of data engineers Collaborate with architects, analysts, and business teams to align data solutions with organizational goals Manage the data engineering roadmap, ensuring More ❯
Posted:

Data Engineer

Lutterworth, England, United Kingdom
Hybrid / WFH Options
PharmaLex
Pharmalex is looking for a Data Engineer to join their growing team. This will be a remote-based role but there is a requirement to travel to Lutterworth one day of the month. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into a central Microsoft Azure repository and hosted MS SQL database. … Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Core responsibility will be using the NHS Secure Data Environment which utilises databricks, to design and extract regular datasets. Configure and troubleshoot Microsoft Azure, manage data ingestion using LogicApps and Data Factory. Develop ETL scripts using MS SQL … Familiarity with Power BI (you will not have to use Power BI, but being aware of how to collaborate with people that do is important). Work closely with data analysts and scientists, contribute to data models and testing of outputs. EDUCATIONAL QUALIFICATIONS: Bachelor’s Degree in Statistics, Computer Science, Information Technology or any other related discipline or More ❯
Posted:

Data Engineering Manager

Lincoln, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: At Travelex we are developing modern data technology and data products. Data is central to the way we define and sell our foreign currency exchange products. Our relationship with our customers is deeply data-driven. The data engineering manager ( DEM ) owns the design and delivery of … all data flows to and from our data platform, underpinning crucial data products. The DEM is responsible for a significant transformation Travelex is going through, with event-driven and transactional enhancements to our enterprise data architecture, alongside expansion of our data warehousing function to support a wide range of data integrations. Main Responsibilities: Work … with the Director of Data Engineering and IT Leadership to enhance the company's data maturity. Maintain strong business alignment by engaging with leaders across domains and geographies. Ensure data engineering initiatives match evolving business priorities. Promote a product mindset, balancing technical efficiency with clear business value. Team Management Lead the Data Engineering team, providing supervision More ❯
Posted:

Data Engineering Manager

Coventry, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: At Travelex we are developing modern data technology and data products. Data is central to the way we define and sell our foreign currency exchange products. Our relationship with our customers is deeply data-driven. The data engineering manager ( DEM ) owns the design and delivery of … all data flows to and from our data platform, underpinning crucial data products. The DEM is responsible for a significant transformation Travelex is going through, with event-driven and transactional enhancements to our enterprise data architecture, alongside expansion of our data warehousing function to support a wide range of data integrations. Main Responsibilities: Work … with the Director of Data Engineering and IT Leadership to enhance the company's data maturity. Maintain strong business alignment by engaging with leaders across domains and geographies. Ensure data engineering initiatives match evolving business priorities. Promote a product mindset, balancing technical efficiency with clear business value. Team Management Lead the Data Engineering team, providing supervision More ❯
Posted:

Data Engineering Manager

Northampton, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: At Travelex we are developing modern data technology and data products. Data is central to the way we define and sell our foreign currency exchange products. Our relationship with our customers is deeply data-driven. The data engineering manager ( DEM ) owns the design and delivery of … all data flows to and from our data platform, underpinning crucial data products. The DEM is responsible for a significant transformation Travelex is going through, with event-driven and transactional enhancements to our enterprise data architecture, alongside expansion of our data warehousing function to support a wide range of data integrations. Main Responsibilities: Work … with the Director of Data Engineering and IT Leadership to enhance the company's data maturity. Maintain strong business alignment by engaging with leaders across domains and geographies. Ensure data engineering initiatives match evolving business priorities. Promote a product mindset, balancing technical efficiency with clear business value. Team Management Lead the Data Engineering team, providing supervision More ❯
Posted:

Data Engineering Manager

Wolverhampton, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: At Travelex we are developing modern data technology and data products. Data is central to the way we define and sell our foreign currency exchange products. Our relationship with our customers is deeply data-driven. The data engineering manager ( DEM ) owns the design and delivery of … all data flows to and from our data platform, underpinning crucial data products. The DEM is responsible for a significant transformation Travelex is going through, with event-driven and transactional enhancements to our enterprise data architecture, alongside expansion of our data warehousing function to support a wide range of data integrations. Main Responsibilities: Work … with the Director of Data Engineering and IT Leadership to enhance the company's data maturity. Maintain strong business alignment by engaging with leaders across domains and geographies. Ensure data engineering initiatives match evolving business priorities. Promote a product mindset, balancing technical efficiency with clear business value. Team Management Lead the Data Engineering team, providing supervision More ❯
Posted:

Data Engineer Azure DBT Midlands Rapid Growth Scale-Up

Nottingham, Nottinghamshire, England, United Kingdom
Hybrid / WFH Options
Avanti
Data Engineer Azure - DBT - Midlands - Rapid Growth Scale-Up About the Company Join a fast-growing Data Analytics software house that is shaking up the analytics market. In just 5 years, they've grown from a startup to £11M turnover and offices across the UK and internationally. Helping clients rapidly achieve actionable insights from their data, they … have outpaced the market. From their background as an Azure house, they've built an innovative data platform that allows data ingestion from any source and can work with any data warehouse. The Role As a customer-facing Azure Data Engineer, you'll work with clients to deliver tailored data solutions. You'll be … part of a 4-5 person implementation squad, building custom reports, visualisations, and data engineering solutions that help clients become self-sufficient with their data. What makes this role special: Direct client impact - see your work drive real business decisions Cutting-edge DBT implementation (key differentiator for the business) Variety of projects across different industries and use cases Opportunity More ❯
Employment Type: Full-Time
Salary: £60,000 per annum
Posted:

Data Migration Lead

Birmingham, England, United Kingdom
Hybrid / WFH Options
Kerv
Join to apply for the Data Migration Lead role at Kerv 1 day ago Be among the first 25 applicants Join to apply for the Data Migration Lead role at Kerv Data Migration Lead (SFIA Level 6+) Salary: competitive depending upon experience + benefits Where the job is based: (home-based, working with Kerv office/customer … re not just another tech company. We’re the problem solvers, the magicians who transform complex challenges into seamless digital experiences. Utilising a powerful blend of Power Platform, DevSecOps, Data experiences, and Software Engineering, we create business solutions that truly resonate with our clients driving extreme value! With our roots planted in Birmingham and branches spreading across the globe … that celebrates collaboration. Sharpen your prowess with a global multi-discipline team and be guided by the industry's most forward-thinking architects. Who We Are Looking For A Data Migration leader with expertise and deep understanding of data migrations to Dynamics 365 and other similar SaaS applications. At Kerv Digital we recognise the vital importance of a More ❯
Posted:

Senior Rust Engineer

Leicester, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: Search 5.0 is delighted to partner with an innovative AI tech start-up in the financial data sector, seeking a Rust Developer to join their exciting journey! Our client equips traders with tools that are faster, smarter, and easier to use. This is a fantastic opportunity to join a leading … AI company whose Machine Learning product suite creates new trading opportunities through real-time analytics, supported by a world-class, scalable, ultra-low latency architecture. The Data Platform is crucial to all capabilities and services, enabling data ingestion, analysis, querying, and storage at near-real-time speeds, setting our client apart from competitors. While most companies process … data in days, hours, or minutes, our client operates at nano to millisecond scales, a speed typically reserved for stock market trading systems. Job: Rust Developer Joining an incredible, small tribe you will play a pivotal role in driving the technical direction ensuring requirements are met and building a scalable product. Develop and maintain the platform services that underpin More ❯
Posted:

Data Migration Lead - Dynamics D365 - CRM, BC, F&O / F&SCM

Lincoln, England, United Kingdom
Hybrid / WFH Options
Experis UK
Join to apply for the Data Migration Lead - Dynamics D365 - CRM, BC, F&O/F&SCM role at Experis UK 2 days ago Be among the first 25 applicants Join to apply for the Data Migration Lead - Dynamics D365 - CRM, BC, F&O/F&SCM role at Experis UK Get AI-powered advice on this job … and more exclusive features. Full Time Role - Fully Hybrid - Work from Home - with Occasional Travel to Client Sites - Fully Expensed Enterprise Solution Data Migrations encompassing D365 CRM, BC, F&O/F&SCM for Small to Large-Scale Migrations within an Agile Delivery Model, working both hands-on and in a "Solution Lead Capacity". In this role, you … will Lead and Shape the Key, Focussed, Data Migration Service Portfolio that clients expect! Location is UK - Office HQ is West Midlands with a UK Wide Clientele - Work from Home is Guaranteed - Remote First! Salary: To Start is at the £80,000pa mark + An Excellent Benefits Package + Remote Working + Training & Certifications Full Security and DBS Vetting More ❯
Posted:

Senior Data Engineer

Northampton, England, United Kingdom
JR United Kingdom
note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the … Elastic Stack. Build dashboards and visualizations in Kibana to enable data-driven decision-making. Ensure high availability and disaster recovery for data systems, implementing appropriate backup and replication strategies. Document data architecture, workflows, and security protocols to ensure smooth operational handover and audit readiness. Experience required: Experience working as a Data Engineer in secure or regulated More ❯
Posted:

Senior Data Engineer

Chesterfield, England, United Kingdom
JR United Kingdom
note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the … Elastic Stack. Build dashboards and visualizations in Kibana to enable data-driven decision-making. Ensure high availability and disaster recovery for data systems, implementing appropriate backup and replication strategies. Document data architecture, workflows, and security protocols to ensure smooth operational handover and audit readiness. Experience required: Experience working as a Data Engineer in secure or regulated More ❯
Posted:

Head of Data Technology & Operations

Stratford-upon-Avon, England, United Kingdom
Cancer Research UK (CRUK)
Join to apply for the Head of Data Technology & Operations role at Cancer Research UK (CRUK) Join to apply for the Head of Data Technology & Operations role at Cancer Research UK (CRUK) Get AI-powered advice on this job and more exclusive features. 4,000 professionals, 0 days wasted, 1 incredible purpose. Together we will beat cancer. Head … of Data Technology & Operations Salary: £83,000 - £93,000 per annum Department: Chief Operating Office Contract: Permanent Hours: Full time 35 hours per week Location: Stratford, London Office-based with high flexibility (1-2 days per week in the office) Closing date: 1st July 11.59pm This vacancy may close earlier if a high volume of applications are received or … need to go much further and much faster. That’s why we’re looking for someone talented, someone determined, someone like you. We’re looking for a Head of Data Technology & Operations to join our Technology leadership team. In this crucial role, you will be accountable for the design, implementation, roll out and continuous improvement of fit-for-purpose More ❯
Posted:

Solution Architect - Data - Local to Pittsburgh/Cleveland/Dallas/Phoenix/Birmingham

Birmingham, England, United Kingdom
CGI
Solution Architect - Data - Local to Pittsburgh/Cleveland/Dallas/Phoenix/Birmingham Client: CGI Location: Birmingham, United Kingdom Job Category: Other EU work permit required: Yes Job Reference: 68452019cc93 Job Views: 4 Posted: 29.06.2025 Expiry Date: 13.08.2025 Job Description: Position Description: Solution Architect - Data - Local to Pittsburgh/Cleveland/Dallas/Phoenix/Birmingham We … re growing rapidly and are looking for a Solution Architect to join our team and help us develop and deploy enterprise-grade platforms that enable data-driven solutions. You will be responsible for designing, implementing, and overseeing data-driven solutions that support business objectives. This role bridges the gap between business needs and technical implementation, ensuring that solutions … inclusive place where you’re empowered to chart your own path, then we’d love to meet you. Your future duties and responsibilities: Develop end-to-end architecture for data science and AI/ML solutions. Ensure integration with existing enterprise systems and data pipelines. Define best practices for data ingestion, processing, storage, and model deployment. More ❯
Posted:

Consultant

Nottingham, England, United Kingdom
Tata Consultancy Services
Ability to troubleshoot technical issues and resolve problems. Bachelor’s degree in Computer Science, Information Technology, or related field. Proficiency in configuring Sprinklr Modern Care's/CCaas including data ingestion, workflow automation, and reporting. Experience with integrating Sprinklr Modern Care with external systems, including CRM systems, ticketing systems, and custom applications. Desirable skills/knowledge/experience … and direct experience working with social media management software. Knowledge of industry-standard frameworks (e.g., Contact center, ITIL). Certification in Sprinklr Modern Care or related technologies. Experience with data analytics and reporting tools. Familiarity with cloud-based technologies and software-as-a-service (SaaS) solutions. Rewards & Benefits TCS is consistently voted a Top Employer in the UK and More ❯
Posted:

Deputy Manager (ref. DM-1)

Worksop, England, United Kingdom
The Caldecott Foundation
are used by the world's most advanced government agencies and businesses, enabling them to go further, faster, and deeper into the dark web. Our proprietary technology provides actionable data that was previously unobtainable; delivering insights, situational awareness and sense-making helping our customers keep ahead. Our mission is simple - protect society from the threats contained within the dark … end components, and integrating user-facing elements in collaboration with front-end developers. The role of a Python developer is a broad one for us, covering the discovery and ingestion of new data, through to how it is managed and analyzed inside our products. We're looking for both experienced and junior developers, and are mostly looking for … you should possess in-depth knowledge of object-relational mapping, experience with server-side logic, and above-average knowledge of Python programming. WHAT WILL I DO? Produce and maintain data harvesting tools in Python Implementing web-scraping tools Maintaining existing infrastructure and services, covering Python, Elastic Search, Docker, Kubernetes and more Developing prototype products in line with new technical More ❯
Posted:

SIEM Application Engineer

Birmingham, Staffordshire, United Kingdom
Hybrid / WFH Options
BT Group
Engineering: Contribute to security engineering projects, transitions, and transformations. Work closely with security operations and associated security incident response systems Stay informed about emerging threats and security best practices. Data Ingestion and Enrichment: Configure Elasticsearch pipelines for data ingestion from various sources, primarily from Kafka Enhance data enrichment by integrating threat intelligence feeds and contextual … work towards achieving these. Skills Required for the Role Security and Compliance with Elastic Security: Set up access controls, authentication, and encryption using Elastic Security features. Ensure compliance with data protection regulations. Detection Rule Development: Ability to create, test, and optimise detection rules to identify suspicious activities and potential threats based on the MITRE ATT&CK Framework Performance Tuning … with Elasticsearch and Logstash: Fine-tune query performance using Elasticsearch indices and mappings. Monitor Logstash pipelines and optimize resource utilization. Kibana Visualization and Monitoring: Leverage Kibana for data visualization, dashboards, and real-time monitoring. Create custom visualizations to track data quality metrics and system performance. Elastic integration Integration of the SIEM with critical systems to provide alerting, monitoring More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:
Data Ingestion
the Midlands
10th Percentile
£57,750
25th Percentile
£63,750
Median
£65,000
75th Percentile
£65,000
90th Percentile
£66,500