7 of 7 Data Ingestion Jobs in the West Midlands

Data Engineer- Azure £500-£525 pd via Umbrella Birmingham- 1-2 days per week in the office Leading business is looking to bring in a Data Engineer to develop, maintain, and operate data-ingestion routines across the estate to create a single, trusted data source that supports a data-driven culture. Role: Design and … implement scalable, secure data-processing pipelines using Azure Data Factory, Azure Synapse, and other Azure services. Manage and optimize data storage solutions, including Azure Data Lake Storage and Azure SQL Data Warehouse. Develop and maintain data models and overall data architecture to enable advanced analytics and business-intelligence reporting. Ensure data quality … and consistency through robust cleaning, transformation, and integration processes. Monitor, diagnose, and resolve data-related issues within the Azure environment to ensure high availability and optimal performance. Skills/experience: Proven Data Engineering experience with proficient SQL skills Experience of designing and implementing data solutions on Azure utilising Azure Blob Storage, Azure Data Lake Storage, Azure More ❯

Head of Data Engineering Our long-standing financial services client is seeking a Head of Data Engineering to lead a high-performing team responsible for delivering a complex data transformation.Looking for a true greenfield challenge? This is your chance to shape a transformation from the ground up, build cutting-edge data solutions, and lead a high … performing team that’s driving change across the business.To succeed in this role, you’ll bring hands-on experience owning and delivering Azure-based data platforms (Databricks, Synapse), alongside strong technical capability in designing and implementing data ingestion pipelines (ETL/ELT) and introducing event-driven architectures (Kafka) to support scalable, real-time solutions.Our client offers a … LTIP , £7.5k car allowance , and a comprehensive benefits package. The role is hybrid , based in Wolverhampton or Chatham . Key Responsibilities Lead, develop, and inspire a high-performing Data Engineering team, setting the vision, priorities, and best practices. Oversee the design, build, and optimisation of data ingestion, processing, and storage pipelines. Embed strong governance, documentation, and lifecycle More ❯

Data Platform Engineer DV Cleared £500 - £600 per day - Outside IR35 JOB DESCRIPTION This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring compliance with strict security standards and regulations. This is a … UK based onsite role with the option of compressed hours. The role will include: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance … with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. Build dashboards and visualizations in Kibana More ❯

IR35) Due to the nature of the role, candidates must hold active DV clearance. Role details: Our client, a leading defence and security company, are looking for DV cleared Data Engineers to join their team on a contract basis. This is a fully onsite role with the option of compressed hours. This role requires strong expertise in building and … managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring compliance with strict security standards and regulations. Responsibilities not limited to: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement … data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics More ❯

Migration Specialist to lead and support the migration of observability workloads from Splunk to Elasticsearch (ELK Stack) . The ideal candidate will bring hands-on expertise in Splunk architecture, data ingestion, alerting, and dashboarding, along with experience migrating workloads to Elasticsearch. In addition to migration duties, the candidate will maintain and enhance existing Splunk infrastructure, provide incident support … and problem-solving skills. Key Responsibilities: Migration: Develop and implement a comprehensive migration strategy from Splunk to Elasticsearch (ELK Stack). Assess existing Splunk configurations (dashboards, alerts, saved searches, data models) and recreate them in Kibana. Collaborate with Elastic teams to configure alerting and monitoring using Kibana, Elasticsearch Watcher, or third-party tools. Ensure migration plans include validation, rollback … and Support: Identify and resolve issues in Splunk and ELK environments. Assist teams with Splunk-related queries and optimization efforts. Skills and Qualifications: Essential: Proven expertise with Splunk architecture , data ingestion, dashboarding, alerting, and administration. Experience migrating Splunk workloads to Elasticsearch (ELK Stack) . Solid understanding of Kibana , Elasticsearch Watcher , and observability tooling. Proficiency in Linux/Unix More ❯

Data Engineer- Azure £500-£525 pd via Umbrella Birmingham- 1-2 days per week in the office Leading business is looking to bring in a Data Engineer to develop, maintain, and operate data-ingestion routines across the estate to create a single, trusted data source that supports a data-driven culture click apply for More ❯

solutions that are people-centred, safe, and designed for the future. Our human touch sets us apart from other consultancies, system integrators and software houses - with people, technology, and data at the heart of who we are, we believe in creating value and sustainability through everything we do for our clients, staff, communities, and the planet. We support our … queries, and alerts. You must hold a valid Elastic Certified Analyst certification, with full working knowledge of the competencies it covers, including anomaly detection, dashboard tuning, and timeline analysis. Data Ingestion & Log Pipeline Engineering: Build, manage and optimise complex Logstash pipelines, utilising a wide range of plugins to handle diverse log formats, transform data, and enrich security … telemetry. Ensure reliable ingestion of logs from both structured and unstructured sources into Elasticsearch. Syslog Configuration: Configure, manage rsyslog and configure centralised logging for network appliances, firewalls, and infrastructure components to ensure visibility and completeness of data collection. Linux Proficiency: Administer and troubleshoot Linux-based systems, with command-line fluency and scripting ability (e.g. Bash, Python) to support More ❯