25 of 25 Data Ingestion Jobs in the West Midlands

Skills & Expertise ·AWS Core Services: S3, Redshift, Glue, Athena, Lake Formation, IAM ·Data Engineering/ETL: ·Building and optimizing ETL pipelines ·Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python) ·Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: ·Expertise in Apache Iceberg table format ·Schema evolution, partitioning, compaction & metadata management ·Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: ·Data modeling, distribution styles, sort keys ·Workload management (WLM) ·Performance optimization & troubleshooting ·Python: ·Automation scripts ·Data processing workflows ·Monitoring, debugging, validation scripts AWS Support ...

Skills & Expertise ·AWS Core Services: S3, Redshift, Glue, Athena, Lake Formation, IAM ·Data Engineering/ETL: ·Building and optimizing ETL pipelines ·Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python) ·Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: ·Expertise in Apache Iceberg table format ·Schema evolution, partitioning, compaction & metadata management ·Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: ·Data modeling, distribution styles, sort keys ·Workload management (WLM) ·Performance optimization & troubleshooting ·Python: ·Automation scripts ·Data processing workflows ·Monitoring, debugging, validation scripts AWS Support ...

Skills & Expertise ·AWS Core Services: S3, Redshift, Glue, Athena, Lake Formation, IAM ·Data Engineering/ETL: ·Building and optimizing ETL pipelines ·Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python) ·Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: ·Expertise in Apache Iceberg table format ·Schema evolution, partitioning, compaction & metadata management ·Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: ·Data modeling, distribution styles, sort keys ·Workload management (WLM) ·Performance optimization & troubleshooting ·Python: ·Automation scripts ·Data processing workflows ·Monitoring, debugging, validation scripts AWS Support ...

Skills & Expertise ·AWS Core Services: S3, Redshift, Glue, Athena, Lake Formation, IAM ·Data Engineering/ETL: ·Building and optimizing ETL pipelines ·Data ingestion, transformation & orchestration using AWS Glue (PySpark/Python) ·Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: ·Expertise in Apache Iceberg table format ·Schema evolution, partitioning, compaction & metadata management ·Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: ·Data modeling, distribution styles, sort keys ·Workload management (WLM) ·Performance optimization & troubleshooting ·Python: ·Automation scripts ·Data processing workflows ·Monitoring, debugging, validation scripts AWS Support ...

Head of Data Engineering Our long-standing financial services client is seeking a Head of Data Engineering to lead a high-performing team responsible for delivering a complex data transformation.Looking for a true greenfield challenge? This is your chance to shape a transformation from the ground … build cutting-edge data solutions, and lead a high-performing team that’s driving change across the business.To succeed in this role, you’ll bring hands-on experience owning and delivering Azure-based data platforms (Databricks, Synapse), alongside strong technical capability in designing and implementing data ingestion ...

Data Platform Engineer DV Cleared £500 - £600 per day - Outside IR35 JOB DESCRIPTION This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring … This is a UK based onsite role with the option of compressed hours. The role will include: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality ...

role, candidates must hold active DV clearance. Role details: Our client, a leading defence and security company, are looking for DV cleared Data Engineers to join their team on a contract basis. This is a fully onsite role with the option of compressed hours. This role requires strong expertise … building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring compliance with strict security standards and regulations. Responsibilities not limited to: Design, develop, and maintain secure and scalable data ...

support the migration of observability workloads from Splunk to Elasticsearch (ELK Stack) . The ideal candidate will bring hands-on expertise in Splunk architecture, data ingestion, alerting, and dashboarding, along with experience migrating workloads to Elasticsearch. In addition to migration duties, the candidate will maintain and enhance existing … Responsibilities: Migration: Develop and implement a comprehensive migration strategy from Splunk to Elasticsearch (ELK Stack). Assess existing Splunk configurations (dashboards, alerts, saved searches, data models) and recreate them in Kibana. Collaborate with Elastic teams to configure alerting and monitoring using Kibana, Elasticsearch Watcher, or third-party tools. Ensure ...

Fullstack at Camunda, you'll help shape our next-generation analytics product for process orchestration—building reliable, high‐throughput SaaS capabilities that turn massive data flows into clear insights and action. You'll work end‐to‐end across Java services and React interfaces, collaborating closely with a talented global … tuning, and verifying impacts in production‐like conditions. Design and build backend APIs (Java) and frontend dashboards (React) to retrieve, aggregate, and visualize analytics data from distributed data stores. Create data exporters and connectors that enable third‐party BI tools to pull detailed analytics from multiple distributed ...

Fullstack at Camunda, you'll help shape our next-generation analytics product for process orchestration—building reliable, high‐throughput SaaS capabilities that turn massive data flows into clear insights and action. You'll work end‐to‐end across Java services and React interfaces, collaborating closely with a talented global … tuning, and verifying impacts in production‐like conditions. Design and build backend APIs (Java) and frontend dashboards (React) to retrieve, aggregate, and visualize analytics data from distributed data stores. Create data exporters and connectors that enable third‐party BI tools to pull detailed analytics from multiple distributed ...

Fullstack at Camunda, you'll help shape our next-generation analytics product for process orchestration—building reliable, high‐throughput SaaS capabilities that turn massive data flows into clear insights and action. You'll work end‐to‐end across Java services and React interfaces, collaborating closely with a talented global … tuning, and verifying impacts in production‐like conditions. Design and build backend APIs (Java) and frontend dashboards (React) to retrieve, aggregate, and visualize analytics data from distributed data stores. Create data exporters and connectors that enable third‐party BI tools to pull detailed analytics from multiple distributed ...

Fullstack at Camunda, you'll help shape our next-generation analytics product for process orchestration—building reliable, high‐throughput SaaS capabilities that turn massive data flows into clear insights and action. You'll work end‐to‐end across Java services and React interfaces, collaborating closely with a talented global … tuning, and verifying impacts in production‐like conditions. Design and build backend APIs (Java) and frontend dashboards (React) to retrieve, aggregate, and visualize analytics data from distributed data stores. Create data exporters and connectors that enable third‐party BI tools to pull detailed analytics from multiple distributed ...

Fullstack at Camunda, you'll help shape our next-generation analytics product for process orchestration—building reliable, high‐throughput SaaS capabilities that turn massive data flows into clear insights and action. You'll work end‐to‐end across Java services and React interfaces, collaborating closely with a talented global … tuning, and verifying impacts in production‐like conditions. Design and build backend APIs (Java) and frontend dashboards (React) to retrieve, aggregate, and visualize analytics data from distributed data stores. Create data exporters and connectors that enable third‐party BI tools to pull detailed analytics from multiple distributed ...

Fullstack at Camunda, you'll help shape our next-generation analytics product for process orchestration—building reliable, high‐throughput SaaS capabilities that turn massive data flows into clear insights and action. You'll work end‐to‐end across Java services and React interfaces, collaborating closely with a talented global … tuning, and verifying impacts in production‐like conditions. Design and build backend APIs (Java) and frontend dashboards (React) to retrieve, aggregate, and visualize analytics data from distributed data stores. Create data exporters and connectors that enable third‐party BI tools to pull detailed analytics from multiple distributed ...

Excellent verbal and written communications skills and stakeholder engagement at all levels Able to develop and execute test plans, test cases, test data, test scenarios, and other testing related plans and documentation based on the requirements and technical specifications Plan, develop, execute, maintain and improve Automated Test Frameworks … testability Previous experience within Identity and Access Management- preferable Any exposure to SailPoint IdentityIQ, Identity warehousing, and working with protocols and formats for data ingestion such as SCIM, REST API, LDAP, OIDC and CSV Experience of testing graph database management systems (GDBMS) ServiceNow, AD, AWS, Azure integrations Testing ...

Excellent verbal and written communications skills and stakeholder engagement at all levels Able to develop and execute test plans, test cases, test data, test scenarios, and other testing related plans and documentation based on the requirements and technical specifications Plan, develop, execute, maintain and improve Automated Test Frameworks … testability Previous experience within Identity and Access Management- preferable Any exposure to SailPoint IdentityIQ, Identity warehousing, and working with protocols and formats for data ingestion such as SCIM, REST API, LDAP, OIDC and CSV Experience of testing graph database management systems (GDBMS) ServiceNow, AD, AWS, Azure integrations Testing ...

Excellent verbal and written communications skills and stakeholder engagement at all levels Able to develop and execute test plans, test cases, test data, test scenarios, and other testing related plans and documentation based on the requirements and technical specifications Plan, develop, execute, maintain and improve Automated Test Frameworks … testability Previous experience within Identity and Access Management- preferable Any exposure to SailPoint IdentityIQ, Identity warehousing, and working with protocols and formats for data ingestion such as SCIM, REST API, LDAP, OIDC and CSV Experience of testing graph database management systems (GDBMS) ServiceNow, AD, AWS, Azure integrations Testing ...

infrastructure, and contributing to system design as we scale Security and compliance - Executing on security and compliance roadmaps and hardening our software, systems and data security. Ensuring we have access controls, audit and compliance processes in place. Observability and Reliability - Owning monitoring and alerting systems to ensure … apply new technologies. Our tech stack and day to day tools are: TypeScript for the majority of our applications, frontends, and microservices Python for data ingestion and our AI services AWS for our cloud infrastructure Postgres for our data storage Terraform for defining infrastructure as code What ...

infrastructure, and contributing to system design as we scale Security and compliance - Executing on security and compliance roadmaps and hardening our software, systems and data security. Ensuring we have access controls, audit and compliance processes in place. Observability and Reliability - Owning monitoring and alerting systems to ensure … apply new technologies. Our tech stack and day to day tools are: TypeScript for the majority of our applications, frontends, and microservices Python for data ingestion and our AI services AWS for our cloud infrastructure Postgres for our data storage Terraform for defining infrastructure as code What ...

infrastructure, and contributing to system design as we scale Security and compliance - Executing on security and compliance roadmaps and hardening our software, systems and data security. Ensuring we have access controls, audit and compliance processes in place. Observability and Reliability - Owning monitoring and alerting systems to ensure … apply new technologies. Our tech stack and day to day tools are: TypeScript for the majority of our applications, frontends, and microservices Python for data ingestion and our AI services AWS for our cloud infrastructure Postgres for our data storage Terraform for defining infrastructure as code What ...

infrastructure, and contributing to system design as we scale Security and compliance - Executing on security and compliance roadmaps and hardening our software, systems and data security. Ensuring we have access controls, audit and compliance processes in place. Observability and Reliability - Owning monitoring and alerting systems to ensure … apply new technologies. Our tech stack and day to day tools are: TypeScript for the majority of our applications, frontends, and microservices Python for data ingestion and our AI services AWS for our cloud infrastructure Postgres for our data storage Terraform for defining infrastructure as code What ...

infrastructure, and contributing to system design as we scale Security and compliance - Executing on security and compliance roadmaps and hardening our software, systems and data security. Ensuring we have access controls, audit and compliance processes in place. Observability and Reliability - Owning monitoring and alerting systems to ensure … apply new technologies. Our tech stack and day to day tools are: TypeScript for the majority of our applications, frontends, and microservices Python for data ingestion and our AI services AWS for our cloud infrastructure Postgres for our data storage Terraform for defining infrastructure as code What ...

workshops Start Date: ASAP Overview A large UK organisation is undertaking a greenfield implementation of Dynamics 365 Customer Insights Journeys and a new MarTech data environment. This role will lead the end-to-end design and build of a multi-channel customer engagement and insights platform. This … Architect who excels in fast-paced delivery settings. Key Responsibilities Architect and implement D365 Customer Insights Journeys as the central orchestration platform. Develop a data-driven engagement model using Azure for profiling, segmentation and insight. Enable and integrate multi-channel communications, including: Web Push WhatsApp/RCS (via Twilio ...

workshops Start Date: ASAP Overview A large UK organisation is undertaking a greenfield implementation of Dynamics 365 Customer Insights Journeys and a new MarTech data environment. This role will lead the end-to-end design and build of a multi-channel customer engagement and insights platform. This … Architect who excels in fast-paced delivery settings. Key Responsibilities Architect and implement D365 Customer Insights Journeys as the central orchestration platform. Develop a data-driven engagement model using Azure for profiling, segmentation and insight. Enable and integrate multi-channel communications, including: Web Push WhatsApp/RCS (via Twilio ...

workshops Start Date: ASAP Overview A large UK organisation is undertaking a greenfield implementation of Dynamics 365 Customer Insights Journeys and a new MarTech data environment. This role will lead the end-to-end design and build of a multi-channel customer engagement and insights platform. This … Architect who excels in fast-paced delivery settings. Key Responsibilities Architect and implement D365 Customer Insights Journeys as the central orchestration platform. Develop a data-driven engagement model using Azure for profiling, segmentation and insight. Enable and integrate multi-channel communications, including: Web Push WhatsApp/RCS (via Twilio ...