17 of 17 Apache Jobs in the Midlands

SQS. Strong experience with DevOps and Infrastructure as Code tooling, including Terraform, CI/CD pipelines, Git and Jenkins. Strong experience developing on Apache Spark or Hadoop. Significant programming experience using Scala or Python. Strong understanding of cloud security, data privacy, access control and governance principles in data platform ...

Data Engineer 6 Month Contract Location: Hereford (Onsite 4 days a week) Rate: £700 - £800 per day (INSIDE IR35) Skills: Python, Azure, Kubernetes, Apache Airflow, Apache Spark, DV Clearance We are looking to recruit a DV Cleared Data Engineer for a leading technology consultancy. This will be joining … Work across Azure environments on the low side Support data engineering workloads within Kubernetes environments on the high side Develop and maintain workflows using Apache Airflow Work with Apache Spark for large-scale data processing Support the ongoing development and improvement of established data pipelines Help ensure data ...

have skills: RabbitMQ Java/Microservices MongoDB/MySQL Kubernetes Grafana/Prometheus Gitlab Job Scheduling tooling (e.g. Berlin/JS7 Job Scheduler, TWS, Apache Airflow). Reporting and visualisation tooling (from Pentaho BA, Power BI, SAP Business Objects). Nice to have: Experience with databases/data platforms ...

should have specialist experience in one or more of the following technologies**Azure Databricks*** Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.* Experience of Databricks ML and Azure … develop predictive models and drive business insights.* Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks and Azure Data Factory.* Azure Data Engineer Associate and Databricks Certified ...

with APIs and integrating multiple data sources. Confidence working with legacy systems and non‐modernised environments. Knowledge of web scraping techniques. Experience with Tableau, Apache, or digital analytics tools is beneficial but not essential. BENEFITS The successful Data Engineer will receive the following benefits: Salary between ...

with cloud‐based data warehouses (e.g., Snowflake, GBQ). Familiarity with cloud‐based data pipeline services (e.g. AWS Glue) or distributed processing frameworks like Apache Spark. Equal Opportunity Employment Goldman Sachs is an equal opportunity employer and does not discriminate on the basis of race, colour, religion, sex, national ...

etc.) Exposure to Angular, AlpineJS, Bootstrap Database tools: Toad, DBeaver, SQL Developer IDEs: VS Code, Eclipse, etc. Typescript TLS, PKI - certs etc. Keyfactor, Sectigo. Apache config Containers (Docker, Podman, etc) Testing tools: Selenium, JUnit Data formats: XML, JSON, YAML AWS, Azure, Cloud etc. Login Authentication (SSO, MFA) CI/ ...

Mockito Experience with clean architecture, DI, modular design Comfortable owning CI/CD, code quality, observability Familiarity with Docker, Maven, Jenkins ⭐ Nice to Have Apache Calcite Starburst or federated query engines JVM performance tuning High-throughput service interfaces (REST/gRPC) Data governance or policy enforcement layers 👥 This Role ...

hybrid work from home policy. Qualifications Commercial experience with web client or server-side development Proficiency with Golang, TypeScript, React, SQL, Kafka or Apache Flink Background delivering software in continuous change environments Familiarity with AI tools to enhance developer productivity Clear technical communication with cross-functional stakeholders Proven grasp ...

trainingof new members of the data engineering team. Requirements Knowledge: A demonstrablenetworking background – experience in system administration. Knowledge of big datatechnologies and ecosystems (e.g. Apache NiFi). Knowledge of currentmarket and emerging tools in data analytical and SIEM platforms. Knowledgeof network security implementations (e.g., IDS, IPS, EDR), including theirfunction ...

pipelines using Python and PySpark Building and optimising data workflows using AWS Glue, Athena, Redshift , and related AWS services Supporting modern lakehouse architectures, including Apache Iceberg Working with relational and NoSQL databases to ensure data is reliable and fit for purpose Collaborating with analysts, engineers, product owners, and stakeholders … Athena, Amazon Redshift , and cloud‐based data platforms Strong SQL skills and experience working with both relational and NoSQL databases Experience supporting or developing Apache Iceberg or modern lakehouse solutions Experience working in Agile delivery environments Familiarity with Linux and Git‐based version control Desirable experience Experience with Amazon ...

client base. Key Responsibilities The successful candidate will be responsible for: Developing, maintaining, and optimising backend services using PHP and the LAMP stack (Linux, Apache, MySQL, PHP). Working with version control, primarily GIT, to manage and track code changes. Debugging issues and reviewing code from peers to ensure ...

Bigdata Technologies – PySpark, Spark • Coding Languages – Python, SQL • AWS services – Glue, Cloud formation, Lake Formation, IAM, Lambda, Redshift • Exposure to cloud technologies – Snowflake, Redshift, Apache Flink and Apache Kafka. • Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives. • Understand project requirements ...

clear SLAs and backups. Own the observability platform (ClickHouse, OpenTelemetry): logs, metrics, traces, synthetics, SLOs and actionable alerting. Own the data platform: Glue pipelines, Apache Iceberg lakehouse, Redshift and CDC; serve BI users with traceable datasets and handle data requests with strong privacy practice. Operate platform security controls (identity … security practice; willing to participate in the on‐call rota. Excellent communication; comfortable prioritising, working with stakeholders and reporting upwards. Desirable ClickHouse, Redshift or Apache Iceberg; data engineering with AWS Glue or Spark. Delivering the technical side of a security standard (Cyber Essentials Plus, ISO 27001). Experience overseeing ...

Data Engineer 6 Month Contract Location: Hereford (Onsite 4 days a week) Rate: £700 - £800 per day (INSIDE IR35) Skills: Python, Azure, Kubernetes, Apache Airflow, Apache Spark, DV Clearance We are looking to recruit a DV Cleared Data Engineer for a leading technology consultancy click apply for full ...

DIHOP, DIHOC, AWS Glue, DBT, Snowflake, Databricks).o Apply architectural patterns for data lakes, streaming, and batch processing.o Exposure to cloud technologies – Snowflake, Redshift, Apache Flink and Apache Kafka.**Technical POCs**o Technical assessment of Cloud data technologies to leverage considering Fraud Business and technical requirementso Design, execute ...

PROMIS MES environment running on VAX/VMS platforms. Configure, maintain, and support PROMIS components including: Datalink Interactive Scripts (Interactive with DCL) GUI via Apache Server Other core PROMIS modules (ASPC, TMS, AE, RTI) and utilities ODS (Operational Data Store) XML Gateway Develop, maintain, and troubleshoot VMS DCL scripts … PROMIS architecture and manufacturing workflows. Strong experience with: PROMIS System Monitoring System Administration and Maintenance Datalink configuration and troubleshooting Interactive Scripts Knowledge of Apache and IIS Production support and troubleshooting Strong proficiency with OpenVMS DCL (Digital Command Language), including developing, modifying, and troubleshooting DCL command procedures and batch jobs. ...