12 of 12 Apache Jobs in Yorkshire

data architectures, including cloud-based and distributed systems. Strong proficiency in SQL and Python . Experience with data engineering and pipeline technologies such as Apache Airflow and Spark . Experience working with cloud platforms, particularly AWS and Azure . Knowledge of big data technologies and distributed data processing. Understanding ...

knowledge Demonstrable experience designing, deploying, and operating big data platforms at scale. Hands‐on experience with OSS data ecosystems (e.g., Spark, Trino, Airflow, Apache Superset, and similar technologies). Knowledge of cloud platforms and traditional on‐premise hosting; hands‐on experience with Azure, AWS and/ ...

Engineer delivering data engineering or integration platforms in cloud environments. Strong hands-on experience building production-grade ETL/ELT pipelines and orchestration with Apache Airflow . Solid experience on Google Cloud Platform , such as: Data services (e.g., BigQuery, Cloud Storage, Pub/Sub, Dataflow) and/or container ...

Consulting Global is seeking a Technical Lead to steer the development of a scalable, multi-tenant data integration platform on Google Cloud Platform using Apache Airflow. You will shape the technical direction, drive reliable ETLs, and raise the bar on automation, governance and performance across environments. You will mentor ...

Lead the engineering delivery and technical direction for a scalable, multi-tenant data integration platform on Google Cloud Platform (GCP). The platform uses Apache Airflow to orchestrate ETL pipelines and enables reliable movement of data from source systems through the platform into downstr click apply for full ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

Lead the engineering delivery and technical direction for a scalable, multi-tenant data integration platform on Google Cloud Platform (GCP). The platform uses Apache Airflow to orchestrate ETL pipelines and enables reliable movement of data from source systems through the platform into downstream vendor systems. Youll guide … contribution where needed (critical ETLs, framework components, design spikes, performance fixes). ETL orchestration & data movement Design and develop robust ETL pipelines orchestrated in Apache Airflow, including scheduling strategies, dependency management, retries, backfills, and processing. Establish patterns for onboarding new source systems and delivering data to downstream vendor systems ...

Lead the engineering delivery and technical direction for a scalable, multi-tenant data integration platform on Google Cloud Platform (GCP). The platform uses Apache Airflow to orchestrate ETL pipelines and enables reliable movement of data from source systems through the platform into downstream vendor systems. You’ll guide … contribution where needed (critical ETLs, framework components, design spikes, performance fixes). ETL orchestration & data movement Design and develop robust ETL pipelines orchestrated in Apache Airflow , including scheduling strategies, dependency management, retries, backfills, and processing. Establish patterns for onboarding new source systems and delivering data to downstream vendor systems ...

analytics tools Required Experience 5+ years in professional Java backend development Core Tech Stack Java, Spring Boot, JPA/Hibernate, MySQL (or other RDBMS), Apache Kafka, Linux Preferred/Plus Tech Directed Acyclic Graphs, Graph Databases, FFmpeg, CI/CD systems, Spring Cloud, Swagger, Snowflake, Apache Doris, Debezium … Database Management: Solid understanding of MySQL (or other major RDBMS) along with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working ...

/Hibernate.Proven experience designing and scaling RESTful APIs.Solid understanding of MySQL (or other major RDBMS) with query-tuning experience.Hands-on experience with Apache Kafka and change data capture (CDC) pipelines.Proficient in Java performance profiling and debugging.Comfortable in Linux environments, with strong communication and production-support skills.PLUSESPlease note that these … build automations.Experience with service-oriented architecture and multi-tier server applications.Exposure to Caching Systems, Spring Cloud, Swagger.Experience with data warehousing solutions like Snowflake/Apache Doris.Familiarity with Debezium.HOW TO APPLYPlease apply with a CV and cover letter demonstrating how you meet the skills above. If we would like ...

Hibernate. Proven experience designing and scaling RESTful APIs. Solid understanding of MySQL (or other major RDBMS) with query-tuning experience. Hands-on experience with Apache Kafka and change data capture (CDC) pipelines. Proficient in Java performance profiling and debugging. Comfortable in Linux environments, with strong communication and production-support … with service-oriented architecture and multi-tier server applications. Exposure to Caching Systems, Spring Cloud, Swagger. Experience with data warehousing solutions like Snowflake/Apache Doris. Familiarity with Debezium. HOW TO APPLYPlease apply with a CV and cover letter demonstrating how you meet the skills above. If we would ...

services remain secure, resilient, and aligned with business objectives. Key Responsibilities Define and maintain secure configuration standards across middleware technologies including WebSphere, IBM MQ, Apache, Tomcat, WebLogic, NGINX, and Node.js. Drive middleware security compliance and remediation activities. Develop platform strategy, roadmaps, and improvement plans. Manage and prioritise platform backlogs … guidance to stakeholders across the organisation. Essential Skills & Experience 5+ years' experience working with enterprise middleware technologies, including several of: IBM WebSphere IBM MQ Apache Tomcat WebLogic NGINX Node.js Strong background in middleware security and secure configuration management. Experience working with CIS Benchmarks . Previous experience leading technical teams. ...