51 to 74 of 74 Apache Jobs in the UK excluding London

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real-time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

maintaining scalable data pipelines and integrations. Developing robust ETL and data transformation processes to support analytics and reporting requirements. Working with Snowflake, DBT, Apache Airflow, AWS, SQL and Python to deliver high-quality data solutions. Collaborating with Data Architecture, DevOps and business stakeholders to ensure trusted and accessible data … ideally within AWS. Data modelling, transformation and orchestration methodologies. Delivering high-quality, well-documented and thoroughly tested data solutions. Experience with Snowflake, DBT and Apache Airflow. Interest in AI and emerging technologies within the data engineering landscape. THE BENEFITS: You will receive a salary ...

documentation and technical reports. MOD or Defence security standards and accreditation processes. Working with secure or safety-critical systems. Exposure to technologies such as Apache Kafka, Apache NiFi, Node.js, TypeScript, MongoDB, AI or Machine Learning would also be beneficial. Security Clearance Due to the nature of the work ...

software development team Hands‐on experience designing and developing data integration/ETL pipelines from diverse data sources and formats Hands‐on experience with Apache Airflow, dbt, and Python Strong database skills with Postgres SQL, DynamoDB, Snowflake, and Databricks Experience collaborating with Agile teams, product owners, and cross‐functional … highly scalable data engineering solutions that power Moody’s next‐generation digital content platform. Design, develop, and maintain scalable data pipelines using DataBricks, Snowflake, Apache Airflow, dbt (SQL), and Python within AWS Support platform optimization, infrastructure improvements, process control enhancements, and system upgrades Collaborate with Moody’s technical teams ...

Responsibilities Data Integration & ETL Design, develop, and optimise ETL processes for efficient data integration Build and maintain data pipelines using tools such as FME, Apache NiFi, and SQL Loader Develop Python scripts and automated processes to support data ingestion Systems & Development Support data streaming solutions via REST APIs … data concepts Experience or knowledge of SQL and/or Python Good communication skills and attention to detail Desirable: Experience with ETL tools (e.g. Apache NiFi, FME, SQL Loader) Knowledge of AWS services (e.g. Lambda, APIs) Understanding of data modelling, data mining, or segmentation Hands-on experience with databases ...

follow up corrective actions Good knowledge of TCP/IP networking concepts including Routing, Switching, Firewalling, including Layer 7 firewalls Linux (CentOS/Ubuntu, Apache, MySQL) Desirable: Project planning and delivery experience Asterisk/VoIP platforms Windows Server and VMware intermediate level experience Hardware and/or software systems ...

transparency.**Skills & Experience****Essential**Proven in-depth commercial experience in the following key areas:* Databricks – Lakehouse architecture, Spark, Delta Lake, workflows and performance tuning.* Apache Spark & Scala – High-performance distributed data processing and optimisation.* Cloud Data Engineering (AWS) – Cloud-native data platforms and distributed computing.* Data Services Architecture & Engineering … knowledge of client core business functions* Demonstrated leadership, project management, and development skills* Relationship and consensus building skills**Preferred*** Kafka/Event-Driven Architecture* Apache Iceberg/Delta Lake* Python* AI/ML & LLM integration* Financial Services/Capital Markets**Education:*** Bachelor’s degree/University degree or equivalent ...

Testing Guild with common standards such as metrics and use of test tools Here's a snapshot of the technologies that we use: Scala Apache Spark Databricks Apache Parquet Azure Cloud Platform Azure DevOps (Test plans, Backlogs, Pipelines) GIT We'd love to hear from ...

teams and setting best practice standards Designing data models, ETL pipelines, warehousing solutions and distributed systems Building and supporting real-time streaming platforms using Apache Flink and related technologies Ensuring compliance with industry standards and government regulations Tracking delivery against agreed designs and managing design deviations Supporting pre-sales … data architecture on complex, secure programmes Strong hands-on AWS experience (EC2, S3, RDS, Lambda, Redshift); Azure or GCP a bonus Proven experience using Apache Flink for real-time, high-throughput data processing Experience leading, mentoring and developing technical teams Confident engaging with senior technical and non-technical stakeholders ...

Python development skills • Previous experience across UK policing data and technology programmes • AWS and cloud application development • OpenShift, Kubernetes or similar container platforms • Apache technologies, ideally Apache NiFi • Building secure applications that process, integrate or manage complex data • CI/CD, DevOps and modern software engineering practices ...

analytics tools Required Experience 5+ years in professional Java backend development Core Tech Stack Java, Spring Boot, JPA/Hibernate, MySQL (or other RDBMS), Apache Kafka, Linux Preferred/Plus Tech Directed Acyclic Graphs, Graph Databases, FFmpeg, CI/CD systems, Spring Cloud, Swagger, Snowflake, Apache Doris, Debezium … Database Management: Solid understanding of MySQL (or other major RDBMS) along with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working ...

Large-scale Linux operating system upgrades. Kernel patching across extensive server estates. Automation of infrastructure operations and maintenance activities. Development of orchestration workflows using Apache Airflow. Building automation tooling using Python and Ansible. Enhancing observability, monitoring and operational controls. Supporting the introduction of live-patching technologies. The role requires … excellence. Automation Engineering Design, develop and maintain infrastructure automation solutions. Develop tooling and integrations using Python and Ansible. Build and enhance orchestration workflows within Apache Airflow. Create automated pre-change validation and post-change verification processes. Improve efficiency and reduce manual intervention through automation. Platform Observability Implement monitoring ...

Senior Data Platform Engineer – Elastic Stack/Apache NiFi | Defence | Bristol Inside IR35 | On-site We're supporting a major defence technology programme looking for an experienced Senior Data Engineer to join a secure enterprise platform team. This role is focused on building and maintaining secure, scalable data pipelines … rather than traditional analytics or reporting. You'll work with technologies including Apache NiFi and the Elastic Stack (Elasticsearch, Logstash & Kibana) to deliver resilient data integration platforms supporting mission-critical environments. You'll be involved in: Designing and maintaining enterprise data pipelines Building secure data ingestion and transformation workflows ...

ingestion, distributed systems, analyst tooling and secure microservices, solving complex engineering challenges in highly regulated environments. What you'll be building Java services and Apache NiFi data pipelines that ingest, enrich and process large-scale mission data Secure Spring Boot microservices deployed on OpenShift and Kubernetes Event-driven distributed … search, visualise and manage operational data Cross-domain solutions that move information securely between networks of different classifications Technology Java, Spring Boot, REST APIs Apache NiFi, distributed data processing, message brokers Kubernetes, OpenShift, cloud-native architecture JavaScript, web API integration and authentication GitLab, CI/CD, SecDevOps, observability Database ...

DIHOP, DIHOC, AWS Glue, DBT, Snowflake, Databricks).o Apply architectural patterns for data lakes, streaming, and batch processing.o Exposure to cloud technologies – Snowflake, Redshift, Apache Flink and Apache Kafka.**Technical POCs**o Technical assessment of Cloud data technologies to leverage considering Fraud Business and technical requirementso Design, execute ...

/frameworks (DIHOP, DIHOC, AWS Glue, DBT, Snowflake, Databricks).Apply architectural patterns for data lakes, streaming, and batch processing.Exposure to cloud technologies – Snowflake, Redshift, Apache Flink and Apache Kafka.Technical POCsTechnical assessment of Cloud data technologies to leverage considering Fraud Business and technical requirementsDesign, execute and lead ...

PROMIS MES environment running on VAX/VMS platforms. Configure, maintain, and support PROMIS components including: Datalink Interactive Scripts (Interactive with DCL) GUI via Apache Server Other core PROMIS modules (ASPC, TMS, AE, RTI) and utilities ODS (Operational Data Store) XML Gateway Develop, maintain, and troubleshoot VMS DCL scripts … PROMIS architecture and manufacturing workflows. Strong experience with: PROMIS System Monitoring System Administration and Maintenance Datalink configuration and troubleshooting Interactive Scripts Knowledge of Apache and IIS Production support and troubleshooting. Strong proficiency with OpenVMS DCL (Digital Command Language), including developing, modifying, and troubleshooting DCL command procedures and batch jobs. ...

Apache Associates are currently working with an innovative SaaS organisation that is investing heavily in AI across its products. We’re looking for an AI Software Engineer with strong C# .NET experience to join the team and help turn emerging AI capabilities into genuine, production-ready product features. This … wants to work somewhere that is genuinely putting AI into production, we'd be very interested in hearing from you. Apply now or contact Apache Associates for a confidential discussion. ...

Apache Associates are currently working with an innovative SaaS organisation that is investing heavily in AI across its products. We’re looking for an AI Software Engineer with strong C# .NET experience to join the team and help turn emerging AI capabilities into genuine, production-ready product features. This … wants to work somewhere that is genuinely putting AI into production, we'd be very interested in hearing from you. Apply now or contact Apache Associates for a confidential discussion. ...

Apache Associates are currently working with an innovative SaaS organisation that is investing heavily in AI across its products. We’re looking for an AI Software Engineer with strong C# .NET experience to join the team and help turn emerging AI capabilities into genuine, production-ready product features. This … wants to work somewhere that is genuinely putting AI into production, we'd be very interested in hearing from you. Apply now or contact Apache Associates for a confidential discussion. ...

Apache Associates are working with an ambitious SaaS organisation that is investing heavily in AI across its products and engineering function. We’re looking for a Senior Applied AI Engineer to take a leading role in turning AI capabilities into genuinely useful, production-ready solutions. This is a senior … with LLMs in the real world – while helping other engineers do the same – we'd love to hear from you. Apply now or contact Apache Associates for a confidential discussion. ...

Apache Associates are working with an ambitious SaaS organisation that is investing heavily in AI across its products and engineering function. We’re looking for a Senior Applied AI Engineer to take a leading role in turning AI capabilities into genuinely useful, production-ready solutions. This is a senior … with LLMs in the real world – while helping other engineers do the same – we'd love to hear from you. Apply now or contact Apache Associates for a confidential discussion. ...

Apache Associates are working with an ambitious SaaS organisation that is investing heavily in AI across its products and engineering function. We’re looking for a Senior Applied AI Engineer to take a leading role in turning AI capabilities into genuinely useful, production-ready solutions. This is a senior … with LLMs in the real world – while helping other engineers do the same – we'd love to hear from you. Apply now or contact Apache Associates for a confidential discussion. ...