1 to 25 of 70 Apache Jobs in the UK excluding London

Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data availability. Develop, maintain ...

Collaborate with senior developers and quantitative teams on new analytics capabilities Participate in debugging, testing, and production support activities Technology Environment Python Databricks/Apache Spark SQL Pandas/NumPy Git REST APIs Cloud technologies (Azure or AWS) Numerix (or equivalent pricing/risk platform) Jupyter/notebook-based ...

clear, structured data engineering framework Build, enhance, and maintain data pipelines within Snowflake Develop transformations and data models using DBT Orchestrate workflows using Apache Airflow Write clean, modular Python code for data engineering solutions Improve pipeline reliability, performance, and observability Introduce and embed CI/CD, testing, and deployment ...

What We're Looking For: Experience with MongoDB: Essential for this role! Technical Proficiency: Strong skills in SQL, Python, and familiarity with tools like Apache Spark, Kafka, and Airflow. Cloud Knowledge: Experience with AWS, Azure, or GCP is a plus. Data Understanding: Strong grasp of data modeling, schema design ...

systems. • Ability to obtain UK Security Clearance (SC). We'd love it if you also have: • Experience with data visualisation tools such as Apache Superset, Jupytr or Power BI • Familiarity with visualisation libraries like D3.js, Chart.js or Plotly for building interactive dashboards. • Exposure to DevOps practices including ...

Apache Spark Python AWS Cloud Data Pipelines A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical … complex, cloud-based data programme - designing, building, and maintaining data pipelines that process large volumes of data across a modern AWS-native stack. Using Apache Spark and PySpark for distributed data processing, Apache Airflow for orchestration, and a range of AWS services for storage, compute, and analytics ...

Apache Spark Python AWS Cloud Data Pipelines A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical … complex, cloud-based data programme - designing, building, and maintaining data pipelines that process large volumes of data across a modern AWS-native stack. Using Apache Spark and PySpark for distributed data processing, Apache Airflow for orchestration, and a range of AWS services for storage, compute, and analytics ...

systems. • Ability to obtain UK Security Clearance (SC). We’d love it if you also have: • Experience with data visualisation tools such as Apache Superset, Jupytr or Power BI • Familiarity with visualisation libraries like D3.js, Chart.js or Plotly for building interactive dashboards. • Exposure to DevOps practices including ...

with a backend or software engineering background Desirable: Experience with Snowflake Orchestration tools such as Dagster or Airflow dbt for data transformation and modelling Apache Iceberg or modern table formats Background in high-growth, consumer-facing products SALARY AND BENEFITS Base salary up to £100,000 Competitive benefits package ...

prompt engineering skills and the ability to critically evaluate AI-generated code for correctness, security, and financial accuracy Desirable, but no essential: Experience with Apache Airflow or similar workflow schedulers REST or GraphQL API design experience Knowledge of fixed income, FX, or derivatives products and associated P&L/ ...

central Bristol most of the time Nice to have: Experience in trading, betting or energy markets AWS data engineering tools, Docker, DevOps or Apache suite Analytical background and data modelling experience Why this role? Private medical, dental & life assurance 30 days annual leave + public holidays Cycle-to-Work ...

internal knowledge Competencies and Behaviours: 3+ years experience in data platform engineering, cloud engineering, or similar roles Strong hands-on experience with Databricks, including Apache Spark, Delta Lake, Workflows Proven experience designing and deploying data platforms on AWS and/or Azure (e.g. ADLS, S3, VNet/ ...

Agile Development using SCRUM. Experience of Oracle/Relational Databases and/or Mongo. Experience of GitLab CI/CD Pipelines. Experience of Apache NiFi. Experience in the use of Atlassian Suite - Bitbucket, Jira, Confluence. Experience of Elasticsearch and Kibana. Experience of Hibernate. Experience of AWS Services such ...

team members. Proficiency in Python, Java, and SQL is essential, along with experience in using AWS services and Docker. Candidates should be familiar with Apache Spark, Terraform, and GitLab for CI/CD. If you have a passion for improving testing frameworks and practices, we invite you to apply. ...

Version control using Git Containerisation experience with Docker Understanding of software engineering best practices and secure development principles Nice to Have: Experience with Kafka, Apache Pulsar or similar messaging technologies Exposure to CI/CD pipelines and automation tooling Familiarity with Agile or Scrum delivery environments Experience using tools ...

Agile Development using SCRUM. Advanced knowledge of Oracle/Relational Databases and/or Mongo. Experience of GitLab CI/CD Pipelines. Experience of Apache NiFi. Experience in the use of Atlassian Suite - Bitbucket, Jira, Confluence. Experience of Elasticsearch and Kibana. Advanced knowledge of Hibernate. Advanced knowledge ...

promote DevOps. Support internal and external stakeholders, including customers and regulatory authorities. Tools, Systems & Continuous Improvement Manage and optimise the use of tools (e.g. Apache Spark, AWS Glue, Databricks or equivalent). Support system enhancements of data processing and transformation, migrations, and process improvements. Contribute to the development ...

lead quality assurance and testing activities within a large-scale cloud data engineering programme operating across a modern AWS-native technology ecosystem, including Apache Airflow, Amazon Athena, AWS Glue, S3, EMR, DynamoDB, and related cloud services. This role combines hands-on technical leadership with test strategy ownership . … reconciliation, and performance under load Oversee PySpark-based data validation and interrogation activities on AWS EMR Support testing and monitoring of workflows orchestrated through Apache Airflow Drive root cause analysis for production data issues and platform defects Risk Management & Reporting Identify, assess, and communicate quality risks across releases ...

with Python-based development workflows and tooling Technology Stack: Azure Cloud Services C# (.NET 10) Python React.js and modern JavaScript (ES6+) Snowflake (Data Warehouse) Apache Airflow Terraform dbt SQL Server ...

development lifecycle from requirements to deployment Tech Stack Includes: Java, Python, Linux, Git, JUnit, GitLab CI/CD, Oracle, MongoDB, JavaScript/TypeScript, React, Apache NiFi, Elasticsearch, Kibana, AWS, Hibernate, Atlassian Suite What’s on Offer: Hybrid working and flexible schedules (4xFlex) Ongoing training and career development Exciting projects ...

delivery of secure, scalable and high-performance data solutions within a regulated environment. This role will focus heavily on the Elastic Stack and Apache NiFi, supporting enterprise-scale data ingestion, transformation and analytics capabilities across complex secure systems. The successful candidate will play a key role in architecting resilient … compliance with strict governance and security standards. KEY RESPONSIBILITIES Data Architecture & Engineering - Design and implement scalable, resilient data pipeline architectures using Elastic Stack and Apache NiFi - Develop secure frameworks for data ingestion, transformation and integration - Build and maintain batch and real-time data processing pipelines - Ensure high standards ...

delivery of secure, scalable and high-performance data solutions within a regulated environment. This role will focus heavily on the Elastic Stack and Apache NiFi, supporting enterprise-scale data ingestion, transformation and analytics capabilities across complex secure systems. The successful candidate will play a key role in architecting resilient … compliance with strict governance and security standards. KEY RESPONSIBILITIES Data Architecture & Engineering - Design and implement scalable, resilient data pipeline architectures using Elastic Stack and Apache NiFi - Develop secure frameworks for data ingestion, transformation and integration - Build and maintain batch and real-time data processing pipelines - Ensure high standards ...

skills and collaborative approach Degree in a relevant subject (or equivalent experience) Nice to have Exposure to Linux/Unix environments Familiarity with MySQL, Apache, or similar technologies Experience with Python (Flask) or backend integration work Exposure to AWS (Lambda, EC2, API Gateway, etc.) Understanding of microservices or serverless ...

Configuration (BigIP F5, HAProxy). Scripting using PowerShell, Bash, YAML, and Python. Email Support (Dovecot, Postfix, Spam Prevention, Mail Routing) Web Server Support (IIS, Apache, Tomcat). Public Cloud (AWS/Azure) + HSM Administration. Active SC Security Clearance is essential for this contract. ...

production environment. Excellent critical thinking skills and diligence. Excellent communication skills for effective collaboration with senior engineers and stakeholders. Desirable Experience: Familiarity with Apache Airflow for workflow orchestration. Experience with Alteryx for data preparation. Knowledge of REST APIs and integration patterns. Awareness of Agile methodologies . Qualifications: Bachelor ...