1 to 25 of 78 Apache Jobs in the UK excluding London

Senior AWS Cloud Engineer | S4 | Data & AI Domain | Milton Keynes

Hiring Organisation
Santander UK
Location
Milton Keynes, United Kingdom
Employment Type
Full Time
Salary
80000 to 120000 GBP Annually
supporting Spark‐based platforms (e.g. EMR, Glue, Databricks) (Preferred) Proficient with DevOps tools and practices (Git, Jenkins, Docker, Kubernetes) as well as ETL frameworks (Apache Spark, Airflow, AWS IoT Analytics/Device Management/Events). (Preferred) Programming expertise in Python, Java, Scala, SQL, Spark, Unix shell scripting ...

FullStack DataOps Engineer

Hiring Organisation
Capgemini
Location
Manchester, United Kingdom
Employment Type
Full Time
native solutions that support analytics, automation, and digital transformation. Data Engineering, Full Stack & Platform Development Design and implement scalable data pipelines using tools like Apache Spark, Airflow, or dbt.Build and maintain data lakes, warehouses, and real-time streaming solutions. Develop APIs and microservices to expose data securely and efficiently. ...

Senior Data Engineer

Hiring Organisation
CGI
Location
City and Borough of Leeds, United Kingdom
Employment Type
Full Time
strong Python/PySpark engineers who can learn Foundry quickly are encouraged to apply. Essential qualifications • Extensive experience with Python and PySpark/Apache Spark. • Proven track record designing and delivering scalable data pipelines and data products. • Strong SQL and data modelling skills. • Experience with modern data architectures ...

Principal Data Engineer

Hiring Organisation
UST
Location
Nottingham, England, United Kingdom
Engineer, Principal Data Engineer or Technical Lead within a large-scale, data-driven organisation Strong hands-on software engineering expertise with Python, PySpark and Apache Airflow Deep experience designing and building distributed data processing systems and large-scale data platforms on AWS Strong knowledge of modern AWS data technologies ...

Databricks Architect

Hiring Organisation
Tredence Inc
Location
Leeds, England, United Kingdom
years overall experience in data engineering or data architecture. 5+ years of hands-on architecture experience specifically in Databricks . Expert in Apache Spark , PySpark , Databricks SQL , Delta Lake, and distributed systems. Strong understanding of Lakehouse architecture , BI ecosystems, and modern data platforms. Cloud expertise in Azure/ ...

Senior Software Enginner

Hiring Organisation
INTEC SELECT LIMITED
Location
London, South East, England, United Kingdom
Employment Type
Contractor
Contract Rate
£700 - £800 per day
Lead Backend Software Engineer – Data Services Federated Data Services | Distributed Systems | Apache Spark | DataFusion | Python | Kubernetes Location: London (2 days per week onsite) Rate: £700–£800 per day (Outside IR35) Duration: Initial 6-month contract with likely extension Overview We're looking for an experienced Lead Backend Software Engineer … data services capable of securely querying and processing data across multiple environments. Design high-performance data processing and streaming workflows using technologies such as Apache Spark, Apache DataFusion, or similar distributed query frameworks. Design and implement Kubernetes-based services and containerised workloads. Build secure APIs and backend services ...

Data Engineer

Hiring Organisation
Investigo
Location
Birmingham, West Midlands (County), United Kingdom
Employment Type
Permanent
Salary
£45000 - £50000/annum
analytics and reporting, and contributing to the adoption of AI-powered workflows and automation. Key Responsibilities & Skills: Build and maintain scalable data pipelines using Apache Airflow or similar orchestration tools. Develop integrations with internal and third-party APIs, ensuring reliable and efficient data flows. Design and optimise SQL-based ...

AI and Data Engineers/Architects (Security Cleared)

Hiring Organisation
Sanderson Government and Defence
Location
Cheltenham, Gloucestershire, South West, United Kingdom
Employment Type
Permanent
platform role Strong hands-on experience with AWS (EC2, S3, RDS, Lambda, Redshift, Glue, Athena) Experience with real-time and batch data processing - Apache Flink, Kafka, Spark, or similar Proficiency in one or more of: Python, Java, Scala Experience with data modelling , ETL processes, and distributed systems Comfortable working ...

Dev Ops Engineer

Hiring Organisation
Aioi Nissay Dowa Europe
Location
NE12, Forest Hall, North Tyneside, Tyne & Wear, United Kingdom
Employment Type
Permanent
Salary
£55000 - £60000/annum
/CD pipelines and deployment automation. • Familiarity with monitoring, logging, and observability tools. • Awareness of application platforms and middleware such as Java, Tomcat, Apache, and NodeJS. • Experience using Git and collaborative development workflows. • Basic scripting skills using Shell or Python. • Understanding of containerisation concepts using Docker. • Strong problem-solving ...

Staff Software Engineer (Java, Glasgow)

Hiring Organisation
LMA Recruitment
Location
Glasgow, Lanarkshire, Scotland, United Kingdom
Employment Type
Contractor
Contract Rate
£550 - £600 per day
HTML5, CSS3, SASS Cloud, DevOps & Infrastructure Kubernetes (GKE/IKP/AWS EKS) Docker, Terraform CI/CD: GitHub Actions, Jenkins Messaging, Streaming & ETL Apache Kafka Apache Flink, Apache Beam Redis Databases PostgreSQL Oracle MongoDB Security & Compliance OAuth 2.0, Okta Enterprise security scanning: Checkmarx, Aqua Security Strong ...

Lead Data Engineer

Hiring Organisation
Arc IT Recruitment
Location
London, South East, England, United Kingdom
Employment Type
Full-Time
Salary
Competitive salary
optimising ETL/ELT pipelines. Strong understanding of Lakehouse, Data Warehouse, and Data Lake architectures. Experience with Azure Data Factory, Azure Synapse, and Apache Spark. Knowledge of data modelling, semantic models, and enterprise reporting solutions. Experience implementing data governance, security, and quality frameworks. Strong understanding of modern data engineering ...

Data Engineer | 6 months

Hiring Organisation
IntaPeople
Location
Cardiff, Butetown Community, South Glamorgan, United Kingdom
Employment Type
Contract
Contract Rate
£400 - £475/day
range of projects that include internal and external suppliers. Essential Skills Proven experience as a Data Engineer Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles. Experience of using programming languages such as Python, Scala and SQL. Demonstrable knowledge of data modelling ...

Infrastructure Engineers (DV Security Clearance)

Hiring Organisation
CGI
Location
Gloucestershire, United Kingdom
Employment Type
Full Time
ecosystem •Infrastructure as Code using Terraform, Ansible, or CloudFormation •GitOps tooling such as Argo CD •Scripting (Python, Shell) •Container orchestration tools (e.g., Docker Swarm, Apache Mesos) •Service Mesh technologies (e.g., Istio, Linkerd) •Monitoring and observability tools (Prometheus, Grafana, ELK) •Applying infrastructure security, compliance, and governance practices •Working within agile ...

Senior Data Engineer

Hiring Organisation
Lightfoot
Location
Exeter, Devon, England, United Kingdom
Employment Type
Full-Time
Salary
Competitive salary
ensuring data integrity across every layer Lead the transformation of legacy reporting (Python, SQL, Excel) into a secure,scalableand fully observable platform powered by Apache Airflow (WMAA). Define and publish data quality metrics that drive engineering decisions anddemonstrateplatform health to stakeholders Champion AI and modern data tooling ...

Site Reliability Engineers (DV Security Clearance)

Hiring Organisation
CGI
Location
Gloucestershire, United Kingdom
Employment Type
Full Time
TypeScript), Bash Frontend: Vue CI/CD & Automation: Jenkins, GitLab CI, Ansible, Cucumber Cloud & Platforms: AWS, OpenShift, Linux Infrastructure as Code: Terraform Data & Streaming: Apache NiFi Monitoring & Logging: Grafana, ELK Stack, SonarQube Version Control: GitLab Automation & Infrastructure as Code (IaC) Automate infrastructure provisioning, configuration, and CI/CD pipelines ...

Senior Data Engineer Python AWS

Hiring Organisation
Client Server
Location
Cheshire, United Kingdom
have strong hands-on experience of building scalable data pipelines in cloud based environments using tools such as DBT, AWS Glue, AWS Lake Formation, Apache Spark and Amazon Redshift You have a good knowledge of data modelling, ELT design patterns, data governance and security best practices You're collaborative ...

Data Architect

Hiring Organisation
KBC Technologies Group
Location
Halifax, England, United Kingdom
performance bottlenecks, and crossplatform data integration issues. Top 10 Skillset & Qualities (Ideal Candidate) 1. Deep Expertise in Google Cloud Data Services BigQuery, GCS, Dataflow (Apache Beam), Pub/Sub, Dataproc, Cloud Composer, Storage Write API. 2. Data Ingestion Engineering Mastery Handson experience designing frameworks to load data from APIs ...

Databricks Platform Engineer

Hiring Organisation
Sagacity
Location
London, South East, England, United Kingdom
Employment Type
Full-Time
Salary
Competitive salary
internal knowledge Competencies and Behaviours: 3+ years experience in data platform engineering, cloud engineering, or similar roles Strong hands-on experience with Databricks, including Apache Spark, Delta Lake, Workflows Proven experience designing and deploying data platforms on AWS and/or Azure (e.g. ADLS, S3, VNet/ ...

Data Engineer SQL Databricks - Fintech

Hiring Organisation
Client Server
Location
Newcastle Upon Tyne, Tyne and Wear, North East, United Kingdom
Employment Type
Permanent, Work From Home
modern data engineering best practices You have experience with Databricks, ideally also Azure You have experience of working with technologies such as SQL, Apache Spark and Python including PySpark and Pandas You're excited to join a start-up in a role that you can shape and influence ...

Cyber Analytics Data Engineer

Hiring Organisation
Oscar Associates (UK) Limited
Location
West Midlands, United Kingdom
Employment Type
Permanent
Salary
£500 - £560 per day
development experience Databricks and PySpark expertise Experience with cloud-based data platforms (AWS, Azure and/or GCP) Data Engineering and analytics at scale Apache Spark ecosystems Cyber Security or Security Analytics experience CI/CD and automated deployment practices Strong stakeholder engagement and communication skills You will play ...

Cyber Data Analytics Engineer

Hiring Organisation
Oscar Associates (UK) Limited
Location
Manchester, North West, United Kingdom
Employment Type
Contract
Contract Rate
£500 - £560 per day
development experience Databricks and PySpark expertise Experience with cloud-based data platforms (AWS, Azure and/or GCP) Data Engineering and analytics at scale Apache Spark ecosystems Cyber Security or Security Analytics experience CI/CD and automated deployment practices Strong stakeholder engagement and communication skills You will play ...

OS Software Developer

Hiring Organisation
Guidant Global
Location
Gloucester, Gloucestershire, South West, United Kingdom
Employment Type
Contract
Contract Rate
£500 - £600 per day
Ability to build and deploy scalable applications or libraries Strong debugging, problem-solving, and performance optimisation skills Understanding of open-source licensing (MIT, GPL, Apache) Experience with cloud platforms such as AWS or Azure Ability to create clear, comprehensive technical documentation Experience working within development teams on both minor ...

Senior Data Engineer

Hiring Organisation
Matalan
Location
Liverpool, Merseyside, North West, United Kingdom
Employment Type
Permanent
with experience building scalable, reusable frameworks Deep understanding of lakehouse and medallion architectures Experience with data pipeline tools (e.g. DataFactory, Dataflow/Apache Beam) and workflow orchestration A track record of delivering cloud cost optimisation (FinOps) and managing large-scale data environments Strong knowledge of data governance, data lineage ...

Head of Engineering

Hiring Organisation
Jobleads-UK
Location
Stratford-upon-Avon, England, United Kingdom
scaling data platforms, with a strong focus on Azure Cloud technologies (e.g., Azure Data Factory, Azure Synapse, Azure Data Lake, Azure SQL Database, Databricks, Apache Spark). Proven experience leading the implementation of data platform strategies and managing large‐scale data infrastructure initiatives using Azure. Demonstrated experience implementing modern ...

Software Engineer, Full-Stack Applications - Ratings Technology

Hiring Organisation
Fitch Group
Location
Manchester, United Kingdom
Employment Type
Full Time
concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications • Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications • Advanced Data Management – Strong SQL design, query optimization, and database architecture expertise • Observability – Experience ...