101 to 125 of 270 Apache Jobs in England

Lead Software Engineering — Trading Tech

Location
City of Westminster, England, United Kingdom
Experience with streaming and/or messaging technologies (for example, Kafka or IBM MQ). Experience with caching technologies (for example, Redis, GemFire, or Apache Ignite). Working knowledge of relational and non-relational databases. Experience working in agile teams with strong engineering hygiene (testing, reviews, and operational readiness ...

Middle Java Developer

Location
Greater London, England, United Kingdom
Java and Spring components, including Spring Data JPA. Experience with containerisation technologies such as Docker and Kubernetes. Experience with stream processing frameworks such as Apache Flink is a plus but not required. Familiarity with SSO mechanisms including OpenID is a plus but not required. A basic understanding of core ...

Software Engineer - Java (Cambridge)

Location
Cambridge, England, United Kingdom
etc.) Exposure to Angular, AlpineJS, Bootstrap Database tools: Toad, DBeaver, SQL Developer IDEs: VS Code, Eclipse, etc. Typescript TLS, PKI – certs etc. Keyfactor, Sectigo Apache config Containers (Docker, Podman, etc) Testing tools: Selenium, JUnit Data formats: XML, JSON, YAML AWS, Azure, Cloud etc. Login Authentication (SSO, MFA) CI/ ...

Data Architect

Location
Greater London, England, United Kingdom
pipelines, inference serving, and GenAI/RAG architectures grounded in proprietary content. Lakehouse and modern data platform design: strong knowledge of open table formats (Apache Iceberg, Delta Lake), zone architecture (landing, cleansed, curated), streaming and batch pipeline patterns, and data quality frameworks. Project engagement and design assurance: able ...

Senior Data Engineer London

Location
Greater London, England, United Kingdom
operating ETL/ELT pipelines and large-scale data architectures. Hands-on experience with modern data stacks — our tech includes Python, SQL, Snowflake, Apache Iceberg, AWS S3, PostgresDB, Airflow, dbt, and Apache Spark, deployed via AWS, Docker, and Terraform (experience with similar technologies is essential). Ability ...

Data Engineer, Portugal London

Location
Greater London, England, United Kingdom
environments. Technical Skills: Experience building and operating ETL/ELT pipelines. Hands-on experience with modern data stacks — our tech includes Python, SQL, Snowflake, Apache Iceberg, AWS S3, PostgresDB, Airflow, dbt, and Apache Spark, deployed via AWS, Docker, and Terraform (experience with some of these or similar technologies ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...

Principal Data Engineer

Location
Greater London, England, United Kingdom
Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...

Senior Data Engineer, Fabric & Analytics (Remote)

Location
Sheffield, England, United Kingdom
support comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, UnityCatalog, and Apache Atlas tomaintaindata integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining and optimising data … latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta TablesorApache Iceberg:Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance Tools:Experience with data governance tools like Azure Purview, UnityCatalog, or Apache ...

Senior Data Engineer, Fabric & Analytics (Remote)

Location
Greater London, England, United Kingdom
support comprehensive data analysis and reporting. Implement and uphold best practices in data governance, security, and compliance, using tools like Azure Purview, UnityCatalog, and Apache Atlas tomaintaindata integrity and trust. Ensure data quality and integrity through meticulous attention to detail and rigorous QA processes, continually refining and optimising data … latency, such as managing 1 billion+ records or terabyte-sized databases. Knowledge of Delta TablesorApache Iceberg:Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently. Knowledge of Data Governance Tools:Experience with data governance tools like Azure Purview, UnityCatalog, or Apache ...

Solution Architect

Location
Greater London, England, United Kingdom
integration, and production support. Good understanding of ETL/ELT, data warehousing, data lakes, dimensional modelling, batch processing, and stream processing. Experience with Apache Beam, Kafka, REST APIs, Docker, Kubernetes, or GKE. Experience with data formats such as JSON, CSV, Avro, and Parquet. Working knowledge of Git, automated testing … observability, and release management. Ability to design solutions for scalability, resilience, security, performance, operability, and cost efficiency. Preferred Skills Experience with Cloud Composer or Apache Airflow, Dataproc or Spark, Dataform or dbt, and metadata-driven pipeline frameworks. Exposure to Terraform or another infrastructure-as-code tool. Knowledge of Dataplex ...

Data Engineer | Hybrid Birmingham

Location
Birmingham, England, United Kingdom
model: Hybrid 3 days on site each week Rate: up to £530 per day --- Responsibilities Design, implement, and maintain high-throughput data pipelines using Apache Spark and cloud-native tools Develop ETL/ELT workflows for managing structured and unstructured data in AWS cloud environments Collaborate with AI/… analytics enablement --- Requirements (Must Have Skills) 5+ years of data engineering experience building high-performing and large-scale data solutions Hands-on expertise in Apache Spark development using Java or Scala (Python experience considered) Strong proficiency in AWS cloud services (S3, EMR, Glue, IAM, etc.) and cloud-native architecture ...

Data Engineer, Data Cloud

Location
Greater London, England, United Kingdom
services, a good understanding of cloud architecture, and proficiency with Terraform for provisioning and managing cloud infrastructure Experience building streaming data pipelines using Apache Flink, Apache Kafka, Spark Structured Streaming, or similar technologies Knowledge of modern data lakehouse architectures and ecosystem such as Kafka, Flink, Spark, Databricks, Snowflake ...

Principal Data Engineer

Hiring Organisation
Morson Edge
Location
Manchester, North West, United Kingdom
Employment Type
Temporary Contract, Hybrid
Salary
£800 - 1,000 per day + None
effectively with stakeholders and champion better ways of working. Nice to Have Experience with Docker, Java/Scala, Kafka, Pulsar, Azure Event Hub, Collibra, Apache Iceberg, Apache Arrow, PySpark or AI engineering technologies such as Snowflake AI, LangChain, LlamaIndex or Pinecone would be advantageous. This is a great ...

Principal Data Engineer

Hiring Organisation
Morson Edge
Location
Manchester City Centre, Manchester, United Kingdom
Employment Type
Contract
Contract Rate
£800 - £1000/day None
effectively with stakeholders and champion better ways of working. Nice to Have Experience with Docker, Java/Scala, Kafka, Pulsar, Azure Event Hub, Collibra, Apache Iceberg, Apache Arrow, PySpark or AI engineering technologies such as Snowflake AI, LangChain, LlamaIndex or Pinecone would be advantageous. This is a great ...

Lead Data Engineer

Location
Manchester, England, United Kingdom
including target modelling, cutover approach, reconciliation strategy and technical risk management. Design and build the real‐time data architecture using Amazon MSK/Apache Kafka and PySpark Structured Streaming (evaluating Apache Flink where it is the better fit), including event schema governance, exactly‐once semantics and stream … large‐scale batch and streaming processing, and strong command of data modelling and data warehousing concepts. Production experience designing and operating streaming architectures with Apache Kafka or Amazon MSK, including stream processing with Spark Structured Streaming. Hands‐on experience with open table formats, such as Apache Iceberg ...

Strategic Account Executive - Consumer Goods Industry

Location
Greater London, England, United Kingdom
unify data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the creators of Lakehouse, Apache Spark, Delta Lake and MLflow. Benefits Databricks strives to provide comprehensive benefits and perks. For specific details in your region, refer to the regional ...

Principal Platform Architect — AI-Driven Enterprise Platform

Location
Cambridge, England, United Kingdom
hybrid) across large structured or semi-structured datasets. Hands-on experience with data lake, warehouse or lakehouse architectures at scale: Delta Lake or Apache Iceberg, schema evolution patterns, partition pruning, and the trade-offs between query performance and storage cost. Infrastructure fluency on AWS with Kubernetes or ECS. ...

Director: Lead Data Engineer

Location
Greater London, England, United Kingdom
product managers, to understand data requirements and deliver high-quality solutions Architect and implement data ingestion, transformation, and storage processes using tools such as Apache Spark, Azure Data Factory, and other similar technologies Optimize data pipeline performance, ensuring data accuracy, reliability, and timely delivery Mentor and guide junior data … Engineering, or a related field 7+ years of experience in data engineering, with at least 3 years in a leadership role Strong proficiency in Apache Spark, Azure Data Factory, and other data pipeline tools Experience with cloud platforms such as Azure, AWS, or GCP Solid understanding of data modeling ...

Data Lineage & Governance Analyst

Location
Greater London, England, United Kingdom
provenance. Hands‐on experience with data lineage/metadata tooling in enterprise environments (e.g., Collibra, Alation, Informatica EDC/IDMC, IBM Infosphere, Microsoft Purview, Apache Atlas, Amundsen, DataHub or similar). Proven ability to build lineage for complex platforms: data lakes, warehouses, marts, and distributed processing (Spark‐based pipelines … production environments. Solid knowledge of Hive, Impala, HDFS, and Parquet. Advanced SQL skills; experience with Oracle databases is preferred. Working knowledge of Autosys & Apache Airflow. Experience with CI/CD tools (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift). Familiarity with AWS S3 for large-scale data storage. ...

Data Engineer

Location
Wigan, England, United Kingdom
driving business growth and commercial success. Reporting into the Data Discipline Lead you will build streaming and batch data pipelines on AWS using Apache Spark Structured Streaming, Lakeflow Spark Declarative Pipelines (formerly DLT), and Kafka (MSK), ensuring our business teams have fast, trusted data at their fingertips. This … Looking For: We’re looking for experienced Data Engineers with proven expertise in building pipelines in Databricks and a strong grasp of Apache Spark, whether in PySpark, including Structured Streaming. You should have experience with Kafka (MSK) and real-time data ingestion, as well as a deep understanding ...

Technical Lead/Associate Architect – PHP / Laravel (LAMP)

Location
Greater London, England, United Kingdom
13.x, REST API design* Data: MySQL (schema design, indexing, query optimization, replication/backup strategies)* Platform: Linux (Ubuntu), Docker, web server tuning (Nginx/Apache)* Cloud: AWS EC2, S3, Secrets Manager (plus IAM, VPC, security groups)* CI/CD: Jenkins, GitHub Actions* Testing: Phpunit, unit/integration/ ...

Technical Delivery Lead - Cloud Data & ETL (GCP)

Location
Greater London, England, United Kingdom
Glass UK seeks a hands-on Technical Delivery Lead to drive engineering strategy for a scalable multi-tenant data integration platform built on Apache Airflow and Google Cloud. You will lead the delivery of production-grade ETL/ELT pipelines and cloud solutions, collaborating with cross-functional teams ...

Data Architect

Location
Basildon, England, United Kingdom
TOAD. AWS Data Stack: Strong working knowledge of the AWS cloud data ecosystem, specifically requiring experience with S3, AWS Glue, PySpark, EMR, and Apache Iceberg. Architecture & Design: Ability to translate complex business requirements into high-level and low-level technical designs (HLD/LLD), ensuring data quality and governance. ...

Data Architect

Hiring Organisation
Randstad Technologies Recruitment
Location
Basildon, Essex, United Kingdom
Employment Type
Permanent
Salary
£75000 - £80000/annum
TOAD. AWS Data Stack: Strong working knowledge of the AWS cloud data ecosystem, specifically requiring experience with S3, AWS Glue, PySpark, EMR, and Apache Iceberg. Architecture & Design : Ability to translate complex business requirements into high-level and low-level technical designs (HLD/LLD), ensuring data quality and governance. ...