76 to 100 of 270 Apache Jobs in England

Sr. Forward Deployed Engineer (FDE) - Public Sector

Location
Greater London, England, United Kingdom
Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals Familiarity with CI/CD for production deploymentsWorking knowledge of MLOps, ML/AI models ...

Senior DevSecOps Engineer

Location
West of England, England, United Kingdom
enquiring and creative mind. It would be nice if you had Microsoft - C#, .NET, SharePoint, SQL. Data Engineering – experience of one or more: Apache ecosystem, SQL, Python. Web - HTML, CSS, JavaScript, XML, SOAP. Experience with Secure DevSECOps within an Agile/SAFe environment. Containerisation - Docker, Kubernetes, Kubeflow etc. Software ...

ML Systems Engineer - Model Training and Infrastructure (SWE-focused LLMs)

Location
Greater London, England, United Kingdom
data generation for code or language models. Training LLMs in distributed environments. Reinforcement learning, preference optimisation or reward modelling. Data tooling such as SQL, Apache Iceberg or DuckDB. LLM‐as‐a‐judge systems or automated code evaluation. Reward‐hacking detection, robustness evaluation or safety‐focused training. Open‐source contributions ...

GCP Senior Data Engineer

Location
Greater London, England, United Kingdom
experience with BigQuery . Experience building and supporting production data pipelines. Experience developing transformation layers using dbt . Experience with orchestration tools such as Apache Airflow or Cloud Composer . Strong SQL and Python development skills. Experience designing scalable data models and data warehouse solutions. Strong stakeholder engagement ...

Data Architect

Location
Greater London, England, United Kingdom
years' experience delivering enterprise data platforms or analytics solutions. Strong commercial experience delivering Databricks solutions. Consulting or customer-facing delivery experience. Strong understanding of Apache Spark, modern Lakehouse architecture and Unity Catalog. Experience with Azure, AWS or GCP. Experience implementing CI/CD and deployment automation. Excellent communication ...

Resiliency Data Products - Data Engineer Vice President

Location
Greater London, England, United Kingdom
Experience with non-relational database technologies (for example, MongoDB) and associated query patterns Familiarity with large-scale data processing and analytics platforms (for example, Apache Spark or Hadoop) Experience implementing, or partnering closely on, data quality, metadata, and governance controls to improve reliability and auditability Understanding of modern distributed ...

Data Analyst

Location
Greater London, England, United Kingdom
databases Experience with one of Azure/AWS/GCP ETL tools like Informatica, Alteryx and Business Glossary tools like Collibra, Azure Purview or Apache Atlas. TDD/BDD, Experience working in an Agile development environment Identity management and synchronisation will be an add on for the resources Experience ...

Data Engineer, Data Platform

Location
Greater London, England, United Kingdom
platforms. You will leverage cloud-native technologies and AWS tools such as AWS S3, EKS, Glue, Airflow, Trino, and Parquet, while preparing to adopt Apache Iceberg for even greater performance and flexibility. You’ll tackle high-performance data workloads, ensuring seamless execution of massive queries, including 600+ billion ...

Senior DevOps Engineer (8 Month FTC)

Location
Greater London, England, United Kingdom
build elegant solutions Understanding of system administration tasks on some of the following; Operating systems (e.g. Linux, CoreOS and Windows) Application stacks (e.g. nginx, Apache, Tomcat, JBoss, Websphere, Hybris, IIS, .Net, Node.js, Solr) RDBMS (e.g. PostgreSQL, MySQL, Oracle, MS SQL) NoSQL (e.g. MongoDB, Cassandra, Riak) Containerisation and microservices (e.g. ...

Supply Chain and Ops AI infrastructure Architect

Location
City Of London, England, United Kingdom
preferred knowledge of AI infrastructure. Proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Professional experience ...

Senior EMEA AI Solutions Architect

Location
Greater London, England, United Kingdom
migration strategies as well as with machine learning, LLMs, and agentic AI workflows. Proficient in programming, debugging, and problem‐solving using SQL, Python, Apache Spark, cloud platforms, and Lakehouse architectures and with AI tools. Experience collaborating with Global System Integrators (GSIs) and third‐party consulting organizations to drive customer ...

Senior Data Engineer

Location
Horsham, England, United Kingdom
help design and deliver cutting-edge data solutions for customers operating in some of the UK's most complex and challenging environments. Using Databricks, Apache Spark and cloud-native technologies, you’ll develop scalable Lakehouse architectures and production-grade data pipelines that enable organisations to trust, share and exploit … opportunity to grow your career while helping customers unlock the power of their data. Responsibilities Design, build and optimise scalable data pipelines using Databricks, Apache Spark, PySpark and Delta Lake. Develop and implement modern Lakehouse architectures, applying Medallion (Bronze, Silver, Gold) design principles to support trusted and reusable data ...

Data Architect - AWS & Azure

Location
Greater London, England, United Kingdom
deliver scalable data architectures across AWS and Azure environments. Define and implement automated data pipelines using cloud-native technologies and frameworks such as Apache Spark. Design data integration solutions connecting cloud platforms with on-premises data sources. Establish event-driven architectures to support efficient data processing, workflow orchestration … Azure. Strong understanding of cloud data architecture, data integration and distributed data processing. Experience designing and implementing automated ETL/ELT pipelines. Experience with Apache Spark or equivalent distributed data processing technologies. Experience designing event-driven architectures and data processing workflows. Strong understanding of data pipeline orchestration, performance optimisation ...

Principal Data Engineer

Location
Greater London, England, United Kingdom
stores). Hands-on experience building, scaling, and shipping large-scale data platforms in production. Deep practical experience with distributed data processing frameworks (e.g., Apache Spark, Flink, Hadoop). Strong expertise in message brokers and event streaming platforms (e.g., Apache Kafka, Kinesis). End-to-end exposure … data pipeline lifecycle development, including extensive experience with workflow orchestration tools (e.g., Apache Airflow, Dagster). Hands-on expertise with cloud data warehouses (e.g., Snowflake, BigQuery, Redshift) and data lake architectures (e.g., Databricks, Delta Lake, Apache Iceberg). Advanced SQL skills and proficiency in Python. Strong background ...

Data Integration Engineer - Active SC

Hiring Organisation
Investigo Change Solutions
Location
London, United Kingdom
Employment Type
Contract
Contract Rate
GBP 540 Daily
Kubernetes. Experience building, supporting and monitoring data pipelines using Grafana, Prometheus and GitLab. Knowledge of enterprise job scheduling and orchestration tools such as Apache Airflow, JS7/Berlin or Tivoli Workload Scheduler (TWS). Experience with reporting and visualisation platforms including Power BI, Pentaho BA or SAP Business Objects. ...

Databricks Solution Architect

Hiring Organisation
GIS Recruiter Ltd
Location
London, United Kingdom
Employment Type
Permanent
Salary
£90000 - £120000/annum Hybrid Working
5+ years of hands-on Databricks platform experience. Extensive Azure Databricks architecture experience. Expert-level PySpark, Spark SQL and Python knowledge. Deep understanding of Apache Spark processing architecture. Extensive Delta Lake and Lakehouse architecture experience. Strong experience designing Medallion Architecture. Expert knowledge of Unity Catalog, governance, permissions and data ...

Data Engineer

Location
Greater London, England, United Kingdom
play a key role in shaping the future of the engineering function. Skills required: Strong experience with Python Excellent SQL knowledge Experience with Apache technologies (Spark, Airflow or Kafka) Proven experience designing and building scalable data pipelines Strong understanding of data architecture and distributed systems Experience working within ...

Java Developer

Hiring Organisation
Experis
Location
Telford, West Midlands, United Kingdom
Employment Type
Hybrid
have skills: RabbitMQ Java/Microservices MongoDB/MySQL Kubernetes Grafana/Prometheus Gitlab Job Scheduling tooling (e.g. Berlin/JS7 Job Scheduler, TWS, Apache Airflow). Reporting and visualisation tooling (from Pentaho BA, Power BI, SAP Business Objects). Nice to have: Experience with databases/data platforms ...

Lead Data Engineer

Location
Greater London, England, United Kingdom
languages like Python, or functional programming languages like Scala Demonstrated experience in design and development of big data applications using tech stacks like Databricks, Apache Spark, HDFS, HBase and Snowflake Commendable skills in building data products, by integrating large sets of data from hundreds of internal and external sources ...

Systems Integration Specialist

Location
Greater London, England, United Kingdom
Experience with Slack, Jira, GitHub or equivalent version control, Google Platform or equivalent cloud platforms. Nice to have Experience of using tools such as Apache Airflow, Mode Analytics, Terraform. Experience of New Product Introduction (NPI) processes or onboarding new products and features into a delivery pipeline. Experience with ...

Forward Deployed Engineering Manager

Location
Greater London, England, United Kingdom
teams in data engineering, data platforms, software engineering, or AI/ML. Technical Depth: Strong technical background capable of evaluating architectures spanning distributed computing (Apache SparkTM), Python/Scala, modern cloud ecosystems (AWS, Azure, GCP), CI/CD, and MLOps/GenAI frameworks. Leadership Skills: Proven ability to manage ...

AI Infrastructure Lead Architect

Location
City Of London, England, United Kingdom
knowledge of AI infrastructure. Good proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem‐solving skills and ability to work in a fast‐paced environment. Excellent communication and collaboration skills. Significant experience ...

Data Engineer

Location
Birmingham, England, United Kingdom
should have specialist experience in one or more of the following technologies**Azure Databricks*** Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.* Experience of Databricks ML and Azure … develop predictive models and drive business insights.* Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks and Azure Data Factory.* Azure Data Engineer Associate and Databricks Certified ...

Infrastructure Engineer- Manchester – National Security West

Hiring Organisation
Hackajob Ltd
Location
Manchester, North West, United Kingdom
Employment Type
Permanent Contract, Hybrid
configuration management and an interest in migrating to Ansible and cloud-native tooling. Experience managing Kubernetes platforms and deploying containerised applications. Knowledge of GitLab, Apache NiFi, HashiCorp Vault, Trend Micro Deep Security Manager, Ivanti device control, and Ansible Tower/AWX. Windows Infrastructure Experience with Windows Server administration, deployment ...

Lead Data Engineer, AI & Data Pipelines Architect

Location
Greater London, England, United Kingdom
software engineers and product managers to deliver robust data solutions. The role requires 7+ years in data engineering, including leadership, and strong expertise in Apache Spark and Azure Data Factory, with hands-on cloud experience across Azure/AWS/GCP. #J-18808-Ljbffr ...