76 to 100 of 103 Apache Jobs in England

GCP Data Engineer

Hiring Organisation
MANNING SERVICES LIMITED
Location
England, United Kingdom
hands-on experience with Google Cloud Platform (BigQuery, Cloud Storage, etc.). Proven experience in DBT for data transformation. Expertise in Cloud Composer/Apache Airflow for workflow orchestration. Advanced proficiency in Python. Solid experience with Terraform for infrastructure provisioning. Demonstrated experience in migrating legacy systems (on-prem ...

Senior AI Engineer

Hiring Organisation
Harnham
Location
City of London, London, United Kingdom
services including Vertex AI, Model Garden, BigQuery, Cloud Run and Google’s ADK. • Experience with document and data processing using tools such as Apache Tika, plus storage or caching technologies like Postgres, Redis, GCS or BigQuery. • Solid DevOps practices including CI/CD, Docker, observability and automated testing. ...

Senior AI Engineer

Hiring Organisation
Harnham
Location
Sheffield, England, United Kingdom
services including Vertex AI, Model Garden, BigQuery, Cloud Run and Google’s ADK. • Experience with document and data processing using tools such as Apache Tika, plus storage or caching technologies like Postgres, Redis, GCS or BigQuery. • Solid DevOps practices including CI/CD, Docker, observability and automated testing. ...

Junior Data Engineer

Hiring Organisation
Information Tech Consultants
Location
Greater London, England, United Kingdom
schema). Version Control Practical experience with Git (branching, merging, pull requests). Preferred Qualifications (A Plus) Experience with a distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage … . Exposure to workflow orchestration tools ( Apache Airflow, Prefect, or Dagster ). Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field. ...

Infrastructure Cloud Architect

Hiring Organisation
Pearson Whiffin IT & Digital
Location
West Malling, Kent, South East, United Kingdom
Employment Type
Permanent
Salary
£85,000
M365) Azure DevOps Cloud Security & Governance Applications & Platforms .NET Framework/.NET Core Microsoft Dynamics SQL Server SSRS M365 Apps Exchange SharePoint IIS Apache Security OWASP Firewalls ISO27001 Azure Security Benchmark Microsoft Defender zScaler CASB technologies Networking Enterprise switching & routing MPLS ExpressRoute Azure Front Door Routing protocols Firewalls Infrastructure ...

Data Engineer

Hiring Organisation
Searchability®
Location
Greater Manchester, England, United Kingdom
optimise scalable data pipelines within a Databricks Lakehouse environment. You’ll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams …/7 Collaborative office environment with regular social and charity events And Much More!!! DATA ENGINEER – ESSTENTIAL SKILLS Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands-on experience with Kafka (MSK) and real-time data ingestion ...

Snowflake Data Architect

Hiring Organisation
Hirexa Solutions UK
Location
London, South East, England, United Kingdom
Employment Type
Contractor
Contract Rate
£400 - £450 per day
architecture to support data consumption for reporting systems, operational applications, and analytics platforms. Implement automation, orchestration, and scalable pipeline frameworks using tools such as Apache Airflow. Collaborate with business stakeholders and technical teams to align the data platform with enterprise data strategy. Support hospitality analytics use cases, including guest … predictive analytics, recommendation engines, and customer behaviour analytics. Ability to design AI-ready data platforms for future analytics use cases. Preferred Skills Experience with Apache Airflow for pipeline orchestration. Knowledge of CI/CD pipelines, DevOps, and Git-based development workflows. Experience with data governance, metadata management, and enterprise ...

Senior Data Engineer - Platform Engineering

Hiring Organisation
IO Associates
Location
London, United Kingdom
Employment Type
Permanent
Salary
£85,000
across the platform. Key Responsibilities Design and maintain data pipelines to process large geospatial and sensor datasets. Develop distributed systems using tools such as Apache Spark, Kafka, and Hadoop. Integrate diverse data sources including satellite, remote sensing, IoT, and GIS feeds. Build analytical models and workflows to detect patterns … Science, Engineering, or similar. Knowledge of visualization tools such as Tableau, Mapbox, or D3. Experience with real-time streaming frameworks like Kafka Streams or Apache Flink. Background in geospatial or environmental intelligence projects. Understanding of coordinate systems, spatial projections, and data formatting standards. ...

ML Ops Engineer

Hiring Organisation
Circadia Health
Location
London Area, United Kingdom
models are always running, always accurate, and always improving. Key Responsibilities ML Pipeline Orchestration & Automation Own and extend Circadia’s ML pipeline orchestration using Apache Airflow, including training, evaluation, and deployment workflows. Build and maintain automated pipelines for model retraining, validation, and promotion across development, staging, and production environments. … closely related infrastructure role. Strong proficiency in Python for ML pipeline development, tooling, and automation. Hands-on experience with ML pipeline orchestration tools, particularly Apache Airflow. Experience with model registries and experiment tracking platforms (MLflow preferred). Experience deploying and operating ML workloads on AWS (Batch ...

Snowflake Data Architect

Hiring Organisation
Hirexa Solutions UK
Location
Hemel Hempstead, Hertfordshire, England, United Kingdom
Employment Type
Contractor
Contract Rate
£400 per day
architecture to support data consumption for reporting systems, operational applications, and analytics platforms. Implement automation, orchestration, and scalable pipeline frameworks using tools such as Apache Airflow. Collaborate with business stakeholders and technical teams to align the data platform with enterprise data strategy. Support hospitality analytics use cases, including guest … predictive analytics, recommendation engines, and customer behaviour analytics. Ability to design AI-ready data platforms for future analytics use cases. Preferred Skills Experience with Apache Airflow for pipeline orchestration. Knowledge of CI/CD pipelines, DevOps, and Git-based development workflows. Experience with data governance, metadata management, and enterprise ...

Data Architect

Hiring Organisation
Raytheon
Location
Warminster, Wiltshire, South West, United Kingdom
Employment Type
Permanent
Proven track record with data governance, quality, lineage, and security practices. Experience with real-time/streaming data technologies, data Ingestion/ETL (e.g., Apache Kafka, Apache NiFi, Kinesis, Pub/Sub). Experience in, or knowledge of, DevSecOps Tooling and Processes. Self-starter with the ability ...

Application Analyst

Hiring Organisation
Hays
Location
Woking, Surrey, South East, United Kingdom
Employment Type
Permanent, Work From Home
Salary
£45,000
looking to learn and develop themselves. Application Support Experience: minimum 3 years' experience of supporting client-server back-office and web-based systems (Apache; IIS). Database Proficiency: Exhibit experience with relational databases like Microsoft SQL Server and Oracle. Windows Server Environment: Understand the key workings of Windows Server ...

Data Engineer

Hiring Organisation
SearchWorks
Location
Manchester Area, United Kingdom
improve team quality Support production systems and troubleshoot issues Write clean, tested, and maintainable code Tech Stack Python & SQL AWS (EMR, Athena, Lambda) Apache Spark (Scala or PySpark) Big data/distributed processing tools What They’re Looking For Strong experience as a Data Engineer using Python … Experience working with AWS or similar cloud platforms Hands-on experience with Apache Spark Ability to work with large, complex datasets Strong problem-solving and analytical mindset Understanding of CI/CD, testing, and agile development practices Confident communicating with technical and non-technical stakeholders Exposure to AI tools ...

Lead Python Data Engineer - Leading Technology AI Brand

Hiring Organisation
MLR Associates
Location
London, United Kingdom
Employment Type
Permanent
Salary
GBP 70,000 - 100,000 Annual
acceptable). Experience with NoSQL databases. Experience with vector databases used in modern AI systems. Strong programming experience in Python. Frameworks/Infrastructure:- Apache Spark Apache Airflow Kafka Elasticsearch/OpenSearch ...

Databricks Data Architect - Hybrid - Permanent

Hiring Organisation
Tenth Revolution Group
Location
London, South East, England, United Kingdom
Employment Type
Full-Time
Salary
£120,000 - £125,000 per annum
capabilities across the organization. Key Responsibilities Design and implement data architectures on the Databricks Lakehouse Platform Build and optimize ETL/ELT pipelines using Apache Spark and Databricks Implement Delta Lake and medallion architecture (Bronze, Silver, Gold) Ensure data governance, security, and performance optimization Integrate Databricks with cloud platforms … stakeholders to deliver scalable data solutions Required Skills & Qualifications Databricks Certification (e.g., Databricks Certified Data Engineer Associate/Professional) Strong experience with Databricks, Apache Spark, and Delta Lake Proficiency in Python, SQL, and data pipeline development Experience with cloud platforms (Azure, AWS, or GCP) Solid understanding of modern data ...

Data Engineer - Manchester (Hybrid)

Hiring Organisation
Circle Group
Location
Manchester, North West, United Kingdom
Employment Type
Permanent, Work From Home
Salary
£55,000
code and sharing knowledge across the team Supporting production systems when needed The platform uses a mix of modern data tooling including AWS and Apache Spark, so there's plenty of opportunity to work with big data technologies. What they're hoping you'll bring You don't need … complex data problems An interest in improving pipelines, tooling and processes A collaborative approach and willingness to share ideas Exposure to tools like Apache Spark, modern data platforms, or AI tools for development productivity would be a bonus but isn't essential. The setup The team works ...

Data Engineer - Manchester (Hybrid)

Hiring Organisation
Circle Group
Location
Manchester, North West, United Kingdom
Employment Type
Contract, Work From Home
Contract Rate
£250 - £500 per day + Bens/hybrid
code and sharing knowledge across the team Supporting production systems when needed The platform uses a mix of modern data tooling including AWS and Apache Spark, so there's plenty of opportunity to work with big data technologies. What they're hoping you'll bring You don't need … complex data problems An interest in improving pipelines, tooling and processes A collaborative approach and willingness to share ideas Exposure to tools like Apache Spark, modern data platforms, or AI tools for development productivity would be a bonus but isn't essential. The setup The team works ...

Java Developer (Elastic Search)

Hiring Organisation
Experis
Location
South Croydon, London, United Kingdom
Employment Type
Contract
with cross-functional teams to optimise data workflows and performance * Utilising programming languages such as Java, Python, and SQL, alongside tools like LakeFS and Apache Spark, to process and manage data efficiently What you'll bring: * Proven expertise as an Elastic Search SME, with a deep understanding … with data systems, from collection to analysis * Strong programming skills in Java, Python, and SQL * Familiarity with data processing tools such as LakeFS and Apache Spark (desirable) * Ability to work effectively in a collaborative environment, with excellent problem-solving skills * Must have a minimum of 5 years of unbroken ...

Cloud Engineer - Azure

Hiring Organisation
Reed
Location
Newquay, Cornwall, England, United Kingdom
Employment Type
Full-Time
Salary
£49,000 - £55,491 per annum, Inc benefits
Cloud Engineer – Azure Annual Salary: £55491 Location: Newquay - one day per week on site Job Type: Full-time Reed Technology are delighted to be working with a highly regarded organisation with their search for an ...

Data Architect

Hiring Organisation
Aubay UK
Location
Solihull, England, United Kingdom
distributed systems) Exposure to proof of concept (PoC) development Knowledge of object storage and distributed processing frameworks Familiarity with technologies such as: PySpark, Dremio, Apache Iceberg, Apache Airflow, S3/object storage concepts, IBM Cloud (or willingness to upskill) Experience in financial services or highly regulated environments Strong ...

SENIOR CLOUD ENGINEER / AI ENGINEER (CONTRACT)

Hiring Organisation
Secure Recruitment Ltd
Location
North London, London, United Kingdom
Employment Type
Contract, Work From Home
Contract Rate
Up to £1,200 per day
Production Hands-On Experience with Deep Learning Frameworks (TensorFlow, PyTorch, XGBoost) Deep Knowledge of Data Warehousing, ETL/ELT Architectures & Heavy Analytic Environments (Apache Beam, Hadoop, Spark, Hive) Responsibilities: Leading Customer-Facing AI Deployments across Europe, from the Initial Consulting Phase right through to the Live Implementation of Production … Systems Architecting & Optimising Scalable Data Pipelines, ETL/ELT Solutions & Distributed ML Environments (using Hadoop, Spark & Apache Beam). Deploying Recommendation Engines & Deep Learning Models (TensorFlow, PyTorch) to solve specific Client Problems. Running Technical Design Sessions, Tailoring ML Ops Architectures using Vertex AI & Gen AI. Writing Automation-Focused Code ...

DevOps Engineer

Hiring Organisation
STACKSTUDIO DIGITAL LTD
Location
London, South East, England, United Kingdom
Employment Type
Contractor
Contract Rate
£350 - £400 per day
estate (AWS + Airflow + Databricks). Key Responsibilities Design, build and maintain Infrastructure as Code using CloudFormation and AWS services Manage and scale Apache Airflow (MWAA) environments Develop and maintain CI/CD pipelines (Git + Jenkins/GitHub Actions) Build serverless components with Lambda and other … call rotation and incident resolution Essential Skills & Experience 5+ years as a DevOps/Platform Engineer Strong AWS experience + CloudFormation Production experience with Apache Airflow (MWAA) Lambda , Linux + Bash scripting CI/CD expertise (Git, Jenkins, GitHub Actions) IaC and GitOps practices Nice to Have Terraform Databricks ...

Guidewire Business Analyst – Commercial Insurance

Hiring Organisation
STACKSTUDIO DIGITAL LTD
Location
London, South East, England, United Kingdom
Employment Type
Contractor
Contract Rate
£350 - £380 per day
estate (AWS + Airflow + Databricks). Key Responsibilities Design, build and maintain Infrastructure as Code using CloudFormation and AWS services Manage and scale Apache Airflow (MWAA) environments Develop and maintain CI/CD pipelines (Git + Jenkins/GitHub Actions) Build serverless components with Lambda and other … call rotation and incident resolution Essential Skills & Experience 5+ years as a DevOps/Platform Engineer Strong AWS experience + CloudFormation Production experience with Apache Airflow (MWAA) Lambda , Linux + Bash scripting CI/CD expertise (Git, Jenkins, GitHub Actions) IaC and GitOps practices Nice to Have Terraform Databricks ...

Data Platform Engineer

Hiring Organisation
Morson Edge
Location
Preston, Lancashire, North West, United Kingdom
Employment Type
Contract
Contract Rate
£64 - 74 per hour
that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data ingestion, transformation … such as databases, APIs, and cloud platforms. About You: As an experienced Data Platform Engineer, your skills and experience may include; • Strong experience of Apache NiFi • Experience designing and optimizing data flows for batch, real-time streaming, and event-driven architectures. • Ability to identify and resolve flow issues, optimize ...

Java Developer

Hiring Organisation
Experis
Location
City of London, London, United Kingdom
Employment Type
Contract
Contract Rate
£468 - £469/day
data sets can be effectively combined and analysed. They can also utilise programming languages such as Python, Java or SQL and tools such as Apache Spark or in this instance LakeFS, for data processing and management. Useful - R, Apache Spark Very useful - Python, SQL, JSON, LakeFS. ...