76 to 100 of 103 Apache Jobs in England

hands-on experience with Google Cloud Platform (BigQuery, Cloud Storage, etc.). Proven experience in DBT for data transformation. Expertise in Cloud Composer/Apache Airflow for workflow orchestration. Advanced proficiency in Python. Solid experience with Terraform for infrastructure provisioning. Demonstrated experience in migrating legacy systems (on-prem ...

services including Vertex AI, Model Garden, BigQuery, Cloud Run and Google’s ADK. • Experience with document and data processing using tools such as Apache Tika, plus storage or caching technologies like Postgres, Redis, GCS or BigQuery. • Solid DevOps practices including CI/CD, Docker, observability and automated testing. ...

services including Vertex AI, Model Garden, BigQuery, Cloud Run and Google’s ADK. • Experience with document and data processing using tools such as Apache Tika, plus storage or caching technologies like Postgres, Redis, GCS or BigQuery. • Solid DevOps practices including CI/CD, Docker, observability and automated testing. ...

schema). Version Control Practical experience with Git (branching, merging, pull requests). Preferred Qualifications (A Plus) Experience with a distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage … . Exposure to workflow orchestration tools ( Apache Airflow, Prefect, or Dagster ). Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field. ...

M365) Azure DevOps Cloud Security & Governance Applications & Platforms .NET Framework/.NET Core Microsoft Dynamics SQL Server SSRS M365 Apps Exchange SharePoint IIS Apache Security OWASP Firewalls ISO27001 Azure Security Benchmark Microsoft Defender zScaler CASB technologies Networking Enterprise switching & routing MPLS ExpressRoute Azure Front Door Routing protocols Firewalls Infrastructure ...

optimise scalable data pipelines within a Databricks Lakehouse environment. You’ll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams …/7 Collaborative office environment with regular social and charity events And Much More!!! DATA ENGINEER – ESSTENTIAL SKILLS Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands-on experience with Kafka (MSK) and real-time data ingestion ...

architecture to support data consumption for reporting systems, operational applications, and analytics platforms. Implement automation, orchestration, and scalable pipeline frameworks using tools such as Apache Airflow. Collaborate with business stakeholders and technical teams to align the data platform with enterprise data strategy. Support hospitality analytics use cases, including guest … predictive analytics, recommendation engines, and customer behaviour analytics. Ability to design AI-ready data platforms for future analytics use cases. Preferred Skills Experience with Apache Airflow for pipeline orchestration. Knowledge of CI/CD pipelines, DevOps, and Git-based development workflows. Experience with data governance, metadata management, and enterprise ...

across the platform. Key Responsibilities Design and maintain data pipelines to process large geospatial and sensor datasets. Develop distributed systems using tools such as Apache Spark, Kafka, and Hadoop. Integrate diverse data sources including satellite, remote sensing, IoT, and GIS feeds. Build analytical models and workflows to detect patterns … Science, Engineering, or similar. Knowledge of visualization tools such as Tableau, Mapbox, or D3. Experience with real-time streaming frameworks like Kafka Streams or Apache Flink. Background in geospatial or environmental intelligence projects. Understanding of coordinate systems, spatial projections, and data formatting standards. ...

models are always running, always accurate, and always improving. Key Responsibilities ML Pipeline Orchestration & Automation Own and extend Circadia’s ML pipeline orchestration using Apache Airflow, including training, evaluation, and deployment workflows. Build and maintain automated pipelines for model retraining, validation, and promotion across development, staging, and production environments. … closely related infrastructure role. Strong proficiency in Python for ML pipeline development, tooling, and automation. Hands-on experience with ML pipeline orchestration tools, particularly Apache Airflow. Experience with model registries and experiment tracking platforms (MLflow preferred). Experience deploying and operating ML workloads on AWS (Batch ...

architecture to support data consumption for reporting systems, operational applications, and analytics platforms. Implement automation, orchestration, and scalable pipeline frameworks using tools such as Apache Airflow. Collaborate with business stakeholders and technical teams to align the data platform with enterprise data strategy. Support hospitality analytics use cases, including guest … predictive analytics, recommendation engines, and customer behaviour analytics. Ability to design AI-ready data platforms for future analytics use cases. Preferred Skills Experience with Apache Airflow for pipeline orchestration. Knowledge of CI/CD pipelines, DevOps, and Git-based development workflows. Experience with data governance, metadata management, and enterprise ...

Proven track record with data governance, quality, lineage, and security practices. Experience with real-time/streaming data technologies, data Ingestion/ETL (e.g., Apache Kafka, Apache NiFi, Kinesis, Pub/Sub). Experience in, or knowledge of, DevSecOps Tooling and Processes. Self-starter with the ability ...

looking to learn and develop themselves. Application Support Experience: minimum 3 years' experience of supporting client-server back-office and web-based systems (Apache; IIS). Database Proficiency: Exhibit experience with relational databases like Microsoft SQL Server and Oracle. Windows Server Environment: Understand the key workings of Windows Server ...

improve team quality Support production systems and troubleshoot issues Write clean, tested, and maintainable code Tech Stack Python & SQL AWS (EMR, Athena, Lambda) Apache Spark (Scala or PySpark) Big data/distributed processing tools What They’re Looking For Strong experience as a Data Engineer using Python … Experience working with AWS or similar cloud platforms Hands-on experience with Apache Spark Ability to work with large, complex datasets Strong problem-solving and analytical mindset Understanding of CI/CD, testing, and agile development practices Confident communicating with technical and non-technical stakeholders Exposure to AI tools ...

acceptable). Experience with NoSQL databases. Experience with vector databases used in modern AI systems. Strong programming experience in Python. Frameworks/Infrastructure:- Apache Spark Apache Airflow Kafka Elasticsearch/OpenSearch ...

capabilities across the organization. Key Responsibilities Design and implement data architectures on the Databricks Lakehouse Platform Build and optimize ETL/ELT pipelines using Apache Spark and Databricks Implement Delta Lake and medallion architecture (Bronze, Silver, Gold) Ensure data governance, security, and performance optimization Integrate Databricks with cloud platforms … stakeholders to deliver scalable data solutions Required Skills & Qualifications Databricks Certification (e.g., Databricks Certified Data Engineer Associate/Professional) Strong experience with Databricks, Apache Spark, and Delta Lake Proficiency in Python, SQL, and data pipeline development Experience with cloud platforms (Azure, AWS, or GCP) Solid understanding of modern data ...

code and sharing knowledge across the team Supporting production systems when needed The platform uses a mix of modern data tooling including AWS and Apache Spark, so there's plenty of opportunity to work with big data technologies. What they're hoping you'll bring You don't need … complex data problems An interest in improving pipelines, tooling and processes A collaborative approach and willingness to share ideas Exposure to tools like Apache Spark, modern data platforms, or AI tools for development productivity would be a bonus but isn't essential. The setup The team works ...

code and sharing knowledge across the team Supporting production systems when needed The platform uses a mix of modern data tooling including AWS and Apache Spark, so there's plenty of opportunity to work with big data technologies. What they're hoping you'll bring You don't need … complex data problems An interest in improving pipelines, tooling and processes A collaborative approach and willingness to share ideas Exposure to tools like Apache Spark, modern data platforms, or AI tools for development productivity would be a bonus but isn't essential. The setup The team works ...

with cross-functional teams to optimise data workflows and performance * Utilising programming languages such as Java, Python, and SQL, alongside tools like LakeFS and Apache Spark, to process and manage data efficiently What you'll bring: * Proven expertise as an Elastic Search SME, with a deep understanding … with data systems, from collection to analysis * Strong programming skills in Java, Python, and SQL * Familiarity with data processing tools such as LakeFS and Apache Spark (desirable) * Ability to work effectively in a collaborative environment, with excellent problem-solving skills * Must have a minimum of 5 years of unbroken ...

Cloud Engineer – Azure Annual Salary: £55491 Location: Newquay - one day per week on site Job Type: Full-time Reed Technology are delighted to be working with a highly regarded organisation with their search for an ...

distributed systems) Exposure to proof of concept (PoC) development Knowledge of object storage and distributed processing frameworks Familiarity with technologies such as: PySpark, Dremio, Apache Iceberg, Apache Airflow, S3/object storage concepts, IBM Cloud (or willingness to upskill) Experience in financial services or highly regulated environments Strong ...

Production Hands-On Experience with Deep Learning Frameworks (TensorFlow, PyTorch, XGBoost) Deep Knowledge of Data Warehousing, ETL/ELT Architectures & Heavy Analytic Environments (Apache Beam, Hadoop, Spark, Hive) Responsibilities: Leading Customer-Facing AI Deployments across Europe, from the Initial Consulting Phase right through to the Live Implementation of Production … Systems Architecting & Optimising Scalable Data Pipelines, ETL/ELT Solutions & Distributed ML Environments (using Hadoop, Spark & Apache Beam). Deploying Recommendation Engines & Deep Learning Models (TensorFlow, PyTorch) to solve specific Client Problems. Running Technical Design Sessions, Tailoring ML Ops Architectures using Vertex AI & Gen AI. Writing Automation-Focused Code ...

estate (AWS + Airflow + Databricks). Key Responsibilities Design, build and maintain Infrastructure as Code using CloudFormation and AWS services Manage and scale Apache Airflow (MWAA) environments Develop and maintain CI/CD pipelines (Git + Jenkins/GitHub Actions) Build serverless components with Lambda and other … call rotation and incident resolution Essential Skills & Experience 5+ years as a DevOps/Platform Engineer Strong AWS experience + CloudFormation Production experience with Apache Airflow (MWAA) Lambda , Linux + Bash scripting CI/CD expertise (Git, Jenkins, GitHub Actions) IaC and GitOps practices Nice to Have Terraform Databricks ...

estate (AWS + Airflow + Databricks). Key Responsibilities Design, build and maintain Infrastructure as Code using CloudFormation and AWS services Manage and scale Apache Airflow (MWAA) environments Develop and maintain CI/CD pipelines (Git + Jenkins/GitHub Actions) Build serverless components with Lambda and other … call rotation and incident resolution Essential Skills & Experience 5+ years as a DevOps/Platform Engineer Strong AWS experience + CloudFormation Production experience with Apache Airflow (MWAA) Lambda , Linux + Bash scripting CI/CD expertise (Git, Jenkins, GitHub Actions) IaC and GitOps practices Nice to Have Terraform Databricks ...

that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data ingestion, transformation … such as databases, APIs, and cloud platforms. About You: As an experienced Data Platform Engineer, your skills and experience may include; • Strong experience of Apache NiFi • Experience designing and optimizing data flows for batch, real-time streaming, and event-driven architectures. • Ability to identify and resolve flow issues, optimize ...

data sets can be effectively combined and analysed. They can also utilise programming languages such as Python, Java or SQL and tools such as Apache Spark or in this instance LakeFS, for data processing and management. Useful - R, Apache Spark Very useful - Python, SQL, JSON, LakeFS. ...