1 to 25 of 50 Apache Jobs in the UK excluding London

driving innovation in data engineering. Desirable Criteria Experience delivering data pipelines on Hortonworks/Cloudera on-prem and leading cloud migration initiatives. Familiarity with: Apache Airflow Data modelling and metadata management Experience influencing enterprise data strategy and contributing to architectural governance. To apply for this position please submit your ...

Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data availability. Develop, maintain ...

provisioning automation. Nice to Have Skills: Experience with Power BI, DAX, and data modeling for optimized reporting. Knowledge of big data orchestration tools like Apache Airflow. Previous exposure to regulated environments such as finance, healthcare, or gaming. Experience in a lottery or similar domain is a plus. Preferred Education ...

deployment and management. Strong understanding of data modelling methodologies such as Kimball and Data Vault in data warehouse environments. Familiarity with frameworks such as Apache Beam and dbt. 3. Future-Focused & AI Awareness Interest in the evolution of modern data platforms and emerging technologies. Understanding of, or interest ...

within scalable cloud -based architectures. Robust understanding of data governance, data quality, and metadata management. Desirable skills Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles. Experience in using Git, Azure DevOps, or GitHub Actions for version control, CI/CD, and collaborative ...

within scalable cloud -based architectures. Robust understanding of data governance, data quality, and metadata management. Desirable skills Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles. Experience in using Git, Azure DevOps, or GitHub Actions for version control, CI/CD, and collaborative ...

practice routes Required Skills & Experience Active SC Clearance - mandatory and non-negotiable Strong hands-on experience with Databricks in production environments Expert knowledge of Apache Spark , including PySpark and Spark SQL Proficiency with Python for data engineering Experience delivering solutions on cloud data platforms ( AWS preferred , Azure acceptable) Understanding ...

pipelines Proficiency with at least one cloud platform: Amazon Web Services (AWS) Microsoft Azure (Azure) Google Cloud Platform (GCP) Experience with orchestration tools (e.g., Apache Airflow) Experience with version control (e.g., Git) Solid understanding of data warehousing concepts and dimensional modeling To apply for this role please submit your ...

/CD pipelines (e.g. Azure DevOps) Excellent communication skills and the ability to engage confidently with senior and executive stakeholders Desirable Experience Agentic AI, Apache Spark, or enterprise architecture frameworks Enterprise data integration and Microsoft BI technologies Experience with AWS or GCP and additional CI/CD tooling (e.g. ...

/CD pipelines (e.g. Azure DevOps) Excellent communication skills and the ability to engage confidently with senior and executive stakeholders Desirable Experience Agentic AI, Apache Spark, or enterprise architecture frameworks Enterprise data integration and Microsoft BI technologies Experience with AWS or GCP and additional CI/CD tooling (e.g. ...

locally-hosted solutions. Technical Requirements Languages Expert-level Python and advanced SQL . Data Engineering Experience with ETL/ELT and orchestration tools like Apache Airflow or NiFi . On-Prem Tech Proficiency with Hadoop/HDFS , Spark , and containerization via Docker/Kubernetes (K3s/OpenShift) . ...

Agile Development using SCRUM. Experience of Oracle/Relational Databases and/or Mongo. Experience of GitLab CI/CD Pipelines. Experience of Apache NiFi. Experience in the use of Atlassian Suite - Bitbucket, Jira, Confluence. Experience of Elasticsearch and Kibana. Experience of Hibernate. Experience of AWS Services such ...

other engineers What we are looking for Strong experience in Python and Linux Experience in Python data processing pipelines such as Dagster or Apache Airflow Knowledge of security, encryption and compliance standards for AS networks Experience building and maintaining bespoke Docker containers Experience using server-less AWS cloud services ...

solutions while remaining hands-on. You should have: Proven experience building production-ready solutions on Google Cloud Expertise with batch and streaming frameworks like Apache Spark or Beam Strong understanding of data storage, pipeline patterns, and event-driven architectures Experience with CI/CD, version control, automated testing ...

development lifecycle from requirements to deployment Tech Stack Includes: Java, Python, Linux, Git, JUnit, GitLab CI/CD, Oracle, MongoDB, JavaScript/TypeScript, React, Apache NiFi, Elasticsearch, Kibana, AWS, Hibernate, Atlassian Suite PLEASE NOTE: eDV clearance is required to start. The process can take 6 - 18 months. For more ...

compliance across data services that underpin critical national infrastructure programmes. Preferred Tech Stack Expertise Google Cloud Platform including BigQuery, Cloud SQL and Cloud Composer, Apache Airflow, Dataplex, Dataform, Great Expectations or similar data quality tools, Terraform, Python and SQL Responsibilities Lead design and delivery of enterprise-scale data pipelines ...

Required Data Integration & Ingestion Data Manipulation & Processing GitHub, GitHub Actions, Azure DevOps Azure Data Factory Databricks SQL Database Azure Synapse Stream Analytics AWS Glue Apache Airflow AWS Kinesis Amazon Redshift SonarQube PyTest Optional/Nice to Have Experience managing projects or running Scrum teams Experience with BPC/Planning ...

Experience with AWS and cloud-native data engineering patterns Clear communicator who can work effectively with both technical colleagues and business stakeholders Exposure to Apache Airflow, Databricks Workflows, or Informatica Cloud is a bonus — as are Databricks or AWS certifications Why Join Us? You'll be part ...

building a modern Lakehouse architecture. Designing and implementing AWS-native ETL pipelines using S3, Glue, Athena, Step Functions. Building scalable, ACID-compliant datasets using Apache Iceberg. Running cost-efficiency initiatives across Redshift and broader AWS services. Consolidating fragmented environments into a secure, multi-tenant data platform. Implementing automated data ...

Agile Development using SCRUM. Advanced knowledge of Oracle/Relational Databases and/or Mongo. Experience of GitLab CI/CD Pipelines. Experience of Apache NiFi. Experience in the use of Atlassian Suite - Bitbucket, Jira, Confluence. Experience of Elasticsearch and Kibana. Advanced knowledge of Hibernate. Advanced knowledge ...

Services, storage services (blob storage, file storage, etc.), Azure Database services, Azure Cost Management, etc. Terraform and/or CloudFormation scripting Linux, Apache/Nginx Continuous integration/deployment (CI/CD) experience including GitHub Actions Familiarity with the AWS/Azure Well-Architected Framework and NCSC Cloud Security ...

Python Good knowledge of developing in a Linux environment Working knowledge of Git version control and GitLabs CI/CD pipelines Experience working with Apache NiFi Some exposure to front-end elements like JavaScript, TypeScript or React Some data interrogation with ElasticSearch and Kibana Exposure to working with Atlassian ...

Bolt Technical are hiring exclusively for a growing SaaS business. This is a key senior hire to take ownership of a legacy LAMP (Linux, Apache, MySQL, PHP) platform, modernising it pragmatically while supporting a small, fast-moving team. The role offers significant influence over technical direction and a clear ...

that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure ...

with APIs and integrating multiple data sources. Confidence working with legacy systems and non-modernised environments. Knowledge of web scraping techniques. Experience with Tableau, Apache, or digital analytics tools is beneficial but not essential. BENEFITS The successful Data Engineer will receive the following benefits: Salary between ...