1 to 25 of 72 Permanent Apache Jobs in the UK

Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data availability. Develop, maintain ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

platform, features, and best practices with Strong understanding of data modeling principles and techniques A solid understanding of big data technologies such as Apache Spark, and knowledge of Hadoop ecosystems. Knowledge of programming languages such as Python, R, or Java is beneficial. Knowledge of ETL/ELT processes (such ...

development is highly desirable. Experience in high‐growth or smaller technology environments. Nice‐to‐haves Snowflake experience. Experience with dbt, Fivetran, AWS Glue, or Apache Iceberg. Prior leadership or mentoring experience (team lead/tech lead). What They Offer The opportunity to influence architecture, tooling, and engineering standards ...

modern data warehouses Strong data modelling and architectural capability Background scaling data platforms in high-growth environments Nice to have Snowflake or Apache Iceberg Infrastructure-as-Code (Terraform) Observability-driven data systems Package & Benefits Salary up to £120,000 Fully remote working Home-office setup Private healthcare and income ...

Infra tooling using Terraform, Ansible and Jenkins whilst automating everything with Python Tech (experience in any listed is advantageous) Python Cloud: AWS Lake house: Apache Spark or AWS Glue Cloud Native storage: Iceberg, RDS, RedShift, Kafka IaC: Terraform, Ansible CI/CD: Jenkins, Gitlab Other platforms such as Databricks ...

individuals’ desires and capabilities. Essential Skills Proven experience as a Data Architect (or similar/related role) Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles. Experience with Big Data Experience with Enterprise level Data sets Experience of using programming languages such ...

Agile Development using SCRUM. Experience of Oracle/Relational Databases and/or Mongo. Experience of GitLab CI/CD Pipelines. Experience of Apache NiFi. Experience in the use of Atlassian Suite - Bitbucket, Jira, Confluence. Experience of Elasticsearch and Kibana. Experience of Hibernate. Experience of AWS Services such ...

Agile Development using SCRUM. Experience of Oracle/Relational Databases and/or Mongo. Experience of GitLab CI/CD Pipelines. Experience of Apache NiFi. Experience in the use of Atlassian Suite - Bitbucket, Jira, Confluence. Experience of Elasticsearch and Kibana. Experience of Hibernate. Experience of AWS Services such ...

solutions while remaining hands-on. You should have: Proven experience building production-ready solutions on Google Cloud Expertise with batch and streaming frameworks like Apache Spark or Beam Strong understanding of data storage, pipeline patterns, and event-driven architectures Experience with CI/CD, version control, automated testing ...

development lifecycle from requirements to deployment Tech Stack Includes: Java, Python, Linux, Git, JUnit, GitLab CI/CD, Oracle, MongoDB, JavaScript/TypeScript, React, Apache NiFi, Elasticsearch, Kibana, AWS, Hibernate, Atlassian Suite What s on Offer: Hybrid working and flexible schedules (4xFlex) Ongoing training and career development Exciting projects ...

solutions.• Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data factory and engineering tools like Apache Spark to ensure seamless data flow.• Monitoring and Failure Recovery: Implement monitoring procedures to detect failures or unusual data profiles and establish recovery processes ...

applications and high proficiency in SQL (query tuning, complex joins) Hands-on experience designing and deploying ETL/ELT pipelines using Google Cloud Dataflow (Apache Beam) or similar tools Proficiency in data architecture, data modeling, and scalable storage design Solid engineering practices: Git and CI/CD for data ...

Desired Skills (Bonus Points) Experience with MLOps tooling (MLflow, Kubeflow, Weights & Biases, or similar) Building data pipelines (real-time or batch) using tools like Apache Spark, Kafka, Airflow, or dbt Familiarity with recommender systems, transformers, or graph neural networks Exposure to model optimisation techniques (quantisation, distillation, efficient inference) What ...

Agile Development using SCRUM. Advanced knowledge of Oracle/Relational Databases and/or Mongo. Experience of GitLab CI/CD Pipelines. Experience of Apache NiFi. Experience in the use of Atlassian Suite - Bitbucket, Jira, Confluence. Experience of Elasticsearch and Kibana. Advanced knowledge of Hibernate. Advanced knowledge ...

Agile Development using SCRUM. Advanced knowledge of Oracle/Relational Databases and/or Mongo. Experience of GitLab CI/CD Pipelines. Experience of Apache NiFi. Experience in the use of Atlassian Suite - Bitbucket, Jira, Confluence. Experience of Elasticsearch and Kibana. Advanced knowledge of Hibernate. Advanced knowledge ...

serving platforms such as BentoML, MLflow, or SageMaker . Hands-on work with streaming and batch data pipelines using tools like Spark, Airflow, or Apache Beam . Background in front-end or mobile development , enabling end-to-end solution thinking. Prior experience in healthcare, life sciences, or regulated industries ...

NICE FOR THE SENIOR SOFTWARE ENGINEER TO HAVE.... Cloud based experience Microservice architecture or server-less architecture Big Data/Messaging technologies such as Apache Nifi/MiNiFi/Kafka TO BE CONSIDERED.... Please either apply by clicking online or emailing me directly to For further information please call ...

Data Platform Engineer – London (AWS, Apache Spark, AWS Glue, Iceberg, S3, RDS, Redshift, Kafka/MSK, Python, Terraform, Ansible, CI/CD, Jenkins, GitLab, Snowflake, Databricks) Working with an established FinTech client in London who is looking for a Data Platform Engineer to play a key role in defining ...

across AWS, Azure and Terraform for infrastructure. Real-time data pipelines and edge computing are key pillars of the Ferry platform, where we augment Apache Flink and Kafka. Your Day to Day Build and scale the backend systems that power Ferry’s core platform Design and implement performant APIs ...

Responsibilities will include; Design, implement, and optimize end-to-end solutions using Fabric components: o Data Factory (pipelines, orchestration) o Data Engineering (Lakehouse, notebooks, Apache Spark) o Data Warehouse (SQL endpoints, schemas, MPP performance tuning) o Real-Time Analytics (KQL databases, event ingestion) o Manage and enhance OneLake architecture ...

Responsibilities will include; Design, implement, and optimize end-to-end solutions using Fabric components: o Data Factory (pipelines, orchestration) o Data Engineering (Lakehouse, notebooks, Apache Spark) o Data Warehouse (SQL endpoints, schemas, MPP performance tuning) o Real-Time Analytics (KQL databases, event ingestion) o Manage and enhance OneLake architecture ...

architecture, and network stack optimization. Data Infrastructure: Familiarity with the modern data stack, including time-series databases, object stores, and streaming frameworks like Apache Flink or Spark Streaming . Engineering Rigor: You write clean, testable, and reliable code. You understand that in this environment, a system failure can cost ...

processing, and consumption layers Technology Leadership Evaluate and recommend modern data technologies and tooling Stay current with industry trends such as open table formats (Apache Iceberg, Delta Lake), data observability, and cloud-native services Lead proofs-of-concept and technical assessments for new technologies Ensure the data architecture remains ...

processing, and consumption layers Technology Leadership Evaluate and recommend modern data technologies and tooling Stay current with industry trends such as open table formats (Apache Iceberg, Delta Lake), data observability, and cloud-native services Lead proofs-of-concept and technical assessments for new technologies Ensure the data architecture remains ...