1 to 25 of 34 Permanent Apache Jobs in the North of England

Python, Java or Scala, and SQL. Hands‐on experience building and operating large‐scale data pipelines using big data and distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud‐native data platforms ...

Python, Java or Scala, and SQL. Hands‐on experience building and operating large‐scale data pipelines using big data and distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud‐native data platforms ...

Qualifications 10–15 years overall experience in data engineering or data architecture. 5+ years of hands-on architecture experience specifically in Databricks. Expert in Apache Spark, PySpark, Databricks SQL, Delta Lake, and distributed systems. Strong understanding of Lakehouse architecture, BI ecosystems, and modern data platforms. Cloud expertise in Azure ...

strong Python/PySpark engineers who can learn Foundry quickly are encouraged to apply. Essential qualifications • Extensive experience with Python and PySpark/Apache Spark. • Proven track record designing and delivering scalable data pipelines and data products. • Strong SQL and data modelling skills. • Experience with modern data architectures ...

/CD pipelines and deployment automation. • Familiarity with monitoring, logging, and observability tools. • Awareness of application platforms and middleware such as Java, Tomcat, Apache, and NodeJS. • Experience using Git and collaborative development workflows. • Basic scripting skills using Shell or Python. • Understanding of containerisation concepts using Docker. • Strong problem-solving ...

tools such as Terraform Familiarity building and integrating with NoSQL database (familiarity with MongoDB is preferred) or SQL databases such as Postgres Familiarity. With Apache NiFI Familiarity with web standards, accessibility, and development best practice Bonus: Building microservices in C# using .Net Experience building solutions that integrate with LLMs ...

business goals and translating them to technical deliverables. What you'll do Build large-scale data pipelines using frameworks like Google Cloud Platform and Apache Beam. Work on projects powering new generative AI experiences and helping to build models. Learn and contribute to the team's best practices ...

data science team Experiment in your domain to improve precision, recall, or cost savings Requirements Expert skills in Java or Python Experience with Apache Spark or PySpark Experience writing software for the cloud (AWS or GCP) Speaking and writing in English enables you to take part ...

lead quality assurance and testing activities within a large-scale cloud data engineering programme operating across a modern AWS-native technology ecosystem, including Apache Airflow, Amazon Athena, AWS Glue, S3, EMR, DynamoDB, and related cloud services. This role combines hands-on technical leadership with test strategy ownership . … reconciliation, and performance under load Oversee PySpark-based data validation and interrogation activities on AWS EMR Support testing and monitoring of workflows orchestrated through Apache Airflow Drive root cause analysis for production data issues and platform defects Risk Management & Reporting Identify, assess, and communicate quality risks across releases ...

record in designing, deploying, and maintaining production-grade, distributed ML systems (Sagemaker) Deep MLOps Proficiency: Expert-level knowledge of CI/CD, orchestration (e.g., Apache Airflow, Flink), and model monitoring/drift detection at scale. Software Engineering Rigor: Strong background in Python, distributed systems, and backend development, with ...

record in designing, deploying, and maintaining production-grade, distributed ML systems (Sagemaker) Deep MLOps Proficiency: Expert-level knowledge of CI/CD, orchestration (e.g., Apache Airflow, Flink), and model monitoring/drift detection at scale. Software Engineering Rigor: Strong background in Python, distributed systems, and backend development, with ...

record in designing, deploying, and maintaining production-grade, distributed ML systems (Sagemaker) Deep MLOps Proficiency: Expert-level knowledge of CI/CD, orchestration (e.g., Apache Airflow, Flink), and model monitoring/drift detection at scale. Software Engineering Rigor: Strong background in Python, distributed systems, and backend development, with ...

configuration management and an interest in migrating to Ansible and cloud‐native tooling. Experience managing Kubernetes platforms and deploying containerised applications. Knowledge of GitLab, Apache NiFi, HashiCorp Vault, Trend Micro Deep Security Manager, Ivanti device control, and Ansible Tower/AWX. Windows Infrastructure Experience with Windows Server administration, deployment ...

concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications • Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications • Advanced Data Management – Strong SQL design, query optimization, and database architecture expertise • Observability – Experience ...

MySQL, PostgreSQL, MongoDB) Experience with software delivery and CI/CD Experience with software service metrics and monitoring tools such as Grafana, Plausible and Apache Superset. Familiarity with Linux server administration and networking Experience directly interacting with end users, replying professionally to queries and questions Enthusiasm for growing ...

MySQL, PostgreSQL, MongoDB) Experience with software delivery and CI/CD Experience with software service metrics and monitoring tools such as Grafana, Plausible and Apache Superset. Familiarity with Linux server administration and networking Experience directly interacting with end users, replying professionally to queries and questions Enthusiasm for growing ...

structures, partitioning strategies, consistency models, and performance optimization, as well as OLTP databases such as PostgreSQL and MySQL Distributed compute frameworks – strong experience with Apache Spark and distributed data processing, including optimisation, performance tuning, and large‐scale batch/streaming workloads Cloud‐native data platforms – demonstrated experience with ...

Glue, ECR, EC2, EMR, DynamoDB, Lake Formation Experience with Infrastructure as Code (Terraform) Proficiency in Python, SQL, and familiarity with PySpark Experience with Apache Spark and data processing frameworks Hands-on experience with Apache Airflow for workflow orchestration Experience using Jupyter Notebooks and/or Amazon Athena ...

including data modelling, DAX and semantic model design Hands-on experience with Microsoft Fabric, particularly lakehouse architecture, notebooks and data pipelines Strong understanding of Apache Spark/PySpark and large-scale data processing Experience designing and operating modern data platforms Experience developing or enabling AI and machine learning capabilities ...

with large-scale and unstructured datasets. Python development experience, including technologies such as PySpark, Pandas and PyArrow. Expertise in distributed data processing frameworks, particularly Apache Spark. Experience building and maintaining ETL pipelines using technologies such as Apache Airflow, AWS Step Functions or Apache NiFi. Cloud platform experience ...

Building on the success of our database business, we have created the industry’s first observability warehouse, Imply Lumi. Built by the creators of Apache Druid, Lumi lets organizations store more data, support more use cases and spend less for observability. Imply Lumi is a high-performance, cost-efficient ...

Building on the success of our database business, we have created the industry s first observability warehouse, Imply Lumi. Built by the creators of Apache Druid, Lumi lets organizations store more data, support more use cases and spend less for observability. Imply Lumi is a high-performance, cost-efficient ...

Building on the success of our database business, we have created the industry s first observability warehouse, Imply Lumi. Built by the creators of Apache Druid, Lumi lets organizations store more data, support more use cases and spend less for observability. Imply Lumi is a high-performance, cost-efficient ...

automation & configuration management; • Ansible (plus Puppet, Saltstack), Terraform, CloudFormation; • NodeJS, REACT/MaterialUI (plus Angular), Python, JavaScript; • Big data processing and analysis, e.g. Apache Hadoop (CDH), Apache Spark; • RedHat Enterprise Linux, CentOS, Debian or Ubuntu. • Java 8, Spring framework (preferably Spring boot), AMQP - RabbitMQ, • Open source technologies; • Experience ...

platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/ ...