12 of 12 Permanent Apache Spark Jobs in the North of England

improve team quality Support production systems and troubleshoot issues Write clean, tested, and maintainable code Tech Stack Python & SQL AWS (EMR, Athena, Lambda) Apache Spark (Scala or PySpark) Big data/distributed processing tools What They’re Looking For Strong experience as a Data Engineer using Python … Experience working with AWS or similar cloud platforms Hands-on experience with Apache Spark Ability to work with large, complex datasets Strong problem-solving and analytical mindset Understanding of CI/CD, testing, and agile development practices Confident communicating with technical and non-technical stakeholders Exposure ...

NoSQL technologies Hands-on experience with at least one major cloud platform (Azure, AWS, or GCP) Experience with big data technologies such as Spark, Hadoop, or Kafka Proficiency with ETL/ELT tools and frameworks (e.g. Airflow, dbt, Informatica) Strong programming skills in Python, Java, Scala, or similar Experience ...

Strong programming experience in Java (preferred) or Python Experience building ETL/ELT or streaming data pipelines Hands-on experience with Kafka, Flink, or Spark (streaming experience preferred) Good understanding of stream-processing concepts (event time, state, backpressure) Experience with cloud platforms (AWS preferred; Azure or GCP also considered ...

experience working with data warehouses. Solid understanding of ETL/ELT design and data pipeline optimisation. Experience with big data frameworks such as Apache Spark, and exposure to streaming technologies like Kafka. Strong problem-solving skills and the ability to collaborate effectively across teams. What's on offer ...

Azure or AWS Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication skills, effectively participating with Senior Stakeholders Nice to haves: Azure/AWS Data Engineering certifications Databricks certifications What ...

least one data-oriented programming language (Python, Scala, or similar) Experience with cloud-based data platforms and big data technologies (eg AWS, Spark, Hadoop, or equivalent) Ability to lead delivery on complex, multi-story work streams with minimal oversight Experience working in Agile teams, collaborating with Product Owners ...

levels. Knowledge of industry‐standard data models and frameworks such as Lambda, Medallion, and Data Mesh. Experience with real‐time data processing (Kafka, Spark) and BI tools (Power BI, Tableau). Strong analytical and problem‐solving skills, translating business requirements into effective data solutions. Equal Opportunities & Reasonable Adjustments ...

teams to drive outcomes Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant AWS, Azure, GCP Working pattern Hybrid working, with the team on client site or in the office ...

Lakehouse platform in Azure. Owning Databricks engineering, administration and platform optimisation. Designing end-to-end data platform solutions Leading implementation using Databricks, PySpark, Spark SQL and Azure Data Factory. Creating and maintaining CI/CD pipelines and automated testing frameworks. Developing APIs to support integration Implementing monitoring, logging ...

Lakehouse platform in Azure. Owning Databricks engineering, administration and platform optimisation. Designing end-to-end data platform solutions Leading implementation using Databricks, PySpark, Spark SQL and Azure Data Factory. Creating and maintaining CI/CD pipelines and automated testing frameworks. Developing APIs to support integration Implementing monitoring, logging ...

quality, consistency and scalability across complex datasets Contributing to architecture and technical direction within a small team Tech environment Java (core language) Python (supporting) Spark/Dataproc Distributed systems and data pipelines AWS/GCP What they’re looking for Strong Java engineering background (5+ years) Experience building distributed ...

lead embedded data science teams, partnering effectively with senior stakeholders across multiple domains Hands-on technical expertise with tools such as Databricks, Python, Spark, and GCP/BigQuery Engineering mindset, with experience moving teams toward machine learning engineering best practice Credibility to lead long-tenured individual contributors while providing ...