26 to 36 of 36 Apache Spark Jobs in the North of England

Senior Data Engineer, Python, Spark

Location
Manchester, England, United Kingdom
Python is required . Proficiency in at least one object-oriented language. Experience with big data technologies such as HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, or Presto. Experience with AWS, GCP, or Looker (advantageous but not essential). Solid background in data modelling, including the design, implementation ...

DV Cleared Data Architects Wanted

Hiring Organisation
Avanti
Location
Manchester, Lancashire, United Kingdom
Employment Type
Full-Time
Salary
£80,000 - £100,000 per annum
depth actually gets used. • AWS across the board, including S3, Glue, Redshift, Lake Formation and Kinesis • Databricks and Snowflake running on top of AWS • Spark and distributed processing frameworks for large-scale data • Streaming technologies such as Kinesis or Kafka You're expected to pick the right tools ...

Senior Kafka Platform Engineer

Location
Knutsford, England, United Kingdom
include: Contributing to disaster recovery, business continuity and platform resilience solutions for streaming environments. Working with streaming technologies such as Kafka Streams, Flink or Spark Streaming and applying real‐time data processing approaches to business requirements. Working collaboratively across engineering, architecture, security and infrastructure teams, sharing knowledge and contributing ...

Kafka Platform Engineer

Location
Knutsford, England, United Kingdom
Kafka Connect, Schema Registry, Cluster Linking and ksqlDB. Other highly valued skills may include Experience with streaming technologies such as Kafka Streams, Flink or Spark Streaming. Experience working with cloud-native technologies and Kubernetes-based platforms in enterprise environments. Effective collaboration, communication and problem-solving skills, with the ability ...

Data Engineer

Hiring Organisation
Anson Mccade
Location
Newcastle Upon Tyne, Tyne and Wear, North East, United Kingdom
Employment Type
Permanent
rapidly evolving world of AI. You will have the opportunity to: Design and implement robust data pipelines and ML workflows using Python, SQL, Spark and Databricks. Develop and deploy machine learning models, including NLP, deep learning and agentic AI, into production environments. Integrate data from diverse sources through both … years experience with large-scale data challenges Hands-on with Infrastructure-as-Code (Terraform, Ansible) Agile and Waterfall project experience Experience withPython, SQL, Spark, Scala What you will gain from working here: Competitive salary 25 days annual leave Private medical Career progression Extensive Training If youre passionate about data ...

Senior Software Engineer, Java

Hiring Organisation
Roku
Location
Manchester, UK
Employment Type
Full-time
spans a wide range of technologies, including Java and Python-based MicroServices, AWS/GCP cloud backend systems, Big Data technologies like Hive and Spark, and modern Web applications. With a globally distributed presence across the US, India and Europe, the team thrives on collaboration, bringing together diverse perspectives … needs, entrepreneurial spiritExcellent verbal and written communication skillsBS or MS degree in Computer Science or equivalentExperience in distributed computing frameworks like - Hive/Hadoop, Apache SparkExperience in developing Finance or HR related applicationsExperience with following cloud services: AWS Elastic Beanstalk, EC2, S3, CloudFront, RDS, DynamoDB, VPC, Elastic Cache, LambdaWorking ...

SC Cleared DevOps Engineer - 1 Day a month onsite in Leeds

Hiring Organisation
Opus Recruitment Solutions Ltd
Location
Leeds, West Yorkshire, United Kingdom
Employment Type
Full-Time
Salary
£450.00 - £475.00 per day
Build and manage CI/CD pipelines and Infrastructure as Code using Terraform, GitLab CI, and GitHub. Support big data platforms using Hadoop, Hive, Spark, EMR, Athena, and Redshift. Implement monitoring, logging, security, and compliance controls across cloud environments. Drive automation, containerisation, and platform resilience using Kubernetes, Python … with Terraform and CI/CD tools (GitLab CI, Concourse, GitHub). Strong Linux administration experience. Experience with big data technologies including Hadoop, Hive, Spark, and Amazon EMR (or equivalent). Knowledge of monitoring, logging, and security tools. Desirable Skills Kubernetes/EKS or other container platforms. Python scripting ...

Data Scientist

Location
Manchester, England, United Kingdom
matter – packed with personal touches and delivered with care. We’re not just about selling cards or gifts – we’re here to spread joy, spark smiles and make every celebration feel extra special. And with values that guide how we work and support one another, we’ve built … place where people (and ideas) can truly thrive. If you’re looking to make an impact, bring your spark and be part of something meaningful – we’d love to have you on the team. Data Scientist | London or Manchester – Hybrid (1–2 office days per week) | Competitive Salary + ...

Senior Data Scientist

Location
Manchester, England, United Kingdom
matter – packed with personal touches and delivered with care. We're not just about selling cards or gifts – we're here to spread joy, spark smiles and make every celebration feel extra special. And with values that guide how we work and support one another, we've built … place where people (and ideas) can truly thrive. If you're looking to make an impact, bring your spark and be part of something meaningful – we'd love to have you on the team. Senior Data Scientist | London or Manchester - Hybrid (1-2 office days per week) | Competitive Salary ...

Software Engineering Manager

Location
Manchester, England, United Kingdom
matter – packed with personal touches and delivered with care. We’re not just about selling cards or gifts – we’re here to spread joy, spark smiles and make every celebration feel extra special. And with values that guide how we work and support one another, we’ve built … place where people (and ideas) can truly thrive. If you’re looking to make an impact, bring your spark and be part of something meaningful – we’d love to have you on the team. Software Engineering Manager – Reminders | London or Manchester – Hybrid (1–2 days per week ...

Senior Full Stack Engineer - Full or Part Time

Hiring Organisation
AutoTrader UK
Location
Manchester, UK
Employment Type
Full-time
build these systems with industry standard frameworks and tools, such as React and Angular on the front end with Java, Spring Boot and Apache Kafka on the back end. All of this runs on our cutting edge cloud delivery platform, facilitating over 60k releases to production a year. … while delivering high-impact projects. Although not a requirement, helpful experience includes: An interest in working with data at scale using tools like dbt, Spark, and AI/ML frameworks (e.g. PyTorch, TensorFlow, scikit-learn)Experience with Kafka or other event-driven architectures. During our application process, you will ...