18 of 18 Apache Spark Jobs in the North West

About the Role We are seeking a highly skilled Senior Software Engineer with deep expertise in API Development using Spring Boot and knowledge of Apache Spark‐based Big Data pipelines using Airflow. This hybrid position bridges software engineering and data engineering, requiring the ability to design, build … teams to architect and manage robust, production‐grade data products that power critical analytics and measurement capabilities. You will work with technologies such as Apache Spark, Apache Airflow, Trino, Druid, Spring Boot, StarRocks, and Looker to deliver reliable, high‐performance solutions. The ideal candidate is a proactive ...

role We are seeking a high‐skilled Senior Software Engineer with deep expertise in API Development using Spring Boot while also possessing knowledge of Apache Spark‐based Big Data pipelines using Airflow. This hybrid position bridges software engineering and data engineering, requiring the ability to design, build … teams to architect and manage robust, production‐grade data products that power critical analytics and measurement capabilities. You will work with technologies such as Apache Spark, Apache Airflow, Trino, Druid, Spring Boot, StarRocks, and Looker to deliver reliable, high‐performance solutions. The ideal candidate is a proactive ...

Data Engineer Salary up to £70,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via ABOUT THE CLIENT Due to continued growth, we're seeking a skilled Data Engineer … optimise scalable data pipelines within a Databricks Lakehouse environment. You'll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering ...

looking for: · 3+ years of professional Python development experience as a Data Platform Engineer, using AWS. · Experience developing and deploying Serverless technologies, provisioning Apache Airflow, and using infrastructure as code such as AWS CloudFormation or Terraform. · Takes a collaborative approach to problem solving and breaking down complex problems, whilst … with software engineering requirements and specifications. · Good interpersonal skills, positive can-do attitude and willing to help other members of the team. · Understanding of Apache Spark, Apache Trino or other big data and machine learning systems. · Exposure to using AI tools to enhance productivity and quality ...

Software Engineer on large software applications. Proficient in technologies including Python, REST, PyTorch, TensorFlow, Docker, FastAPI, Selenium, React, TypeScript, Redux, GraphQL, Kafka, and Apache Spark. Experience working with one or more of the following database systems: DynamoDB, DocumentDB, MongoDB. Demonstrated expertise in unit testing and tools such as JUnit ...

development experience Databricks and PySpark expertise Experience with cloud-based data platforms (AWS, Azure and/or GCP) Data Engineering and analytics at scale Apache Spark ecosystems Cyber Security or Security Analytics experience CI/CD and automated deployment practices Strong stakeholder engagement and communication skills You will ...

teams to drive outcomes Core skills (indicative) Production pipeline design and deployment experience Strong engineering capability with Python, SQL, plus big data tooling (e.g., Spark, and Java/Scala where relevant AWS, Azure, GCP Working pattern Hybrid working, with the team on client site or in the office ...

learning frameworks (TensorFlow, PyTorch, Keras) Knowledge of prompt engineering, RAG (Retrieval Augmented Generation), and LLM fine‐tuning techniques Familiarity with distributed computing frameworks (eg Spark) Knowledge of graph neural networks, reinforcement learning, or causal inference Experience with AI governance, model risk management, and regulatory compliance Experience using Pro code ...

Manchester, UK, to develop scalable APIs and manage big data solutions. Candidates should have 8+ years in software or data engineering, with skills in Apache Spark, Airflow, and a strong foundation in Java, Python, or Scala. The role requires collaboration with cross-functional teams to deliver high-quality ...

manage multiple priorities and respond calmly to issues. • Self-motivated with a collaborative approach. Preferred: • Familiarity with AWS data tooling such as S3, Athena, Spark or notebooks. • Experience supporting data products or client-facing datasets. • Understanding of release testing, UAT or production support processes. • Exposure to Jira/Agile ...

design and develop APIs and Big Data pipelines. The role demands deep expertise in API development via Spring Boot and knowledge of Apache Spark. You will work closely with cross-functional teams to deliver robust data solutions. The ideal candidate has over 10 years of professional experience in software ...

Data Engineer Salary up to £70,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via ABOUT THE CLIENT Due to continued growth, we're seeking a skilled Data Engineer ...

governed and used across the organisation. Key Responsibilities: Maintain, improve and optimise an existing Databricks data platform. Build and enhance scalable data pipelines using Spark, SQL and Python or Scala. Develop and mature Bronze, Silver and Gold layers to support analytics, reporting and downstream data use. Ingest and integrate … What We're Looking For: Proven experience as a Data Engineer within a cloud-based data environment. Strong hands-on experience with Databricks and Apache Spark. Experience building or improving medallion architecture, including Bronze, Silver and Gold data layers. Strong SQL skills for transformation, validation and data analysis. Python ...

Deep experience with cloud platforms (Azure, AWS, or GCP) and cloud-native architecture Strong background in data engineering and large-scale data platforms (e.g., Spark, Databricks) Experience implementing MLOps frameworks, including CI/CD and model governance Experience integrating AI into microservices, APIs, and enterprise systems Exposure to advanced … similar programming languages) TensorFlow, PyTorch, or similar ML frameworks Cloud AI services (Azure AI, AWS SageMaker, GCP AI Platform) Data technologies (SQL/NoSQL, Spark, Databricks) API and microservices architecture DevOps/MLOps tooling Desirable Experience Experience with Generative AI solutions (e.g. Azure OpenAI, GPT-based models) Microsoft stack ...

that are accurate, maintainable and easy for the business to use. Key Responsibilities: Build, enhance and maintain data pipelines within a Databricks environment. Use Spark, SQL and Python or Scala to support data transformation and automation. Develop structured data layers to support reporting, analytics and wider business use. Extract … What We're Looking For: Experience working as a Data Engineer within a modern cloud data environment. Strong hands-on experience with Databricks and Apache Spark. Experience building structured data layers, ideally within a Bronze, Silver and Gold architecture. Strong SQL skills for transformation, validation and analysis. Python ...

Senior Software Engineer - Real-Time Data (Kafka/Spark) Chester | Hybrid working | 12-month contract | Inside IR35 | Global Investment Bank A leading global investment bank is looking for a hands-on Senior Engineer to build high-performance, real-time data platforms supporting regulatory compliance across global operations. This … processing , ideal for someone who enjoys solving complex data challenges at scale. What You'll Do Design and build Kafka-based streaming pipelines and Spark processing jobs Develop low-latency, high throughput systems handling large-scale datasets Create data matching and reconciliation solutions across multiple sources Work on event ...

Senior Software Engineer - Real-Time Data (Kafka/Spark) Chester Hybrid working 12-month contract Inside IR35 Global Investment Bank A leading global investment bank is looking for a hands‐on Senior Engineer to build high‐performance, real‐time data platforms supporting regulatory compliance across global operations. This … processing, ideal for someone who enjoys solving complex data challenges at scale. What You'll Do Design and build Kafka‐based streaming pipelines and Spark processing jobs Develop low‐latency, high throughput systems handling large‐scale datasets Create data matching and reconciliation solutions across multiple sources Work on event ...

Senior Software Engineer - Real-Time Data to join their team in Chester. This role involves designing and building Kafka-based streaming pipelines and Spark processing jobs, focusing on delivering low-latency, high-throughput systems. The ideal candidate will have strong hands-on experience with real-time data processing ...