16 of 16 Permanent Apache Spark Jobs in West Yorkshire

control, code review), and with project management tools (JIRA or similar) in an agile environment. Familiarity with other ML Ops tools (Kubeflow, MLflow, etc.) or big data processing frameworks (Spark) can be an added advantage Rewards and Benefits We believe in supporting our employees in both their professional and personal lives. As part of our commitment to your well More ❯

control, code review), and with project management tools (JIRA or similar) in an agile environment. Familiarity with other ML Ops tools (Kubeflow, MLflow, etc.) or big data processing frameworks (Spark) can be an added advantage Rewards and Benefits We believe in supporting our employees in both their professional and personal lives. As part of our commitment to your well More ❯

control, code review), and with project management tools (JIRA or similar) in an agile environment. Familiarity with other ML Ops tools (Kubeflow, MLflow, etc.) or big data processing frameworks (Spark) can be an added advantage Rewards and Benefits We believe in supporting our employees in both their professional and personal lives. As part of our commitment to your well More ❯

quality software features Strong communication, organisational, and interpersonal skills Ability to manage multiple priorities in a fast-paced environment Experience with SQL, NoSQL, and big data platforms (e.g., Hadoop, Spark) Knowledge of cloud security (AWS, Azure, GCP) and data access controls Proficiency in scripting languages (e.g., Python, Bash) for automation Certifications such as OSCP, CEH, CISSP, or GIAC are More ❯

Airflow, and Git for version control. Excellent collaboration and communication skills, with strong attention to detail and data quality. Desirable: Exposure to AI/ML data preparation, Python or Spark, Data Vault 2.0, data governance, GDPR, and experience working in mobility, logistics, financial services, or tech-enabled environments. What's in it for me? Hybrid and remote working flexibility. More ❯

best practices for data security and compliance. Collaborate with stakeholders and external partners. Skills & Experience: Strong experience with AWS data technologies (e.g., S3, Redshift, Lambda). Proficient in Python, Apache Spark, and SQL. Experience in data warehouse design and data migration projects. Cloud data platform development and deployment. Expertise across data warehouse and ETL/ELT development in More ❯

Experience 10+ years' experience in Data Engineering, with a minimum of 3 years of hands-on Azure Databricks experience delivering production-grade solutions. Strong programming proficiency in Python and Spark (PySpark) or Scala, with the ability to build scalable and efficient data processing applications. Advanced understanding of data warehousing concepts, including dimensional modelling, ETL/ELT patterns, and modern More ❯

Experience 10+ years' experience in Data Engineering, with a minimum of 3 years of hands-on Azure Databricks experience delivering production-grade solutions. Strong programming proficiency in Python and Spark (PySpark) or Scala, with the ability to build scalable and efficient data processing applications. Advanced understanding of data warehousing concepts, including dimensional modelling, ETL/ELT patterns, and modern More ❯

Experience 10+ years' experience in Data Engineering, with a minimum of 3 years of hands-on Azure Databricks experience delivering production-grade solutions. Strong programming proficiency in Python and Spark (PySpark) or Scala, with the ability to build scalable and efficient data processing applications. Advanced understanding of data warehousing concepts, including dimensional modelling, ETL/ELT patterns, and modern More ❯

familiarity with data science libraries and frameworks. Strong expertise in statistical modelling, predictive analytics, and machine learning. In-depth understanding of data architecture and big data technologies (e.g., Hadoop, Spark, AWS). Exceptional problem-solving skills and ability to think strategically. Outstanding communication abilities to convey technical concepts to non-technical stakeholders. Experience in managing cross-departmental or large More ❯

in public cloud (AWS) and our dev/test workloads are self-orchestrated using clustered Proxmox as a private cloud. Our analytics workloads are distributed on bare metal using Spark, HBASE and HDFS. We make extensive use of terraform and ansible for IaC, our CI/CD uses GitHub Actions, our observability is provided via Datadog and we increasingly More ❯

in public cloud (AWS) and our dev/test workloads are self-orchestrated using clustered Proxmox as a private cloud. Our analytics workloads are distributed on bare metal using Spark, HBASE and HDFS. We make extensive use of terraform and ansible for IaC, our CI/CD uses GitHub Actions, our observability is provided via Datadog and we increasingly More ❯

in public cloud (AWS) and our dev/test workloads are self-orchestrated using clustered Proxmox as a private cloud. Our analytics workloads are distributed on bare metal using Spark, HBASE and HDFS. We make extensive use of terraform and ansible for IaC, our CI/CD uses GitHub Actions, our observability is provided via Datadog and we increasingly More ❯

record of deploying AI into production at scale. Technical Skills: Strong backend Python; expertise with ML frameworks (TensorFlow, PyTorch, Scikit-Learn, etc.); familiarity with modern data pipeline tools (Airflow, Spark, Kafka) and workflow orchestration frameworks such as n8n or LangGraph. Applied AI: Background in enterprise applications such as chatbots, workflow automation, RAG pipelines, or intelligent document processing. Domain Awareness More ❯

record of deploying AI into production at scale. Technical Skills: Strong backend Python; expertise with ML frameworks (TensorFlow, PyTorch, Scikit-Learn, etc.); familiarity with modern data pipeline tools (Airflow, Spark, Kafka) and workflow orchestration frameworks such as n8n or LangGraph. Applied AI: Background in enterprise applications such as chatbots, workflow automation, RAG pipelines, or intelligent document processing. Domain Awareness More ❯

record of deploying AI into production at scale. Technical Skills: Strong backend Python; expertise with ML frameworks (TensorFlow, PyTorch, Scikit-Learn, etc.); familiarity with modern data pipeline tools (Airflow, Spark, Kafka) and workflow orchestration frameworks such as n8n or LangGraph. Applied AI: Background in enterprise applications such as chatbots, workflow automation, RAG pipelines, or intelligent document processing. Domain Awareness More ❯