6 of 6 Apache Spark Jobs in Lancashire

with Databricks** You'll play a pivotal role in designing, building, and optimising their Azure-based Data Lakehouse, with a focus on Databricks, PySpark, Spark SQL, and Azure Data Factory. This isn't just about coding - you'll also provide architectural guidance, mentor engineers, and ensure solutions are scalable ...

skills; experience with deep learning frameworks (TensorFlow, PyTorch) Solid understanding of ML algorithms, statistics, and data modelling Experience with large-scale data tools (Hadoop, Spark, Kafka) Cloud & MLOps experience (AWS, Azure, or GCP) NLP experience highly beneficial Strong leadership, communication, and stakeholder management ...

Lakehouse platform in Azure. Owning Databricks engineering, administration and platform optimisation. Designing end-to-end data platform solutions Leading implementation using Databricks, PySpark, Spark SQL and Azure Data Factory. Creating and maintaining CI/CD pipelines and automated testing frameworks. Developing APIs to support integration Implementing monitoring, logging ...

deep learning techniques. Experience deploying ML models to production using cloud platforms (AWS, GCP or Azure). Familiarity with big-data or distributed tools (Spark, Kafka or similar). A track record of leading complex ML projects and influencing technical decisions. Excellent communication skills across distributed, cross-functional teams. ...

required to undertake DV (developed vetting) clearance (eligible to undertake DV Security Clearance). Skills required for the role: Java, Spring Boot, AWS, Python, Spark, Hadoop, Kafka, ElasticSearch, OpenShift/Kubernetes, NiFi Please apply to this advertisement if you are interested SmartSourcing are a Disability Confident Employer ...

team engineering organisations Strong background in distributed systems, large-scale data pipelines and ML model deployment Deep understanding of modern data stacks such as Spark, Databricks or cloud-native architectures Solid understanding of modern frontend engineering, DevOps knowledge and experience delivering machine learning systems Strong communication, organisation and stakeholder ...