1 to 25 of 33 Apache Spark Jobs in Yorkshire

urgently require a Data Platform Engineer with core strengths in Building and Operating Data Platforms, and hands-on expertise in Azure Services, Synapse Spark Architecture, ADF and Terraform (IaC), to assist in designing and delivering complex cloud solutions. Key Requirements: Proven, hands-on experience of Building and Operating Data … Advanced knowledge of Azure Services Demonstrable experience with Azure Data Factory (ADF), including network configurations and integration runtime options Strong expertise in Synapse Analytics Spark, Azure Key Vault, and Data Lake Storage Accounts Ability to showcase DevOps and CI/CD capabilities Working knowledge of designing and deploying infrastructure ...

urgently require a Data Platform Engineer with core strengths in Building and Operating Data Platforms, and hands-on expertise in Azure Services, Synapse Spark Architecture, ADF and Terraform (IaC), to assist in designing and delivering complex cloud solutions. Key Requirements: Proven, hands-on experience of Building and Operating Data … Advanced knowledge of Azure Services Demonstrable experience with Azure Data Factory (ADF), including network configurations and integration runtime options Strong expertise in Synapse Analytics Spark, Azure Key Vault, and Data Lake Storage Accounts Ability to showcase DevOps and CI/CD capabilities Working knowledge of designing and deploying infrastructure ...

platforms such as AWS, Azure, or GCP. Exposure to modern data tools such as Snowflake, Databricks, or BigQuery. Familiarity with streaming technologies (e.g., Kafka, Spark Streaming, Flink) is an advantage. Experience with orchestration and infrastructure tools such as Airflow, dbt, Prefect, CI/CD pipelines, and Terraform. What ...

Networking/Infrastructure Report Development - Power BI Power Platform MSBI Traditional Stack (SQL, SSAS, SSIS, SSRS) Azure Automation/PowerShell Azure Streaming Analytics/Spark Streaming Azure Functions/C# .NET Data Science Azure AI Services – Azure AI Foundry, Open AI, Cognitive Services Master Data Management/MDS Certifications ...

Networking/Infrastructure Report Development - Power BI Power Platform MSBI Traditional Stack (SQL, SSAS, SSIS, SSRS) Azure Automation/PowerShell Azure Streaming Analytics/Spark Streaming Azure Functions/C# .NET Data Science Azure AI Services – Azure AI Foundry, Open AI, Cognitive Services Master Data Management/MDS Certifications ...

Networking/Infrastructure Report Development - Power BI Power Platform MSBI Traditional Stack (SQL, SSAS, SSIS, SSRS) Azure Automation/PowerShell Azure Streaming Analytics/Spark Streaming Azure Functions/C# .NET Data Science Azure AI Services – Azure AI Foundry, Open AI, Cognitive Services Master Data Management/MDS Certifications ...

Networking/Infrastructure Report Development - Power BI Power Platform MSBI Traditional Stack (SQL, SSAS, SSIS, SSRS) Azure Automation/PowerShell Azure Streaming Analytics/Spark Streaming Azure Functions/C# .NET Data Science Azure AI Services – Azure AI Foundry, Open AI, Cognitive Services Master Data Management/MDS Certifications ...

Networking/Infrastructure Report Development - Power BI Power Platform MSBI Traditional Stack (SQL, SSAS, SSIS, SSRS) Azure Automation/PowerShell Azure Streaming Analytics/Spark Streaming Azure Functions/C# .NET Data Science Azure AI Services – Azure AI Foundry, Open AI, Cognitive Services Master Data Management/MDS Certifications ...

Networking/Infrastructure Report Development - Power BI Power Platform MSBI Traditional Stack (SQL, SSAS, SSIS, SSRS) Azure Automation/PowerShell Azure Streaming Analytics/Spark Streaming Azure Functions/C# .NET Data Science Azure AI Services – Azure AI Foundry, Open AI, Cognitive Services Master Data Management/MDS Certifications ...

control. Excellent collaboration and communication skills, with strong attention to detail and data quality. Desirable: Exposure to AI/ML data preparation, Python or Spark, Data Vault 2.0, data governance, GDPR, and experience working in mobility, logistics, financial services, or tech-enabled environments. What ...

modern cloud engineering practices. Wherever you land, youll be working with some of the biggest datasets in the UK using everything from Spark and statistical methods to domain knowledge and emerging GenAI applications. The work you could be doing Design and deploy machine learning models for fraud detection, credit … risk, customer segmentation, and behavioural analytics using scalable frameworks like TensorFlow, PyTorch, and XGBoost. Engineer robust data pipelines and ML workflows using Apache Spark, Vertex AI, and CI/CD tooling to ensure seamless model delivery and monitoring. Apply advanced techniques in deep learning, natural language processing ...

modern cloud engineering practices. Wherever you land, youll be working with some of the biggest datasets in the UK using everything from Spark and statistical methods to domain knowledge and emerging GenAI applications. The work you could be doing Design and deploy machine learning models for fraud detection, credit … risk, customer segmentation, and behavioural analytics using scalable frameworks like TensorFlow, PyTorch, and XGBoost. Engineer robust data pipelines and ML workflows using Apache Spark, Vertex AI, and CI/CD tooling to ensure seamless model delivery and monitoring. Apply advanced techniques in deep learning, natural language processing ...

Data Engineering, with a minimum of 3 years of hands-on Azure Databricks experience delivering production-grade solutions. Strong programming proficiency in Python and Spark (PySpark) or Scala, with the ability to build scalable and efficient data processing applications. Advanced understanding of data warehousing concepts, including dimensional modelling ...

Data Engineering, with a minimum of 3 years of hands-on Azure Databricks experience delivering production-grade solutions. Strong programming proficiency in Python and Spark (PySpark) or Scala, with the ability to build scalable and efficient data processing applications. Advanced understanding of data warehousing concepts, including dimensional modelling ...

Data Engineering, with a minimum of 3 years of hands-on Azure Databricks experience delivering production-grade solutions. Strong programming proficiency in Python and Spark (PySpark) or Scala, with the ability to build scalable and efficient data processing applications. Advanced understanding of data warehousing concepts, including dimensional modelling ...

like Airflow and dbt Experience working with cloud platforms e.g. Azure Knowledge of data lakes and data warehouses concepts and distributed systems like Kafka, Spark etc., Familiarity of Kubernetes, CI/CD and Terraform Knowledge of cybersecurity principles and practices Location: London: Hybrid model work on-site ...

chunking, reranking techniques, etc. Extra awesome: You have experience working in a B2B SaaS company Experience with orchestration tools (e.g. Airflow) Familiarity with SQL, Spark, or other data processing frameworks Knowledge of Snowflake or other cloud data warehouses. Strong familiarity with agentic frameworks for decision-making systems. *Typeform drives ...

chunking, reranking techniques, etc. Extra awesome: You have experience working in a B2B SaaS company Experience with orchestration tools (e.g. Airflow) Familiarity with SQL, Spark, or other data processing frameworks Knowledge of Snowflake or other cloud data warehouses. Strong familiarity with agentic frameworks for decision-making systems. *Typeform drives ...

chunking, reranking techniques, etc. Extra awesome: You have experience working in a B2B SaaS company Experience with orchestration tools (e.g. Airflow) Familiarity with SQL, Spark, or other data processing frameworks Knowledge of Snowflake or other cloud data warehouses. Strong familiarity with agentic frameworks for decision-making systems. *Typeform drives ...

chunking, reranking techniques, etc. Extra awesome: You have experience working in a B2B SaaS company Experience with orchestration tools (e.g. Airflow) Familiarity with SQL, Spark, or other data processing frameworks Knowledge of Snowflake or other cloud data warehouses. Strong familiarity with agentic frameworks for decision-making systems. *Typeform drives ...

compliance. Collaborate with stakeholders and external partners. Skills & Experience: Strong experience with AWS data technologies (e.g., S3, Redshift, Lambda). Proficient in Python, Apache Spark, and SQL. Experience in data warehouse design and data migration projects. Cloud data platform development and deployment. Expertise across data warehouse ...

5+ years in Data Engineering, Data Quality, or Data Governance roles with production systems. Strong SQL and hands-on experience with one or more: Spark/Databricks, dbt, Airflow/Databricks Workflows, Kafka/Kinesis, Python. Experience implementing data quality frameworks and observability (e.g., Great Expectations, Soda, Monte Carlo ...

5+ years in Data Engineering, Data Quality, or Data Governance roles with production systems. Strong SQL and hands-on experience with one or more: Spark/Databricks, dbt, Airflow/Databricks Workflows, Kafka/Kinesis, Python. Experience implementing data quality frameworks and observability (e.g., Great Expectations, Soda, Monte Carlo ...

5+ years in Data Engineering, Data Quality, or Data Governance roles with production systems. Strong SQL and hands-on experience with one or more: Spark/Databricks, dbt, Airflow/Databricks Workflows, Kafka/Kinesis, Python. Experience implementing data quality frameworks and observability (e.g., Great Expectations, Soda, Monte Carlo ...

5+ years in Data Engineering, Data Quality, or Data Governance roles with production systems. Strong SQL and hands-on experience with one or more: Spark/Databricks, dbt, Airflow/Databricks Workflows, Kafka/Kinesis, Python. Experience implementing data quality frameworks and observability (e.g., Great Expectations, Soda, Monte Carlo ...