251 to 275 of 710 Apache Spark Jobs in the UK

Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence to data governance ...

Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence to data governance ...

excellence and be a person that actively looks for continual improvement opportunities. Knowledge and skills Experience as a Data Engineer or Analyst Databricks/Apache Spark SQL/Python BitBucket/GitHub. Advantageous dbt AWS Azure Devops Terraform Atlassian (Jira, Confluence) About Us What ...

outcomes Your Profile Experience: From 1 year in data science or analytics to Principal-level leadership Proficiency in Python, R, SQL , and familiarity with Spark, TensorFlow, PyTorch Strong knowledge of machine learning, statistical modeling, and data engineering principles Experience with cloud platforms (AWS, Azure, GCP) Excellent communication and client ...

outcomes Your Profile Experience: From 1 year in data science or analytics to Principal-level leadership Proficiency in Python, R, SQL , and familiarity with Spark, TensorFlow, PyTorch Strong knowledge of machine learning, statistical modeling, and data engineering principles Experience with cloud platforms (AWS, Azure, GCP) Excellent communication and client ...

outcomes Your Profile Experience: From 1 year in data science or analytics to Principal-level leadership Proficiency in Python, R, SQL, and familiarity with Spark, TensorFlow, PyTorch Strong knowledge of machine learning, statistical modeling, and data engineering principles Experience with cloud platforms (AWS, Azure, GCP) Excellent communication and client ...

ideal person for this role will have a strong background in data engineering , with experience building modern data solutions using technologies like Kafka , Spark , Databricks , dbt , and Airflow . You'll know your way around cloud platforms (AWS, GCP, or Azure) and be confident coding in Python , Java ...

ideal person for this role will have a strong background in data engineering , with experience building modern data solutions using technologies like Kafka , Spark , Databricks , dbt , and Airflow . You'll know your way around cloud platforms (AWS, GCP, or Azure) and be confident coding in Python , Java ...

data quality. Strong proficiency in one the programming languages, such as Python, Java, Scala, C++, etc. Experience with distributed computing frameworks such as Ray, Spark, and MapReduce. Attention to detail and a strong commitment to data integrity. Excellent problem-solving skills and ability to work in a fast-paced ...

data quality. Strong proficiency in one the programming languages, such as Python, Java, Scala, C++, etc. Experience with distributed computing frameworks such as Ray, Spark, and MapReduce. Attention to detail and a strong commitment to data integrity. Excellent problem-solving skills and ability to work in a fast-paced ...

like AWS, Azure, or Google Cloud. Data Modeling: Knowledge of data modeling principles and techniques. Big Data: Experience with big data technologies like Hadoop, Spark, etc. Data Governance: Understanding of data governance principles and practices. Data Security: Knowledge of data security principles and best practices. Project Management: Experience ...

like AWS, Azure, or Google Cloud. Data Modeling: Knowledge of data modeling principles and techniques. Big Data: Experience with big data technologies like Hadoop, Spark, etc. Data Governance: Understanding of data governance principles and practices. Data Security: Knowledge of data security principles and best practices. Project Management: Experience ...

performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout … data lifecycle. Azure Databricks Implementation: Work extensively with Azure Databricks Unity Catalog, including Delta Lake, Spark SQL, and other relevant services. Implement best practices for Databricks development and deployment. Optimise Databricks workloads for performance and cost. Need to program using the languages such as SQL, Python, R, YAML ...

performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout … data lifecycle. Azure Databricks Implementation: Work extensively with Azure Databricks Unity Catalog, including Delta Lake, Spark SQL, and other relevant services. Implement best practices for Databricks development and deployment. Optimise Databricks workloads for performance and cost. Need to program using the languages such as SQL, Python, R, YAML ...

performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout … data lifecycle. Azure Databricks Implementation: Work extensively with Azure Databricks Unity Catalog, including Delta Lake, Spark SQL, and other relevant services. Implement best practices for Databricks development and deployment. Optimise Databricks workloads for performance and cost. Need to program using the languages such as SQL, Python, R, YAML ...

services (Redshift, Lambda, S3, Glue, Lake Formation). Expertise in ETL/ELT development, data warehouse design (Kimball, Lakehouse). Proficiency in Python, Apache Spark, SQL, and CI/CD pipelines. Knowledge of Agile methodologies and ability to manage projects effectively. Excellent stakeholder management and communication skills. Hands … experience with DBT, Apache Iceberg, Docker (nice to have). What you'll get: Salary up to £60,000 Strong career progression and development Hybrid working (2 days a week in Leeds- non-negotiable) Annual Leave: 25 days + Bank Holidays 5% Discretionary bonus Pension: Employee contribution 6%/ ...

services (Redshift, Lambda, S3, Glue, Lake Formation). Expertise in ETL/ELT development, data warehouse design (Kimball, Lakehouse). Proficiency in Python, Apache Spark, SQL, and CI/CD pipelines . Knowledge of Agile methodologies and ability to manage projects effectively. Excellent stakeholder management and communication skills. … Hands-on experience with DBT, Apache Iceberg, Docker (nice to have). What you’ll get: Salary up to £60,000 Strong career progression and development Hybrid working ( 2 days a week in Leeds - non-negotiable ) Annual Leave: 25 days + Bank Holidays 5% Discretionary bonus Pension: Employee contribution ...

also have Experience developing or using AI applications Experience with NoSQL databases (e.g. MongoDB). Experience with big data processing frameworks (e.g. Apache Spark). Knowledge of Large Language Model (LLM) integration, Retrieval-Augmented Generation (RAG), or Agentic AI frameworks. Experience with high-performance computing (HPC) environments (e.g. ...

year in a data-related role to Principal-level expertise Background in Analytics, Engineering, Data Science, or Consulting Skilled in tools like Python, SQL, Spark, Power BI , and cloud platforms ( AWS, Azure, GCP ) Strong problem-solving and communication skills Comfortable in client-facing environments Active SC or DV Clearance ...

year in a data-related role to Principal-level expertise Background in Analytics, Engineering, Data Science, or Consulting Skilled in tools like Python, SQL, Spark, Power BI , and cloud platforms ( AWS, Azure, GCP ) Strong problem-solving and communication skills Comfortable in client-facing environments Active SC or DV Clearance ...

year in a data-related role to Principal-level expertise Background in Analytics, Engineering, Data Science, or Consulting Skilled in tools like Python, SQL, Spark, Power BI, and cloud platforms (AWS, Azure, GCP) Strong problem-solving and communication skills Comfortable in client-facing environments Active SC or DV Clearance ...

collaborative, forward-thinking culture where engineers work on large-scale datasets, distributed systems, and modern cloud platforms. Teams leverage cutting-edge tools such as Spark, Airflow, Kafka, dbt, and Databricks to build resilient, scalable, and high-quality data solutions. Why this role? ** Lead a talented team of data engineers ...

collaborative, forward-thinking culture where engineers work on large-scale datasets, distributed systems, and modern cloud platforms. Teams leverage cutting-edge tools such as Spark, Airflow, Kafka, dbt, and Databricks to build resilient, scalable, and high-quality data solutions. Why this role? ** Lead a talented team of data engineers ...

collaborative, forward-thinking culture where engineers work on large-scale datasets, distributed systems, and modern cloud platforms. Teams leverage cutting-edge tools such as Spark, Airflow, Kafka, dbt, and Databricks to build resilient, scalable, and high-quality data solutions. Why this role? ** Lead a talented team of data engineers ...

collaborative, forward-thinking culture where engineers work on large-scale datasets, distributed systems, and modern cloud platforms. Teams leverage cutting-edge tools such as Spark, Airflow, Kafka, dbt, and Databricks to build resilient, scalable, and high-quality data solutions. Why this role? ** Lead a talented team of data engineers ...