226 to 250 of 686 Apache Spark Jobs in England

models into production environments. Data & Engineering Skills Strong SQL skills and experience working with large datasets. Familiarity with data processing tools (Pandas, NumPy, Spark). Experience building APIs (FastAPI, Flask) for ML services. ...

models into production environments. Data & Engineering Skills Strong SQL skills and experience working with large datasets. Familiarity with data processing tools (Pandas, NumPy, Spark). Experience building APIs (FastAPI, Flask) for ML services. ...

models into production environments. Data & Engineering Skills Strong SQL skills and experience working with large datasets. Familiarity with data processing tools (Pandas, NumPy, Spark). Experience building APIs (FastAPI, Flask) for ML services. ...

models into production environments. Data & Engineering Skills Strong SQL skills and experience working with large datasets. Familiarity with data processing tools (Pandas, NumPy, Spark). Experience building APIs (FastAPI, Flask) for ML services. ...

models into production environments. Data & Engineering Skills Strong SQL skills and experience working with large datasets. Familiarity with data processing tools (Pandas, NumPy, Spark). Experience building APIs (FastAPI, Flask) for ML services. ...

models into production environments. Data & Engineering Skills Strong SQL skills and experience working with large datasets. Familiarity with data processing tools (Pandas, NumPy, Spark). Experience building APIs (FastAPI, Flask) for ML services. ...

improve data engineering processes. Mentor junior engineers and support knowledge-sharing across teams. Key Responsibilities: Design, build, and maintain scalable data pipelines using Databricks, Spark, and Delta Lake. Develop efficient ETL/ELT workflows to process large volumes of structured and unstructured data. Implement data governance, security, and compliance … data pipeline deployment and monitoring. What We Are Looking For: 5+ years of experience in data engineering or related roles. Strong expertise in Databricks, Spark, Delta Lake, and cloud data platforms (AWS, Azure, or GCP). Proficiency in Python and SQL for data manipulation and transformation. Experience with ...

improve data engineering processes. Mentor junior engineers and support knowledge-sharing across teams. Key Responsibilities: Design, build, and maintain scalable data pipelines using Databricks, Spark, and Delta Lake. Develop efficient ETL/ELT workflows to process large volumes of structured and unstructured data. Implement data governance, security, and compliance … data pipeline deployment and monitoring. What We Are Looking For: 5+ years of experience in data engineering or related roles. Strong expertise in Databricks, Spark, Delta Lake, and cloud data platforms (AWS, Azure, or GCP). Proficiency in Python and SQL for data manipulation and transformation. Experience with ...

Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence to data governance ...

Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence to data governance ...

Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence to data governance ...

Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence to data governance ...

excellence and be a person that actively looks for continual improvement opportunities. Knowledge and skills Experience as a Data Engineer or Analyst Databricks/Apache Spark SQL/Python BitBucket/GitHub. Advantageous dbt AWS Azure Devops Terraform Atlassian (Jira, Confluence) About Us What ...

outcomes Your Profile Experience: From 1 year in data science or analytics to Principal-level leadership Proficiency in Python, R, SQL , and familiarity with Spark, TensorFlow, PyTorch Strong knowledge of machine learning, statistical modeling, and data engineering principles Experience with cloud platforms (AWS, Azure, GCP) Excellent communication and client ...

outcomes Your Profile Experience: From 1 year in data science or analytics to Principal-level leadership Proficiency in Python, R, SQL , and familiarity with Spark, TensorFlow, PyTorch Strong knowledge of machine learning, statistical modeling, and data engineering principles Experience with cloud platforms (AWS, Azure, GCP) Excellent communication and client ...

outcomes Your Profile Experience: From 1 year in data science or analytics to Principal-level leadership Proficiency in Python, R, SQL, and familiarity with Spark, TensorFlow, PyTorch Strong knowledge of machine learning, statistical modeling, and data engineering principles Experience with cloud platforms (AWS, Azure, GCP) Excellent communication and client ...

like AWS, Azure, or Google Cloud. Data Modeling: Knowledge of data modeling principles and techniques. Big Data: Experience with big data technologies like Hadoop, Spark, etc. Data Governance: Understanding of data governance principles and practices. Data Security: Knowledge of data security principles and best practices. Project Management: Experience ...

like AWS, Azure, or Google Cloud. Data Modeling: Knowledge of data modeling principles and techniques. Big Data: Experience with big data technologies like Hadoop, Spark, etc. Data Governance: Understanding of data governance principles and practices. Data Security: Knowledge of data security principles and best practices. Project Management: Experience ...

like AWS, Azure, or Google Cloud. Data Modeling: Knowledge of data modeling principles and techniques. Big Data: Experience with big data technologies like Hadoop, Spark, etc. Data Governance: Understanding of data governance principles and practices. Data Security: Knowledge of data security principles and best practices. Project Management: Experience ...

performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout … data lifecycle. Azure Databricks Implementation: Work extensively with Azure Databricks Unity Catalog, including Delta Lake, Spark SQL, and other relevant services. Implement best practices for Databricks development and deployment. Optimise Databricks workloads for performance and cost. Need to program using the languages such as SQL, Python, R, YAML ...

performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout … data lifecycle. Azure Databricks Implementation: Work extensively with Azure Databricks Unity Catalog, including Delta Lake, Spark SQL, and other relevant services. Implement best practices for Databricks development and deployment. Optimise Databricks workloads for performance and cost. Need to program using the languages such as SQL, Python, R, YAML ...

performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout … data lifecycle. Azure Databricks Implementation: Work extensively with Azure Databricks Unity Catalog, including Delta Lake, Spark SQL, and other relevant services. Implement best practices for Databricks development and deployment. Optimise Databricks workloads for performance and cost. Need to program using the languages such as SQL, Python, R, YAML ...

services (Redshift, Lambda, S3, Glue, Lake Formation). Expertise in ETL/ELT development, data warehouse design (Kimball, Lakehouse). Proficiency in Python, Apache Spark, SQL, and CI/CD pipelines. Knowledge of Agile methodologies and ability to manage projects effectively. Excellent stakeholder management and communication skills. Hands … experience with DBT, Apache Iceberg, Docker (nice to have). What you'll get: Salary up to £60,000 Strong career progression and development Hybrid working (2 days a week in Leeds- non-negotiable) Annual Leave: 25 days + Bank Holidays 5% Discretionary bonus Pension: Employee contribution 6%/ ...

services (Redshift, Lambda, S3, Glue, Lake Formation). Expertise in ETL/ELT development, data warehouse design (Kimball, Lakehouse). Proficiency in Python, Apache Spark, SQL, and CI/CD pipelines . Knowledge of Agile methodologies and ability to manage projects effectively. Excellent stakeholder management and communication skills. … Hands-on experience with DBT, Apache Iceberg, Docker (nice to have). What you’ll get: Salary up to £60,000 Strong career progression and development Hybrid working ( 2 days a week in Leeds - non-negotiable ) Annual Leave: 25 days + Bank Holidays 5% Discretionary bonus Pension: Employee contribution ...

also have Experience developing or using AI applications Experience with NoSQL databases (e.g. MongoDB). Experience with big data processing frameworks (e.g. Apache Spark). Knowledge of Large Language Model (LLM) integration, Retrieval-Augmented Generation (RAG), or Agentic AI frameworks. Experience with high-performance computing (HPC) environments (e.g. ...