1 to 25 of 30 Permanent Apache Spark Jobs in Scotland

engineering or a related field, with a focus on building scalable data systems and platforms. Expertise in modern data tools and frameworks such as Spark, dbt, Airflow, Kafka, Databricks, and cloud-native services (AWS, GCP, or Azure) Understanding of data modeling, distributed systems, ETL/ELT pipelines, and streaming More ❯

or a related field, with a focus on building scalable data systems and platforms. Strong expertise with modern data tools and frameworks such as Spark , dbt , Airflow OR Kafka , Databricks , and cloud-native services (AWS, GCP, or Azure). Deep understanding of data modeling , distributed systems , streaming architectures , and More ❯

Intelligence platform, either on Azure or AWS. Good working knowledge of Databricks components: DeltaLake, Unity Catalog, ML Flow, etc. Expertise in SQL, Python and Spark (Scala or Python). Experience working with relational SQL databases either on premises or in the cloud. Experience delivering multiple solutions using key techniques More ❯

architecture, data modelling, ETL/ELT processesand data pipeline development. Competency with cloud platforms (e.g., AWS, Azure, GCP) and big data technologies (e.g., Hadoop, Spark, Kafka etc). Excellent communication and leadership skills, with the ability to engage and influence stakeholders at all levels. Insightful problem-solving skills and More ❯

or a related field, with a focus on building scalable data systems and platforms. Strong expertise in modern data tools and frameworks such as Spark, dbt, Airflow, Kafka, Databricks, and cloud-native services (AWS, GCP, or Azure) Deep understanding of data modeling, distributed systems, ETL/ELT pipelines, and More ❯

ML code. LLMOps & AI Model Management: Experience with tools like MLFlow, LangChain, Hugging Face, Kubeflow, or similar platforms. Data Processing: Proficient with Databricks/Spark for large-scale AI data processing. SQL: Strong capabilities in data querying and preparation. Data Architectures: Understanding of modern data infrastructure (lakehouses, data lakes More ❯

ML code. LLMOps & AI Model Management: Experience with tools like MLFlow, LangChain, Hugging Face, Kubeflow, or similar platforms. Data Processing: Proficient with Databricks/Spark for large-scale AI data processing. SQL: Strong capabilities in data querying and preparation. Data Architectures: Understanding of modern data infrastructure (lakehouses, data lakes More ❯

or a related field, with a focus on building scalable data systems and platforms. Strong expertise in modern data tools and frameworks such as Spark, dbt, Airflow, Kafka, Databricks, and cloud-native services (AWS, GCP, or Azure) Deep understanding of data modeling, distributed systems, ETL/ELT pipelines, and More ❯

performing data analytics on AWS platforms. Experience in writing efficient SQLs, implementing complex ETL transformations on big data platforms. Experience in Big Data technologies (Spark, Impala, Hive, Redshift, Kafka, etc.). Experience in data quality testing; adept at writing test cases and scripts, presenting and resolving data issues. Experience More ❯

discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.) Preferred qualifications, capabilities, and skills Knowledge of AWS Knowledge of Databricks Understanding of Cloudera Hadoop, Spark, HDFS, HBase, Hive. Understanding of Maven or Gradle About the Team J.P. Morgan is a global leader in financial services, providing strategic advice and More ❯

projects with leading organizations? 💡 What You’ll Do: ✅ Design and deliver data solutions using Fabric, Azure Data Factory, and Synapse ✅ Work with SQL, Python, Spark, Kafka, Snowflake , and more ✅ Apply best practices in Data Architecture, Governance, and Engineering ✅ Collaborate with clients to drive real business impact ✅ Be part of More ❯

ML applications or models for these challenges. You will leverage the firm's extensive data resources from both internal and external sources using Python, Spark, and AWS, among other systems. You are expected to extract business insights from technical results and effectively communicate them to a non-technical audience. More ❯

Terraform experience. Strong Kubernetes experience, we want to see people who have worked on Kubernetes implementation, involved in architecture, hands on migration etc K8S, Spark S3 Engine Terraform Ansible CI/CD Hadoop Linux/RHEL - on prem background/container management Grafanna or Elastic Search- for observability Kubernetes More ❯

Terraform experience. Strong Kubernetes experience, we want to see people who have worked on Kubernetes implementation, involved in architecture, hands on migration etc K8S, Spark S3 Engine Terraform Ansible CI/CD Hadoop Linux/RHEL - on prem background/container management Grafanna or Elastic Search- for observability Kubernetes More ❯

Terraform experience. Strong Kubernetes experience, we want to see people who have worked on Kubernetes implementation, involved in architecture, hands on migration etc K8S, Spark S3 Engine Terraform Ansible CI/CD Hadoop Linux/RHEL - on prem background/container management Grafanna or Elastic Search- for observability Kubernetes More ❯

Azure data services Deep understanding of Data Management practices: governance, security, quality, and compliance Proficiency in SQL and familiarity with Azure DevOps Pipelines and Apache Spark Excellent stakeholder engagement and communication skills Relevant certifications (e.g., Azure Solutions Architect Expert or TOGAF) a plus Must be eligible for SC More ❯

Azure data services Deep understanding of Data Management practices: governance, security, quality, and compliance Proficiency in SQL and familiarity with Azure DevOps Pipelines and Apache Spark Excellent stakeholder engagement and communication skills Relevant certifications (e.g., Azure Solutions Architect Expert or TOGAF) a plus Must be eligible for SC More ❯

Azure data services Deep understanding of Data Management practices: governance, security, quality, and compliance Proficiency in SQL and familiarity with Azure DevOps Pipelines and Apache Spark Excellent stakeholder engagement and communication skills Relevant certifications (e.g., Azure Solutions Architect Expert or TOGAF) a plus Must be eligible for SC More ❯

Azure data services Deep understanding of Data Management practices: governance, security, quality, and compliance Proficiency in SQL and familiarity with Azure DevOps Pipelines and Apache Spark Excellent stakeholder engagement and communication skills Relevant certifications (e.g., Azure Solutions Architect Expert or TOGAF) a plus Must be eligible for SC More ❯

Azure data services Deep understanding of Data Management practices: governance, security, quality, and compliance Proficiency in SQL and familiarity with Azure DevOps Pipelines and Apache Spark Excellent stakeholder engagement and communication skills Relevant certifications (e.g., Azure Solutions Architect Expert or TOGAF) a plus Must be eligible for SC More ❯

Azure data services Deep understanding of Data Management practices: governance, security, quality, and compliance Proficiency in SQL and familiarity with Azure DevOps Pipelines and Apache Spark Excellent stakeholder engagement and communication skills Relevant certifications (e.g., Azure Solutions Architect Expert or TOGAF) a plus Must be eligible for SC More ❯

Azure data services Deep understanding of Data Management practices: governance, security, quality, and compliance Proficiency in SQL and familiarity with Azure DevOps Pipelines and Apache Spark Excellent stakeholder engagement and communication skills Relevant certifications (e.g., Azure Solutions Architect Expert or TOGAF) a plus Must be eligible for SC More ❯

Azure data services Deep understanding of Data Management practices: governance, security, quality, and compliance Proficiency in SQL and familiarity with Azure DevOps Pipelines and Apache Spark Excellent stakeholder engagement and communication skills Relevant certifications (e.g., Azure Solutions Architect Expert or TOGAF) a plus Must be eligible for SC More ❯

end ownership • Python or similar (Ruby or Node) or another Functional Language • JavaScript and associated frameworks, preferably Vue, or similar • Cloud technologies • SQL (advantageous) • Spark (advantageous) • Docker/Kubernetes – advantageous ) • MongoDB, SQL, Postgres & Snowflake (advantageous) • Developing online, cloud based SaaS products. • Leading and building scalable architectures and distributed systems More ❯

end ownership • Python or similar (Ruby or Node) or another Functional Language • JavaScript and associated frameworks, preferably Vue, or similar • Cloud technologies • SQL (advantageous) • Spark (advantageous) • Docker/Kubernetes – adv... More ❯