4 of 4 Apache Spark Jobs in Midlothian

Principal Platform Engineer

Hiring Organisation
London Stock Exchange Group
Location
Edinburgh, Midlothian, United Kingdom
Salary
£ 70 K
advanced data analysis, modelling, and visualization to identify patterns and insights.Ensure data quality, reliability, and security across systems. Work with distributed computing frameworks (e.g., Spark, Hive, Hadoop) to process and analyse large datasets. Stay up to date with the latest trends and technologies in big data, analytics, and cloud … programming skills in languages such as Python, Java, or Scala.Hands-on experience with Databricks, SQL, and data modelling. Proficiency with big data tools (e.g., Apache Spark, Apache Kafka, Presto, etc.) and cloud services (e.g., Azure, AWS, GCP).Familiarity with data visualization tools and business intelligence (e.g., Power ...

Data Engineering Manager

Hiring Organisation
FanDuel
Location
Edinburgh, Midlothian, United Kingdom
Salary
£ 80 K
least 1–2 years in a team leadership or mentorship role.Strong technical background in building and maintaining data pipelines and platforms using tools like Spark, dbt, Airflow, Kafka, or Databricks.Proficiency in one or more programming languages (e.g., Python, Scala, or Java) and SQL.Experience with cloud data platforms (e.g. ...

Systems Engineer - Data Engineering

Hiring Organisation
Hackajob Ltd
Location
Edinburgh, Midlothian, Scotland, United Kingdom
Employment Type
Permanent, Part Time, Work From Home
continuous delivery (CI/CD) pipelines, containerisation, and workflow orchestration. Familiar with ETL/ELT frameworks, and experienced with Big Data Processing Tools (e.g. Spark, Airflow, Hive, etc.) Knowledge of programming languages (e.g. Java, Python, SQL) Hands-on experience with SQL/NoSQL database design. Degree in STEM ...

Associate Director, Lead AI Architect, Security & Justice, Engineering, AI & Data, Technology & Transformation

Hiring Organisation
Deloitte
Location
Edinburgh, Midlothian, United Kingdom
Salary
£ 80 K
MLOps/LLMOps principles, including CI/CD for ML, model monitoring, and governance frameworks.Proficiency with large-scale data processing and storage technologies (SQL, Spark, Hadoop) is a plus.Excellent stakeholder management and communication skills, with proven ability to translate complex AI concepts for diverse audiences.You can understand client challenges ...