22 of 22 Remote/Hybrid Apache Spark Jobs in London

Spark-Scala Developer

Hiring Organisation
eTeam Workforce Limited
Location
London, United Kingdom
Employment Type
Contract
Contract Rate
GBP Daily
Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you. Role: Spark-Scala Developer Location: London Working Mode: Hybrid (Weekly 3 days onsite) Contract Type: Inside IR35 Duration: 12 months Rate: £440 per day Inside IR35 … Must have skills: -Spark & Scala Nice to have skills: -Spark Streaming, Hadoop, -Hive, -SQL, -Sqoop, - Impala Detailed Job Description: At least 8+ years of experience and strong knowledge in Scala programming language. Able to write clean, maintainable and efficient Scala code following best practices. Good knowledge ...

Lead Data Solutions Architect

Hiring Organisation
Resourgenix Ltd
Location
London, United Kingdom
Employment Type
Permanent
platform, features, and best practices with Strong understanding of data modeling principles and techniques A solid understanding of big data technologies such as Apache Spark, and knowledge of Hadoop ecosystems. Knowledge of programming languages such as Python, R, or Java is beneficial. Knowledge of ETL/ELT processes ...

Databricks Engineer - £400PD - Remote

Hiring Organisation
Tenth Revolution Group
Location
London, United Kingdom
Employment Type
Contract
Contract Rate
£350 - £400/day
data warehousing concepts, and distributed computing. Familiarity with CI/CD, version control, and DevOps practices. Nice-to-Have Experience with streaming technologies (e.g., Spark Structured Streaming, Event Hub, Kafka). Knowledge of MLflow, Unity Catalog, or advanced Databricks features. Exposure to Terraform or other IaC tools. Experience working ...

Data Engineer

Hiring Organisation
Young's Employment Services Ltd
Location
West London, London, United Kingdom
Employment Type
Permanent, Work From Home
Salary
£70,000
Responsibilities will include; Design, implement, and optimize end-to-end solutions using Fabric components: o Data Factory (pipelines, orchestration) o Data Engineering (Lakehouse, notebooks, Apache Spark) o Data Warehouse (SQL endpoints, schemas, MPP performance tuning) o Real-Time Analytics (KQL databases, event ingestion) o Manage and enhance OneLake ...

Data Engineer

Hiring Organisation
Youngs Employment Services
Location
W12, Wormholt and White City, Greater London, United Kingdom
Employment Type
Permanent
Salary
£55000 - £70000/annum Excellent Benefits
Responsibilities will include; Design, implement, and optimize end-to-end solutions using Fabric components: o Data Factory (pipelines, orchestration) o Data Engineering (Lakehouse, notebooks, Apache Spark) o Data Warehouse (SQL endpoints, schemas, MPP performance tuning) o Real-Time Analytics (KQL databases, event ingestion) o Manage and enhance OneLake ...

Data Engineer

Hiring Organisation
Lynx Recruitment Ltd
Location
London, South East, England, United Kingdom
Employment Type
Full-Time
Salary
£50,000 - £65,000 per annum
experience and familiarity with frameworks (e.g. Flask, Django) Experience building and orchestrating ETL pipelines (e.g. Airflow, Luigi, Argo) Exposure to big data technologies (e.g. Spark, Kafka, Hadoop) Experience working in Agile environments Solid understanding of data architecture and data quality best practices ...

Senior Data Engineer

Hiring Organisation
Lynx Recruitment Ltd
Location
London, South East, England, United Kingdom
Employment Type
Full-Time
Salary
£70,000 - £80,000 per annum
experience and familiarity with frameworks (e.g. Flask, Django) Experience building and orchestrating ETL pipelines (e.g. Airflow, Luigi, Argo) Exposure to big data technologies (e.g. Spark, Kafka, Hadoop) Experience working in Agile environments Solid understanding of data architecture and data quality best practices ...

Senior Data Engineer - Anti-Piracy

Hiring Organisation
Sky
Location
TW75QD, Syon, Greater London, United Kingdom
Employment Type
Permanent
plus) Experience with orchestration and workflow tools (Airflow, Cloud Composer, Dagster, etc.) Familiarity with modern data stack components (BigQuery, dbt, Kafka/PubSub, Spark, etc.) Knowledge of data security, access control, and best practices for handling sensitive data Experience collaborating across engineering, analytics, and product teams Strong communication skills ...

Lead Python Engineer - Director - Equities

Hiring Organisation
Huxley Associates
Location
London, United Kingdom
Employment Type
Permanent
sources, analytics, or trading workflows. Exposure to cloud platforms (Azure, AWS, or GCP). Experience hiring, mentoring, or leading small engineering teams. Familiarity with Apache Spark, Kafka, Delta Lake, or similar data technologies. Apply Now to avoid disappointment! To find out more about Huxley, please visit ...

AI / GenAI Engineer – Investment Banking / Capital Markets

Hiring Organisation
Caspian One
Location
London Area, United Kingdom
TypeScript, JavaScript Machine Learning: TensorFlow, PyTorch, Scikit-learn GenAI/LLMs: OpenAI API, Hugging Face Transformers, LangChain, Langraph, RAG pipelines Data & Analytics: Pandas, NumPy, Spark, Databricks, Hadoop, Vector Databases, Snowflake Model Deployment: MLflow, FastAPI, Flask, Docker, Kubernetes Cloud & Infrastructure: AWS, Azure, GCP CI/CD pipelines (GitLab, Jenkins) Desirable ...

Senior ML Engineer

Hiring Organisation
Anson Mccade
Location
London, United Kingdom
Employment Type
Permanent
Azure, utilizing managed services like SageMaker or Vertex AI. Data Foundations: Strong understanding of data modeling, feature stores, and distributed computing (e.g., Spark, Dask). Qualifications & Experience Experience: 5+ years in a software or data engineering role, with at least 3 years specifically focused on the deployment and scaling ...

Data Analytics Sales Executive

Hiring Organisation
Catch Resource Management
Location
City of London, London, United Kingdom
Data Analytics Sales Executive - Data Sales, Talend, Snowflake, Apache Spark, Kafka, Dataops, AWS, Azure, Data visualisation, SQL, ETL, Pre-Sales, Account Manager, SaaS Sales, Cloud Solutions, Digital Transformation, Business Development, Sales Consultant, CXO Engagement, Strategic Accounts, Deal Negotiation, Remote Working, UK-wide, Permanent Role, Sales Targets, New Business ...

Head of Data Engineering

Hiring Organisation
Harnham - Data & Analytics Recruitment
Location
London, South East, England, United Kingdom
Employment Type
Full-Time
Salary
£105,000 - £115,000 per annum
engineers, setting technical standards and driving best practices across the organisation. The role demands hands-on expertise with Azure, big data technologies like Spark and Hadoop, and programming languages including Python. You will also oversee database architecture, data modelling, and ETL processes to ensure seamless integration across multiple platforms ...

Senior Data Scientist

Hiring Organisation
Anson Mccade
Location
London, United Kingdom
Employment Type
Permanent
from classical statistics and regression to deep learning and NLP. Data Engineering: Proficiency in SQL and experience working with modern data stacks (e.g., Snowflake, Spark, or cloud-native tools on AWS/GCP/Azure). Scientific Rigor: A strong foundation in the scientific methodforming hypotheses, designing experiments ...

Data Engineer

Hiring Organisation
Hexegic
Location
City of London, London, United Kingdom
data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

Data Consultant

Hiring Organisation
Hexegic
Location
City of London, London, United Kingdom
data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

Senior ML Engineer

Hiring Organisation
Anson Mccade
Location
City of London, London, United Kingdom
Employment Type
Permanent, Work From Home
stores (Feast, AWS Feature Store). Containerisation (Docker) and orchestration (Kubernetes, ECS). Infrastructure as Code (Terraform, CloudFormation). Large-scale data processing frameworks (Spark, Dask). Familiarity with data governance and compliance frameworks. Experience in regulated industries such as healthcare or finance. Benefits: Competitive salary ...

Head of Engineering

Hiring Organisation
Tenth Revolution Group
Location
London, South East, England, United Kingdom
Employment Type
Full-Time
Salary
£125,000 - £150,000 per annum
team engineering organisations Strong background in distributed systems, large-scale data pipelines and ML model deployment Deep understanding of modern data stacks such as Spark, Databricks or cloud-native architectures Solid understanding of modern frontend engineering, DevOps knowledge and experience delivering machine learning systems Strong communication, organisation and stakeholder ...

Lead Data Engineer

Hiring Organisation
Experis
Location
London, United Kingdom
Employment Type
Contract
orchestrate data pipelines across Snowflake and AWS environments. Apply data modeling, warehousing, and architecture principles (Kimball/Inmon). Develop pipeline programming using Python, Spark, and SQL; integrate APIs for seamless workflows. Support Machine Learning and AI initiatives, including NLP, Computer Vision, Time Series, and LLMs. Implement MLOps … data pipeline development and orchestration. Proficient with cloud platforms (Snowflake, AWS fundamentals). Solid understanding of data architecture, warehousing, and modeling. Programming expertise: Python, Spark, SQL, API integration. Knowledge of ML/AI frameworks, MLOps, and advanced analytics concepts. Experience with CI/CD, data testing frameworks, and versioning ...

Head of Engineering

Hiring Organisation
Tenth Revolution Group
Location
London, South East, England, United Kingdom
Employment Type
Full-Time
Salary
£80,000 - £150,000 per annum
Head of Engineering - Remote - UK - £80,000-£150,000 GenAI, ML, Spark Why Join This Company? This is a leadership role for someone who wants to work in a truly AI-first engineering environment, not a business experimenting at the edges. The company is already well ahead … solving rather than legacy ways of working. You'll Work With Cross-functional teams spanning: Web Engineering (React/TypeScript) Data Engineering (distributed systems, Spark-based platforms) Data Science & Machine Learning A highly technical CTO who is deeply invested in AI adoption and modern engineering Product leadership following significant ...

Senior Data Engineer

Hiring Organisation
Lynx Recruitment Limited
Location
South West London, London, United Kingdom
Employment Type
Permanent
Salary
£80,000
Senior DataEngineer-RemoteWorking LynxarecurrentlyworkingwithalargeITconsultancytohelpthemsourceaDataEngineer.OurclientislargeglobalConsultancywhoworkwithenterpriseclients,solvingtheirbusinessandtechnologyproblemsusingcuttingedgesolutions. Asa DataEngineer ,youwillplayakeyroleindesigning,building,andmaintainingrobustdataplatformsandpipelines.Youllworkalongsidedatascientists,analysts,andengineerstoensurereliable,scalable,andhigh-qualitydatasolutions. Whatyoullbedoing: Designingandbuildingdatapipelines,models,andarchitectures DevelopingandmaintainingETL/ELTprocessesusingmoderntools Implementingdatastoragesolutionsacrossrelational,non-relational,andcloudplatforms Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience ...

Data Engineer

Hiring Organisation
Lynx Recruitment Limited
Location
South West London, London, United Kingdom
Employment Type
Permanent
Salary
£65,000
DataEngineer-RemoteWorking LynxarecurrentlyworkingwithalargeITconsultancytohelpthemsourceaDataEngineer.OurclientislargeglobalConsultancywhoworkwithenterpriseclients,solvingtheirbusinessandtechnologyproblemsusingcuttingedgesolutions. Asa DataEngineer ,youwillplayakeyroleindesigning,building,andmaintainingrobustdataplatformsandpipelines.Youllworkalongsidedatascientists,analysts,andengineerstoensurereliable,scalable,andhigh-qualitydatasolutions. Whatyoullbedoing: Designingandbuildingdatapipelines,models,andarchitectures DevelopingandmaintainingETL/ELTprocessesusingmoderntools Implementingdatastoragesolutionsacrossrelational,non-relational,andcloudplatforms Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands ...