101 to 125 of 158 Apache Spark Jobs in the UK

Senior Machine Learning Engineer

Hiring Organisation
Fortice
Location
Greater Bristol Area, United Kingdom
communication skills and a collaborative approach Nice to have Edge AI or embedded ML deployment (Jetson, Raspberry Pi, ARM or similar) Computer Vision Databricks, Spark, MLflow Docker, Kubernetes and AWS Experience working in defence, aerospace, robotics, autonomous systems or other safety-critical environments Current SC or DV clearance (although ...

Fraud Data Analytics Senior Consultant

Hiring Organisation
MERJE Ltd
Location
London, South East, England, United Kingdom
Employment Type
Full-Time
Salary
£48,000 - £53,000 per annum
Experience with: Relational databases (SQL Server, PostgreSQL, Oracle, MySQL) Data visualisation tools (Power BI, Tableau, Spotfire) Cloud platforms, particularly Microsoft Azure Big data technologies (Spark, Elasticsearch, Hadoop) Statistical modelling and advanced analytics Machine learning and pattern recognition techniques Web technologies such as HTML and JavaScript ...

Jr Machine Learning Engineer

Hiring Organisation
Information Tech Consultants
Location
Greater London, England, United Kingdom
extracting, manipulating, and preparing data from relational databases. Experience with NoSQL databases is a plus. Big Data/Cloud: Experience with big data tools ( Spark, Hadoop ) and cloud computing platforms ( AWS, Azure, or GCP ) for scalable ML workflows. Visualization: Ability to create clear, compelling data visualizations using tools like ...

Assistant Director - Data Specialist

Hiring Organisation
Moody's
Location
City and Borough of Salford, United Kingdom
Employment Type
Full Time
maintain operational continuity and quality output Knowledge of data processing frameworks, including ETL pipelines, data integration, and data modeling (experience with Databricks or Spark preferred) Strong analytical and problem-solving skills with the ability to communicate clearly to both technical and non-technical stakeholders Basic understanding of artificial intelligence ...

Consulting/Principal Software Engineer

Hiring Organisation
Elsevier
Location
Greater London, United Kingdom
Employment Type
Full Time
operations. Demonstrated depth in Big Data engineering, with proficiency in at least one of the following areas: distributed data processing platforms such as Databricks, Spark, or EMR search platforms such as OpenSearch or Elasticsearch graph databases such as Neo4j Strong understanding of Agile and Lean practices, including backlog refinement ...

Gen AI Engineer

Hiring Organisation
Capgemini
Location
Greater London, United Kingdom
Employment Type
Full Time
Regulatory compliance automation Conversational AI/chatbots for banking use cases 2 . Data Engineering & Platform Development Build scalable data pipelines using tools like Spark, PySpark, Databricks, Snowflake, or BigQuery Design data lakes/lakehouse architectures on AWS/Azure/GCP Integrate structured and unstructured data (market feeds … data engineering/AI engineering Strong Python and SQL expertise Hands-on experience with: LLMs and GenAI frameworks (LangChain, LlamaIndex) Vector databases & embeddings Spark/Databricks/distributed computing Experience in REST APIs and microservices architecture Cloud & Tools Cloud: Azure (preferred), AWS, or GCP Data platforms: Snowflake, Databricks, Delta ...

Senior Data Fabric Engineer

Hiring Organisation
FBI &TMT
Location
Farnborough, Hampshire, South East, United Kingdom
Employment Type
Permanent
Salary
£75,000
Limited (DDIL) communications environments, supporting local processing at the edge Building streaming ingestion, event pipelines, and batch/stream processing workloads using technologies like Apache Flink and/or Apache Spark Implementing metadata, lineage, and catalogue capabilities along with policy-based security and governance Job Requirements: Extensive ...

Data Engineer

Hiring Organisation
Hexegic
Location
London, United Kingdom
data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

Quantexa Technical Lead - Senior Manager

Hiring Organisation
Lorien
Location
London, South East, England, United Kingdom
Employment Type
Full-Time
Salary
£100,000 - £120,000 per annum
large-scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward ...

Data Analyst - Customer Success

Hiring Organisation
RedCat Digital
Location
London, United Kingdom
data extraction, transformation, and pipeline development. Proficiency with data visualization tools (Tableau, Qlik, or similar). Experience with big data platforms (Snowflake, Databricks, Spark) and ETL processes . Working knowledge of Python or R for analytics or automation (preferred). Understanding of statistical methods and A/B testing ...

Data Product Manager

Hiring Organisation
Harnham
Location
England, United Kingdom
large-scale data platforms or complex data pipelines. Deep understanding of analytics, ML workflows, and data product development. Strong grasp of tools such as Spark, Cassandra, and Redshift. Comfortable discussing technical architecture and data systems with engineers. Strong communicator with the ability to explain complex concepts to non-technical ...

Data Engineer

Hiring Organisation
IMServ Europe Ltd
Location
MK14, Great Linford, Milton Keynes, Buckinghamshire, United Kingdom
Employment Type
Permanent
Salary
£55000 - £60000/annum
ongoing basis. Contribute to the planning, research, recommendation, and implementation of current and future IT strategies. PERSON SPECIFICATION: Essential Demonstrable experience of Spark (PySpark) and SQL. Demonstrable experience of Fabric components. Demonstrable experience of working on enterprise environments. Experience of designing architectural Fabric processes. Experience of Azure Data Factory. ...

Data Engineer - Products

Hiring Organisation
RealityMine
Location
Trafford Park, England, United Kingdom
manage multiple priorities and respond calmly to issues. • Self-motivated with a collaborative approach. Preferred: • Familiarity with AWS data tooling such as S3, Athena, Spark or notebooks. • Experience supporting data products or client-facing datasets. • Understanding of release testing, UAT or production support processes. • Exposure to Jira/Agile ...

Lead Data Scientist - Trust and Safety

Hiring Organisation
Wise
Location
Greater London, United Kingdom
Employment Type
Full Time
machine learning frameworks and programming languages such as Python, R, or similar. Experience working with large datasets and data processing technologies (e.g., Hadoop, Spark, SQL). Familiarity with anomaly detection, supervised, unsupervised learning methods, deep learning, and graph based solutions Demonstrated ability to work collaboratively in cross-functional teams ...

Model Development Team Lead for Name List Screening (NLS) & Transaction Screening (TS) - Model Strats

Hiring Organisation
Deutsche Bank
Location
Greater London, United Kingdom
Employment Type
Full Time
loop, calibration, guardrails, auditability) Experience with hyperparameter tuning at scale and experimentation frameworks Strong technical experience with SQL and Python; significant experience with Spark for large-scale data processing Excellent interpersonal skills with demonstrable collaborative leadership capabilities (coaching, mentoring, guiding, delivery ownership and stakeholder engagement) and strong standards ...

Data Scientist- Performance Marketing

Hiring Organisation
Booking.com
Location
Manchester, United Kingdom
Employment Type
Full Time
using data mining techniques and with statistical rigor Strong technical skills regarding data analysis, statistics, machine learning and programming. Strong working knowledge of Hadoop, Spark, SQL, Python and/or R. Excellent communication skills Strong skills in translating business problems into data problems Strong data visualization skills Strong skills ...

GCP Data Engineer

Hiring Organisation
HCLTech
Location
London Area, United Kingdom
processin g.Cloud Pub/Su b: For real-time messaging and event ingestio n.Cloud Storag e: For scalable and durable object storag e.Cloud Composer (Apache Airflow ): For workflow orchestration and pipeline managemen t.Cloud Datapro c: For managed Hadoop and Spark clusters (good to have ).Cloud SQL/Cloud ...

Senior Data Engineer

Hiring Organisation
ID5.io
Location
United kingdom
based languages (Java, Kotlin), ideally combined with Python and experience in Spring Boot Solid understanding of data engineering tools and frameworks, like Spark, Flink, Kafka, dbt, Trino, and Airflow. Hands-on experience with cloud environments (AWS, GCP, or Azure), infrastructure-as-code practices, and ideally container orchestration with Kubernetes. … with experience in CI/CD pipelines, monitoring, and observability tools (Grafana or equivalent). Exposure to analytics, reporting, and BI tools such as Apache Superset, Lightdash or OpenSearch Willingness to work across the stack by contributing to API development and, at times, UI components (Vue.js, Zoho, or similar ...

Senior Data Engineer (eDV)

Hiring Organisation
Frontier Resourcing Ltd
Location
Manchester, North West, United Kingdom
Employment Type
Permanent
with large-scale and unstructured datasets. Python development experience, including technologies such as PySpark, Pandas and PyArrow. Expertise in distributed data processing frameworks, particularly Apache Spark. Experience building and maintaining ETL pipelines using technologies such as Apache Airflow, AWS Step Functions or Apache NiFi. Cloud platform experience ...

Senior Databricks QA Engineer

Hiring Organisation
Opus Recruitment Solutions
Location
Swindon, Wiltshire, United Kingdom
Employment Type
Contract
Contract Rate
£400 - £500/day
Swindon (we could consider twice per fortnight etc). Required Skills & Experience Strong experience testing data pipelines/ETL processes Hands-on experience with Apache Spark Experience working with Databricks and/or AWS Glue Proven ability to build automation or testing frameworks (Python preferred) Experience with large ...

OpenSource Data Platform Solution Engineer

Hiring Organisation
Hays Specialist Recruitment Limited
Location
Sheffield, South Yorkshire, England, United Kingdom
Employment Type
Contractor
Contract Rate
£500 - £530 per day
teams Ensure solutions meet security, compliance, and regulatory standards Key Skills Required: Experience in solution design/architecture Strong background in big data tools (Spark, Airflow, Trino, etc.) Knowledge of cloud platforms (AWS/Azure/GCP) Understanding of cybersecurity principles (IAM, encryption, secure design) Ability to work hands ...

Site Reliability Engineer

Hiring Organisation
Digital Gurus
Location
United Kingdom
performance. Desirable Skills Experience working with data platforms, data pipelines or data-heavy environments. Exposure to batch or streaming data workloads, such as Kafka, Spark, Airflow, Glue, EMR, Databricks or similar. Data observability experience. Previous public sector experience across multiple engagements. Consultancy experience would be beneficial, especially within environments ...

Data Architect

Hiring Organisation
Raytheon
Location
Warminster, Wiltshire, South West, United Kingdom
Employment Type
Permanent
like ER/Studio, ERwin, or Sparx EA (preferred). Experience reverse engineering models from existing databases. Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop). Experience with API management and gateway tools and services. Experience of RESTful APIs for ingesting and exposing data. Proven track record … with data governance, quality, lineage, and security practices. Experience with real-time/streaming data technologies, data Ingestion/ETL (e.g., Apache Kafka, Apache NiFi, Kinesis, Pub/Sub). Experience in, or knowledge of, DevSecOps Tooling and Processes. Self-starter with the ability to appropriately prioritise ...

Head of Data

Hiring Organisation
PrismFP
Location
London, England, United Kingdom
execute. You have deep experience designing, building, and operating production data pipelines, including owning reliability, monitoring, and failure recovery for orchestration systems such as Apache Airflow (or equivalent). You are fluent in modern data and cloud ecosystems, with hands-on experience (or the ability to ramp quickly … technologies such as Iceberg, Spark, PostgreSQL, and cloud-native infrastructure on AWS (or equivalent). You write clean, readable, and testable Python code, applying sound abstractions, naming, and review discipline to build systems that scale beyond the first version. You bring strong analytical and problem-solving skills ...

Java Data Engineer

Hiring Organisation
Tank Recruitment
Location
City, London, United Kingdom
Employment Type
Contract
Contract Rate
GBP Annual
work on a Big Data Project in the finance sector. Required Experience: Java Big Data experience On-premises cluster experience Databases Kubernetes Kafka Apache Spark Preffered Experience: Finance sector experience ...