1 to 25 of 46 Spark Streaming Jobs in the UK

Senior Data Platform Engineer

Hiring Organisation
easyJet
Location
Luton, England, United Kingdom
pipelines to serve the easyJet analyst and data science community. Highly competent hands-on experience with relevant Data Engineering technologies, such as Databricks, Spark, Spark API, Python, SQL Server, Scala. Work with data scientists, machine learning engineers and DevOps engineers to develop, develop and deploy machine … experience with Terraform or CloudFormation. Understanding of ML development workflow and knowledge of when and how to use dedicated hardware. Significant experience with Apache Spark or any other distributed data programming frameworks (e.g. Flink, Hadoop, Beam) Familiarity with Databricks as a data and AI platform or the Lakehouse ...

Developer

Hiring Organisation
Vallum Associates
Location
London Area, United Kingdom
enabling the technical thought leadership and excellence required for the purpose. Your responsibilities: Design, build, and optimise scalable data pipelines for batch and streaming workloads Develop and manage dataflows, and semantic models to support specific analytics related business requirements Implement complex transformations, aggregations, and joins ensuring performance … skills/knowledge/experience: Experience of programming under Microsoft Azure Cloud Platform Experience of programming under Microsoft Fabric Platform Have knowledge of Spark Programming Ability to write Spark code for large scale data processing, including RDDs, Data Frames, and Spark SQL Python/ ...

Developer

Hiring Organisation
Vallum Associates
Location
City of London, London, United Kingdom
enabling the technical thought leadership and excellence required for the purpose. Your responsibilities: Design, build, and optimise scalable data pipelines for batch and streaming workloads Develop and manage dataflows, and semantic models to support specific analytics related business requirements Implement complex transformations, aggregations, and joins ensuring performance … skills/knowledge/experience: Experience of programming under Microsoft Azure Cloud Platform Experience of programming under Microsoft Fabric Platform Have knowledge of Spark Programming Ability to write Spark code for large scale data processing, including RDDs, Data Frames, and Spark SQL Python/ ...

PySpark

Hiring Organisation
Vallum
Location
London, United Kingdom
Employment Type
Contract
Contract Rate
GBP 450 Annual
enabling the technical thought leadership and excellence required for the purpose. Your responsibilities: Design, build, and optimise scalable data pipelines for batch and streaming workloads Develop and manage dataflows, and semantic models to support specific analytics related business requirements Implement complex transformations, aggregations, and joins ensuring performance … skills/knowledge/experience: Experience of programming under Microsoft Azure Cloud Platform Experience of programming under Microsoft Fabric Platform Have knowledge of Spark Programming Ability to write Spark code for large scale data processing, including RDDs, Data Frames, and Spark SQL Python/ ...

PySpark Developer - Financial Services

Hiring Organisation
Vallum
Location
London, United Kingdom
Employment Type
Contract
Contract Rate
GBP Daily
Essential skills/knowledge/experience: Experience of programming under Microsoft Azure Cloud Platform Have knowledge of Spark Programming Ability to write Spark code for large scale data processing, including RDDs, DataFrames, and Spark SQL Hands-on experience with lakehouses, dataflows, pipelines, and semantic … with a collaborative mindset to work with and manage stakeholders Experience of programming under Microsoft Fabric Platform Python/Notebook programming PySpark programming Spark Streaming/batch processing Delta table Optimization Fabric Spark jobs Java programming language, OOP knowledge Database knowledge, including Relational Database ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
Southampton, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
Cardiff, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
Sheffield, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
Edinburgh, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
Glasgow, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
Leeds, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
Bristol, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
Manchester, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
London, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
Oxford, Oxfordshire, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
Reading, Berkshire, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
Luton, Bedfordshire, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
Basildon, Essex, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
Basingstoke, Hampshire, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
Watford, Hertfordshire, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
Chesterfield, Derbyshire, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
Ipswich, Suffolk, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
High Wycombe, Buckinghamshire, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
Chester, Cheshire, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Data Engineer

Hiring Organisation
Quantum World Technologies Inc
Location
Chelmsford, Essex, UK
Employment Type
Full-time
Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka … Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...