Apache Spark Jobs in the UK

76 to 99 of 99 Apache Spark Jobs in the UK

Senior Engineer

London, United Kingdom
Hybrid / WFH Options
Confidential
first and collaborative development using Java, Kotlin, C++, JavaScript and Oracle and leverage cutting-edge technologies such as MongoDB, ClickHouse, Kafka, Redis, Ignite, gRPC, Spark, and Tableau. We build cloud-ready solutions and host them on-premises (Google Anthos) and on public cloud (Google GKE). You will be more »
Posted:

DevSecOps

EC1N, Farringdon Without, Greater London, United Kingdom
Damia Group Ltd
skilled SC Cleared DevSecOps Engineer to join their team where your key responsibilities will be to : Manage operational procedures. Transform and process data using Apache Spark. Administer AWS RDS with MySQL. Work with the Hadoop platform. Create reports using Tableau. Utilize Red Hat Decision Central Skills/Experience Required … of the SC Cleared DevSecOps Engineer: Strong operational procedures knowledge. Proficient in Apache Spark, AWS RDS (MySQL), and Hadoop. Knowledge of Tableau and Red Hat Decision Central If this SC Cleared DevSecOps Engineer role sounds a good fit for you get in touch now for a prompt discussion more »
Employment Type: Permanent
Salary: £50000 - £65000/annum 15% cash flex and 10% bonus
Posted:

Deputy Data Warehouse Manager

London, United Kingdom
Hybrid / WFH Options
Imperial College Healthcare NHS Trust
s Office. There will be a particular emphasis in this role on developing within a Microsoft SQL Server development environment and/or an Apache Spark big data processing environment - creating algorithms and pipelines to ingest and transform data into information systems and solutions capable of answering clinical more »
Employment Type: Permanent
Salary: £58698.00 - £65095.00 a year
Posted:

Data Warehouse Manager

London, United Kingdom
Imperial College Healthcare NHS Trust
There will be a particular emphasis in this role on developing information systems within a Microsoft SQL Server development environment and/or an Apache Spark big data processing environment creating algorithms and pipelines to ingest and transform data into information systems and solutions capable of answering clinical more »
Employment Type: Permanent
Salary: £66718.00 - £76271.00 a year
Posted:

Senior Data Scientist PhD- Canary Wharf

London, United Kingdom
Confidential
analytics. The Client would also like to see experience of managing and leading a team of Data Scientists. Should have experience of SCALA/SPARK and Hadoop. Initially this is a 3 month contract assignment in Canary Wharf - with likelihood that it will go on beyond that point. Location more »
Posted:

Senior Software Engineer, Technical Lead

South West London, London, United Kingdom
Networking People (UK) Limited
major advantage Experience in building and enhancing compute, storage, and data platforms with exposure to open source products like Kubernetes, Knative, Ceph, Rook, Cassandra, Spark, Nate and the like. Hands-on with infrastructure-as-code tools and automation, such as Terraform, Ansible, or Helm. The role Tech Lead responsible more »
Employment Type: Permanent
Posted:

Associate Director, Credit Solutions

London, United Kingdom
Confidential
equity financing to mid-market and late-stage companies. Liquidity Group is backed by leading global financial institutions including Japan s largest bank, MUFG, Spark Capital, and Apollo Asset Management. About the role We're on the lookout for accomplished credit professionals to assume the role of Director within more »
Posted:

Data Engineer

London, United Kingdom
Confidential
and Data Mart. Utilize Vector Databases, Cosmos DB, Redis, and Elasticsearch for efficient data storage and retrieval. Demonstrate proficiency in programming languages including Python, Spark, Databricks, Pyspark, SQL, and ML Algorithms. Implement Machine Learning models and algorithms using Pyspark, Scikit Learn, and other relevant tools. Manage Azure DevOps, CI … Azure Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Experience with Vector Databases, Cosmos DB, Redis, Elasticsearch. Strong programming skills in Python, Spark, Databricks, Pyspark, SQL, ML Algorithms, Gen AI. Knowledge of Azure DevOps, CI/CD pipelines, GitHub, Kubernetes (AKS). Experience with ML/OPS more »
Posted:

Senior Engineer in Data

London, United Kingdom
Confidential
About CAIS CAISis the pioneer in democratizing access to and education about alternative investments and structured notes for independent advisors, asset managers, and bank issuers, empowering them to engage and transact on a massive scale. We believe that the combination more »
Posted:

Senior Software Developer

South West London, London, United Kingdom
Networking People (UK) Limited
or Rust. Experience in building and enhancing compute, storage, and data platforms with exposure to open source products like Kubernetes, Knative, Ceph, Rook, Cassandra, Spark, Nate etc. Hands-on exp. with IaC tools and automation, such as Terraform, Ansible, or Helm. Active engagement or contributions to the open-source more »
Employment Type: Permanent
Salary: £85,000
Posted:

Head of Comms

London, United Kingdom
Confidential
equity financing to mid-market and late-stage companies. Liquidity Group is backed by leading global financial institutions including Japan s largest bank, MUFG, Spark Capital, and Apollo Asset Management. Reporting to the Chief Marketing Officer, the Head of Communications will be responsible for developing and executing comprehensive communication more »
Posted:

Senior Software Engineer (Data Engineering), WAN Insights

London, United Kingdom
Confidential
Location: London, United Kingdom Alternate Location Lisbon, Portugal Area of Interest Job Type Professional Software Development Job Id 1424436 Who We Are The name ThousandEyes was born from two big ideas: the power to see what s not ordinarily possible more »
Posted:

Machine Learning Engineer III

London, United Kingdom
Confidential
supply partners, and our travelers. Our work spans across a variety of datasets and ML models and across a diverse technology stack ranging from Spark, Sagemaker, Airflow, Databricks, Kubernetes, AWS and much more! What you will do: Work in a cross-functional team of Machine Learning engineers and Machine … Python and Scala (or Java) Knowledgeable in Big Data technologies, in particular Hadoop, Hive, and Spark. Experience in building real-time applications, preferably in Spark Good understanding of machine learning pipelines and machine learning frameworks such as TensorFlow and Pytorch Familiar with cloud services (e.g., AWS) and workflow orchestration more »
Posted:

Spark & Scala Developer

Milton Keynes, Buckinghamshire, South East, United Kingdom
Maclean Moore Ltd
Role: Spark & Scala Developer Duration: 6 Months Location: Milton Keynes Key responsibilities: Demonstrable experience as an Kafka Developer (Ideally Kafka Streams). Hand on experience in Big data technologies (Hadoop, Hue, Hive, Impala,Spark,.) and stronger within Kafka. Knowledge and experience using Key value data bases . … different applications ,usually 24/7 applications with a big performance requirement . Key skills/knowledge/experience: Big Data Hadoop - Hive and Spark/Scala solid experience SQL advance knowledge - Been able to test changes and issues properly, replicating the code functionality into SQL Worked with Code more »
Employment Type: Contract
Posted:

Senior Data Scientist

London, United Kingdom
Confidential
Learning, and Recommendation Systems. Our stack employs a variety of technologies, including (i) code written in Python, Scala, and TypeScript, (ii) data pipelines using Spark, Luigi, Kubernetes, and Terraform, (iii) prototyping and deploying Machine Learning solutions using Pandas, Scikit-learn, and Dask. Job Responsibilities As a Senior Machine Learning … Experience designing and shipping ML models to production environments Experience with cloud computing infrastructure (AWS/Azure/GCP) Experience with distributed data processing (Spark or similar cloud services) Experience with data querying Basic understanding of Generative AI and LLMs Experience with source control tools (GitHub/GitLab) Great more »
Posted:

IT Architect - Platinion

London, England, United Kingdom
Boston Consulting Group
succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate and digital ventures—and business purpose. We work in … technology consulting environment • Current or previous consulting experience highly desirable • Experience of working with companies in the finance sector highly desirable • Platform implementation experience (Apache Hadoop - Kafka - Storm and Spark, Elasticsearch and others) • Experience around data integration & migration, data governance, data mining, data visualisation, database modelling in an more »
Posted:

Senior Data Scientist

London, United Kingdom
Hybrid / WFH Options
Confidential
improvements Key Skills 3+ years of Python experience Highly statistical and Analytical Exposure to Google Cloud Platform ( BigQuery, GCS, Datalab, Dataproc, Cloud ML (desirable) Spark & Hadoop experience Strong communication skills Good problem solving skills Qualifications Bachelor's degree or equivalent experience in a quantative field (Statistics, Mathematics, Computer Science … classification techniques, and algorithms Fluency in a programming language (Python, C,C++, Java, SQL) Familiarity with Big Data frameworks and visualization tools (Cassandra, Hadoop, Spark, Tableau) This is a permanent position, and offers flexibility with Hybrid working, 2-3 days per week in the office, depending on workload #J more »
Posted:

Senior IT Architect - Data/Cloud - Platinion

London, England, United Kingdom
Boston Consulting Group
succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate and digital ventures-and business purpose. We work in … to 10 years' IT Architecture experience working in a software development, technical project management, digital delivery, or technology consulting environment • Platform implementation experience (Apache Hadoop - Kafka - Storm and Spark, Elasticsearch and others) • Experience around data integration & migration, data governance, data mining, data visualisation, database modelling in an agile more »
Posted:

Senior Data Science Engineer

London, United Kingdom
Confidential
What we expect from you Strong experience building python packages, installable with pip/conda Experience processing big data, ideally in a Hadoop/Spark environment Experience working with relational databases, and SQL-like operations Experience with Airflow/orchestration tooling is beneficial Understanding of Continuous Integration/Continuous … and experience applying them within an Agile framework is beneficial Experience with containerisation beneficial, including Docker/Podman Experience building highly scalable applications with Spark highly beneficial Experience building REST/RPC APIs with Flask/FastAPI/gRPC highly beneficial Understanding of machine learning techniques such asregularised regression more »
Posted:

Information Data Architect

Nottingham, Nottinghamshire, East Midlands, United Kingdom
Microlise
data practices Possess strong knowledge of data tools, data management tools, and various data and information technologies. E.g. DAMA DMBOK, Microsoft SQL Server, Couchbase, Apache Druid, Spark, Kafka, Airflow, etc In-depth understanding of modern data principles, methodologies, and tools Excellent communication and collaboration skills, with the ability … native computing concepts and experience working with hybrid or private cloud platforms is a plus. Demonstrable technical experience working with a Microsoft, Redhat, and Apache data and software engineering environment. A team-oriented individual with a passion for engineered excellence and the ability to lead and motivate a team more »
Employment Type: Permanent
Salary: £70,000
Posted:

Senior ML Engineer

London, United Kingdom
Hybrid / WFH Options
Confidential
wish to. How you will contribute in this role: Architecting, building and maintaining ML processing pipelines/workflows in Python via technologies such as Spark, serverless functions, Airflow, MLflow, or other. Implement MLOps and related DevOps focused on creating ML workflows for deploying models for large scale inference and … looking for: 6+ years of professional experience with ML operations used in large scale digital applications. Extensive experience with programming in Python, Jupyter notebooks, Spark, and Docker Professional experience of designing, building and managing bespoke MLOps in cloud environments, using tools such as SageMaker Processing, SageMaker Pipelines, Apache more »
Posted:

Lead Data Engineer

London, United Kingdom
Confidential
SQL Server, Sybase, Snowflake) Document databases (e.g. Mongo, ArangoDB, Couchbase, Solr) Big Data (e.g. Hadoop ecosystem, Bigtable) Data streaming (e.g. Kafka, Flink, Pulsar, Beam, Spark) Cloud databases (e.g. Snowflake, CockroachDB) Other database genres (e.g. Graph, Columnar, time series) In return, we ll give you A competitive basic salary … scheme A high spec laptop (of course) Need more reasons? Here's a few more Work with some of the most exciting new technologies Spark off co-workers who ll challenge your thinking and help you to achieve your potential Deal openly and honestly with customers Benefit from a more »
Posted:

(Senior) Data Scientist - Marketplace - London

London, United Kingdom
Hybrid / WFH Options
Confidential
(Senior) Data Scientist - Marketplace - London Location : We are flexible! Come and join us either in Hamburg, Berlin, London or Athens At FREE NOW, we are at an exciting point in our history we are building a world-class product used more »
Posted:
Apache Spark
10th Percentile
£47,500
25th Percentile
£63,750
Median
£80,000
75th Percentile
£102,500
90th Percentile
£118,750