276 to 297 of 297 Apache Spark Jobs in England

strategy and promote best practices amongst engineers and data scientists. How to make an Impact Architect and Implement : Own the technical roadmap for our Spark-based data processes to ensure our Airflow pipelines are performant, cost-effective, and scalable. You will enhance our existing services through hands-on development … deployment. Expert-level Python and its data ecosystem (Numpy, Pandas), including designing frameworks for data tasks. Deep understanding of distributed data processing engines like Apache Spark. Ability to reason about the full data lifecycle from ingestion through to real-time serving - your system designs will need to meet downstream ...

retraining, and optimise models for reliability and cost efficiency in AWS.Collaboration & Enablement: Partner with data engineers to integrate ML workflows into wider platforms (Spark, Databricks), and share best practice and mentor other technical professionals. What You'll Love About This RoleThink Big: Build ML and AI solutions that shape … models underperform across data, features and architecture, and make reasoned trade-offs. Real-time & distributed ML: A strong grasp of production inference patterns, plus Spark and distributed data processing. Reproducibility & tooling: Reproducible environments (UV/Docker) and MLflow or equivalent, on AWS with Spark, Databricks and Snowflake. Engineering ...

Applying advanced techniques in LLMs, agentic systems, vector databases, fine‐tuning, and deployment tools (e.g., HuggingFace, Langchain). Hands‐on experience working with distributed Spark‐based systems. Experience with data engineering concepts or a good understanding of data engineering concepts. Pre‐sales or post‐sales experience working with external … clients across a variety of industry markets. Minimum of 5+ years of customer‐facing experience would be preferred. [Preferred] Experience working with Apache SparkTM to process large‐scale distributed datasets. Communication: Proven ability to communicate and teach complex technical concepts to both technical and non‐technical audiences. Core Traits ...

interest or experience in data/network security would be a nice-to-have Datadog/Grafana/Prometheus Data related products (Airflow, Jupyter, Spark, dbt etc) The projects will be varied and we're looking for someone who can work autonomously and proactively to scope problems and solve … tracking CircleCI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Postgres/Aurora for our relational databases Spark for data processing dbt for data modelling SparkSQL for analytics Streamlit for data applications Are you ready for a career with us? We want ...

teams and setting best practice standards Designing data models, ETL pipelines, warehousing solutions and distributed systems Building and supporting real-time streaming platforms using Apache Flink and related technologies Ensuring compliance with industry standards and government regulations Tracking delivery against agreed designs and managing design deviations Supporting pre-sales … data architecture on complex, secure programmes Strong hands-on AWS experience (EC2, S3, RDS, Lambda, Redshift); Azure or GCP a bonus Proven experience using Apache Flink for real-time, high-throughput data processing Experience leading, mentoring and developing technical teams Confident engaging with senior technical and non-technical stakeholders ...

Build and manage CI/CD pipelines and Infrastructure as Code using Terraform, GitLab CI, and GitHub. Support big data platforms using Hadoop, Hive, Spark, EMR, Athena, and Redshift. Implement monitoring, logging, security, and compliance controls across cloud environments. Drive automation, containerisation, and platform resilience using Kubernetes, Python … with Terraform and CI/CD tools (GitLab CI, Concourse, GitHub). Strong Linux administration experience. Experience with big data technologies including Hadoop, Hive, Spark, and Amazon EMR (or equivalent). Knowledge of monitoring, logging, and security tools. Desirable Skills Kubernetes/EKS or other container platforms. Python scripting ...

meeting assigned project objectives and timelines. Hands-on Kubernetes experienceHands-on AWS experienceDatabases and middleware — Postgres, Kafka, RedisBig data stack — data warehousing, MPP, Spark, FlinkMicro-service architecture and service meshUI development experienceWhat You Will Bring:3+ years of software development experienceStrong command of at least one of Java, Python …/CD pipelines such as Jenkins or CodeDeployPreferredHands-on Kubernetes experienceHands-on AWS experienceDatabases and middleware — Postgres, Kafka, RedisBig data stack — data warehousing, MPP, Spark, FlinkMicro-service architecture and service meshUI development experienceBenefits Full time benefits for FTJob SummaryJob number: P-122606Date posted : 2026-09-09Profession: Software & DigitalEmployment ...

matter – packed with personal touches and delivered with care. We’re not just about selling cards or gifts – we’re here to spread joy, spark smiles and make every celebration feel extra special. And with values that guide how we work and support one another, we’ve built … place where people (and ideas) can truly thrive. If you’re looking to make an impact, bring your spark and be part of something meaningful – we’d love to have you on the team. Data Scientist | London or Manchester – Hybrid (1–2 office days per week) | Competitive Salary + ...

matter – packed with personal touches and delivered with care. We're not just about selling cards or gifts – we're here to spread joy, spark smiles and make every celebration feel extra special. And with values that guide how we work and support one another, we've built … place where people (and ideas) can truly thrive. If you're looking to make an impact, bring your spark and be part of something meaningful – we'd love to have you on the team. Senior Data Scientist | London or Manchester - Hybrid (1-2 office days per week) | Competitive Salary ...

modeling and the creation of type-safe and easily testable batch jobs. The team also orchestrates a compute environment that simplifies the execution of Spark jobs, facilitating the analysis of terabytes of data with ease and cost-effectiveness. The runtime environment is based on Hadoop clusters on EC2 spot … Identifying and implementing computational improvements Making improvements and/or fixing bugs by submitting patches to open-source projects in our stack, such as Spark, Iceberg, Hadoop, Airflow, and many others Acting as an expert on Spark and Scala Mentoring engineers (including through pairing, design discussions, and knowledge ...

replication tool, and Waggle Dance, a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg, a high-performance open table format for large analytic datasets that underpins many modern Lakehouse architectures. We guarantee you'll learn … scalability, reliability, and observability. Strong knowledge of the JVM and server-side Kotlin/Java programming. Solid understanding of the Hadoop ecosystem, including Spark, Hadoop, and Hive. Strong experience with cloud platforms and data infrastructure, especially AWS, including EMR, S3, and Glue. Experience working in Agile environments and contributing ...

across devices and platforms to surface key metrics. The role emphasizes coding in Python, strong SQL, and experience with large data ecosystems (HDFS, Hive, Spark, Airflow). You will influence architecture and own initiatives from concept to delivery. Hybrid work from Cambridge Office. #J-18808-Ljbffr ...

matter – packed with personal touches and delivered with care. We’re not just about selling cards or gifts – we’re here to spread joy, spark smiles and make every celebration feel extra special. And with values that guide how we work and support one another, we’ve built … place where people (and ideas) can truly thrive. If you’re looking to make an impact, bring your spark and be part of something meaningful – we’d love to have you on the team. Software Engineering Manager – Reminders | London or Manchester – Hybrid (1–2 days per week ...

matter – packed with personal touches and delivered with care. We’re not just about selling cards or gifts – we’re here to spread joy, spark smiles and make every celebration feel extra special. And with values that guide how we work and support one another, we’ve built … place where people (and ideas) can truly thrive. If you’re looking to make an impact, bring your spark and be part of something meaningful – we’d love to have you on the team. Software Engineering Manager – Reminders | London or Manchester – Hybrid (1–2 days per week ...

tuned foundational Large Language Models (LLMs), along with sub-agents, tools, and MCP integrations Architect end-to-end ML pipelines, integrating data processing (e.g. Spark, Airflow) with model training, evaluation, and deployment workflows Drive experimentation frameworks, including A/B testing and offline evaluation, to continuously improve model performance … fine‐tuning Large Language Models (LLMs) and building production AI Agents Proven experience designing scalable data and ML pipelines using tools such as Spark, Airflow, or similar distributed systems Demonstrated ability to operate as a senior individual contributor, influencing technical strategy and decision‐making without direct authority Experience partnering ...

Software Engineer - Space Domain Awareness | Job DetailsAre you looking for an innovative and consolidated place for your professional development? GMV is an experienced technology group and we are looking for a highly motivated Software Engineer ...

with downstream systems, including trader‐facing tools. Experience 5+ years software engineering experience in building distributed systems. Excellent Java skills. Experience with streaming technologies (Apache Flink preferred; Kafka Streams, Spark Streaming, etc.). Solid understanding of event‐driven architecture and asynchronous processing patterns. Experience handling data consistency challenges ...

downstream systems, including trader-facing tools. Your experience 5+ years software engineering experience in building distributed systems. Excellent Java skills Experience with streaming technologies (Apache Flink preferred; Kafka Streams, Spark Streaming, etc.). Solid understanding of event-driven architecture and asynchronous processing patterns. Experience handling data consistency challenges ...

Excellent communication skills Degree in CS, maths, statistics, engineering, physics or similar Desirable Requirements: NoSQL databases – Elasticsearch, MongoDB...etc (bonus) Modern Data tools such as Spark/Beam (bonus) Streaming technologies such as Spark/Akka Streams (bonus) Tagged as: Industry, NLP, United Kingdom #J-18808-Ljbffr ...

build these systems with industry standard frameworks and tools, such as React and Angular on the front end with Java, Spring Boot and Apache Kafka on the back end. All of this runs on our cutting edge cloud delivery platform, facilitating over 60k releases to production a year. … while delivering high-impact projects. Although not a requirement, helpful experience includes: An interest in working with data at scale using tools like dbt, Spark, and AI/ML frameworks (e.g. PyTorch, TensorFlow, scikit-learn)Experience with Kafka or other event-driven architectures. During our application process, you will ...

Privacy Legal Advisor - 12 Month Contract Location: UK London Employment Type: Employee - Fixed Term Contract Work Arrangement: Hybrid At Bumble, the Love Company, trust is the heart of every connection we help spark. As a ...

matter - packed with personal touches and delivered with care. We're not just about selling cards or gifts - we're here to spread joy, spark smiles and make every celebration feel extra special. And with values that guide how we work and support one another, we've built … place where people (and ideas) can truly thrive. If you're looking to make an impact, bring your spark and be part of something meaningful - we'd love to have you on the team. We're looking for a Senior Data Scientist to join Moonpig, working hybrid from London ...