101 to 125 of 137 Apache Spark Jobs in the UK

mentoring Challenge existing approaches within insurance pricing Take full ownership of delivery approach and outcomes Technology environment Python Databricks Large scale and streaming data Spark or Kafka style processing Tree based models and deep neural networks Production grade machine learning systems What my client look for Essential experience Senior ...

team Exposure to sectors such as defence, public sector and consumer/retail Familiarity with modern data and AI tooling such as Python, Spark, Databricks, Azure cloud, and Generative AI platforms (experience with specific tools is helpful but not essential) A mix of technical, product and operational experience - comfortable ...

Organization. Ads are the fuel that powers the client's mission. Technologies used on the team include: Languages: Go, Python, Scala Frameworks: Spark, Thrift, Kafka Data stores: Postgres, BigQuery, Redis, Druid Tools: Kubernetes, Airflow, Docker Job responsibilities: You will work with the existing engineering team and help contribute ...

starter approach, and strong communication skills Geographical flexibility to move to any Parker location both during and upon completion of the program. Did we spark your interest? Then put your career in motion as soon as possible! Simply click Apply Now and attach a copy of your CV. NextSteps ...

power, and deep knowledge of just about every industry. We believe a mix of data, analytics, automation, and responsible AI can do almost anything—spark digital metamorphoses, widen the range of what humans can do, and breathe life into smart products and services. Want to join our crew ...

power, and deep knowledge of just about every industry. We believe a mix of data, analytics, automation, and responsible AI can do almost anything—spark digital metamorphoses, widen the range of what humans can do, and breathe life into smart products and services. Want to join our crew ...

modelling and database design (relational and basic NoSQL concepts) Gain exposure to cloud-based data platforms and storage solutions Work with tools such as Apache Airflow, Spark (basics), and data warehouses Implement data quality, validation, and monitoring practices Collaborate with mentors on real business use cases used ...

Documentation. Your Profile Essential Skills/Knowledge/Experience Strong working and technical knowledge of GCP (GCS Buckets, BigQuery, Dataproc, Pub/Sub), Airflow, Spark, PySpark, Spark SQL, Hive. Good knowledge of Python (Pandas, NumPy, Wiresafe), SQL, Linux CLI, BigQuery. Experience with DBMS, Delta Tables, Oracle, MS Access ...

developed vetting) cleared & willing to undertake DV clearance Essential Skills required for the role: Java Spring Boot AWS Python Spark Hadoop Kafka ElasticSearch OpenShift/Kubernetes NiFi ...

500s, Industry leaders and ambitious start-ups across media, e-commerce, healthcare and more. Requirements Must have strong Python and SQL Solid experience with Spark/Airflow and Kafka Strong experience with large cloud-based systems (AWS) Location: London (3 days per week on-site) Start: ASAP Rate ...

lead embedded data science teams, partnering effectively with senior stakeholders across multiple domains Hands-on technical expertise with tools such as Databricks, Python, Spark, and GCP/BigQuery Engineering mindset, with experience moving teams toward machine learning engineering best practices Credibility to lead long-tenured individual contributors while providing ...

team engineering organisations Strong background in distributed systems, large-scale data pipelines and ML model deployment Deep understanding of modern data stacks such as Spark, Databricks or cloud-native architectures Solid understanding of modern frontend engineering, DevOps knowledge and experience delivering machine learning systems Strong communication, organisation and stakeholder ...

team engineering organisations Strong background in distributed systems, large-scale data pipelines and ML model deployment Deep understanding of modern data stacks such as Spark, Databricks or cloud-native architectures Solid understanding of modern frontend engineering, DevOps knowledge and experience delivering machine learning systems Strong communication, organisation and stakeholder ...

team engineering organisations Strong background in distributed systems, large-scale data pipelines and ML model deployment Deep understanding of modern data stacks such as Spark, Databricks or cloud-native architectures Solid understanding of modern frontend engineering, DevOps knowledge and experience delivering machine learning systems Strong communication, organisation and stakeholder ...

team engineering organisations Strong background in distributed systems, large-scale data pipelines and ML model deployment Deep understanding of modern data stacks such as Spark, Databricks or cloud-native architectures Solid understanding of modern frontend engineering, DevOps knowledge and experience delivering machine learning systems Strong communication, organisation and stakeholder ...

team engineering organisations Strong background in distributed systems, large-scale data pipelines and ML model deployment Deep understanding of modern data stacks such as Spark, Databricks or cloud-native architectures Solid understanding of modern frontend engineering, DevOps knowledge and experience delivering machine learning systems Strong communication, organisation and stakeholder ...

ensure A-Level grades are included on your CV) Basic scripting knowledge in Python or Bash Excellent customer-facing skills You have a sales spark - while this role isn't a focused sales role, this is required due to the nature of the role A motivated self-starter with ...

practices like TDD, CI/CD, IaC and Observability. Skills: TypeScript/Node.js Backend APIs AWS or GCP Streaming systems experience (Flink, Kafka, Kinesis, Spark etc.) In return, you'll be given real ownership in an early-stage start-up environment where you can shape direction and genuinely make ...

Level grades are included on your CV). Basic scripting knowledge in Python or Bash Excellent customer-facing skills You have a sales spark - while this role isn't a focussed sales role, this is required due to the nature of the role A motivated self-starter with ...

solutions, with a focus on innovation, resilience, and regulatory compliance. Key Responsibilities: Lead and develop robust data engineering platforms leveraging technologies such as Hadoop, Spark, and Splunk. Design, implement, and maintain scalable ETL/ELT data pipelines for diverse data types, including raw, structured, semi-structured, and unstructured data … groups and vendor interactions to influence and adopt emerging technologies and standards. Qualifications and Skills: Extensive experience with big data frameworks such as Hadoop, Spark, and Splunk. Strong scripting capabilities in Python, with experience in object-oriented and functional programming paradigms. Proven expertise in handling varied data formats ...

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major ...

with Databricks Experience. Job Description:- Design, develop, and maintain scalable microservices using Java and Spring Boot. Build and optimize Real Time data pipelines leveraging Apache Kafka, Flink, and Spark/Databricks. Develop robust data distribution and streaming solutions for high-throughput systems. Deploy, manage, and monitor services … Kafka and distributed streaming systems. Solid understanding of SQL and data modelling. Experience with containerization (Docker) and orchestration (Kubernetes). Working knowledge of Flink, Spark, or Databricks for data processing. Familiarity with AWS services (ECS, EKS, S3, Lambda, etc.). Basic Scripting in Python for automation or data manipulation. ...

Months About the Role: Design, develop, and maintain scalable microservices using Java and Spring Boot. Build and optimize real-time data pipelines leveraging Apache Kafka, Flink, and Spark/Databricks. Develop robust data distribution and streaming solutions for high-throughput systems. Deploy, manage, and monitor services in containerized … Kafka and distributed streaming systems. Solid understanding of SQL and data modeling. Experience with containerization (Docker) and orchestration (Kubernetes). Working knowledge of Flink, Spark, or Databricks for data processing. Familiarity with AWS services (ECS, EKS, S3, Lambda, etc.). Basic scripting in Python for automation or data manipulation. ...

Description:- About the Role: Design, develop, and maintain scalable microservices using Java and Spring Boot. Build and optimize real-time data pipelines leveraging Apache Kafka, Flink, and Spark/Databricks. Develop robust data distribution and streaming solutions for high-throughput systems. Deploy, manage, and monitor services in containerized … Kafka and distributed streaming systems. Solid understanding of SQL and data modeling. Experience with containerization (Docker) and orchestration (Kubernetes). Working knowledge of Flink, Spark, or Databricks for data processing. Familiarity with AWS services (ECS, EKS, S3, Lambda, etc.). Basic scripting in Python for automation or data manipulation. ...

data/version management, model registry, canary/blue-green rollouts, and rollback plans. Data engineering: Build reliable data pipelines (batch/stream) using Spark/Airflow/Beam; ensure data quality, lineage, and governance. Technical leadership: Lead design reviews, mentor engineers, enforce coding standards, documentation, and SRE best … guardrails, prompt/context engineering, multimodal workflows, and observability. Experience with MLOps/model serving (e.g., MLflow, SageMaker, Vertex AI) and data pipelines (e.g., Spark, Airflow, Beam). Security-first mindset and familiarity with compliance (PII handling, RBAC/IAM,key management). Nice-to-Have Experience with function ...