76 to 100 of 137 Apache Spark Jobs in the UK excluding London

Building and maintaining data pipelines. Data modelling and warehousing fundamentals. dbt or similar modern transformation frameworks Experience with AWS data services. Exposure to Kafka, Spark, streaming data, or modern BI tools. Interest in AI, analytics engineering, and data products THE BENEFITS You will receive a salary ...

e.g. Python, R, KNIME, Splunk, Geo data. Desirable: Industry recognised qualification/accreditation in relevant field. Experience of using big data ecosystems e.g. Hadoop, Spark and/or MapReduce. Experience of working in NATO or similar multi-national defence/security sector. Why work with us? By joining ...

Jenkins, Bamboo, Concourse etc. Monitoring utilising products such as: Prometheus, Grafana, ELK, filebeat etc. Observability - SRE Big Data solutions (ecosystems) and technologies such as: Apache Spark and the Hadoop Ecosystem Edge technologies e.g. NGINX, HAProxy etc. Excellent knowledge of YAML or similar languages It is essential for this ...

Essential Skills of the Analytical Platform Engineer Python Kubernetes Docker CI/CD pipelines (GitLab or similar) Desirable skills MLOps and data engineering concepts Apache Spark Scala S3-compatible object storage Graph database technologies If you are an driven and experienced Analytical platform engineer looking for their next ...

design artefacts and delivery roadmaps Key Requirements 7+ yearsâ experience in data engineering or data platform development Strong experience with modern cloud data platforms, Spark and distributed data processing Experience with data cataloguing and governance tooling, open table formats (e.g. Delta Lake, Iceberg) and streaming architectures Advanced Python ...

data extraction, transformation, and pipeline development Experience with dashboarding and visualization tools (Tableau, Qlik, or similar) Familiarity with big data tools (Snowflake, Databricks, Spark) and ETL processes Experience with Python or R for advanced analytics, automation, or experimentation support preferred Knowledge of statistical methods and experimentation (A/ ...

data extraction, transformation, and pipeline development Experience with dashboarding and visualization tools (Tableau, Qlik, or similar) Familiarity with big data tools (Snowflake, Databricks, Spark) and ETL processes Experience with Python or R for advanced analytics, automation, or experimentation support preferred Knowledge of statistical methods and experimentation (A/ ...

Candidate Requirements: Extensive experience building and deploying machine learning models in production, with strong hands-on Python capability. Experience with distributed computing frameworks (e.g., Spark or similar) and scalable data processing environments. Exposure to cloud-based platforms (e.g., AWS, Azure, GCP or Databricks) and modern ML/MLOps practices. ...

manipulation and analysis of data. Manage and integrate data across dissimilar data sets. Analyze large-scale structured and unstructured data. Use frameworks such as Spark and Hadoop to conduct large-scale data processing. Perform statistical modeling and create data visualizations using products like Tableau, Microsoft Power ...

Limited (DDIL) communications environments, supporting local processing at the edge Building streaming ingestion, event pipelines, and batch/stream processing workloads using technologies like Apache Flink and/or Apache Spark Implementing metadata, lineage, and catalogue capabilities along with policy-based security and governance Job Requirements: Extensive ...

unstructured workloads at scale - Integrate multiple sources into modern cloud platforms - Collaborate across engineering and delivery on mission-critical programmes **The environment** Python, SQL, Spark, Java or Scala · AWS, Azure or GCP · modern distributed and cloud-native architectures **What we need** - Active DV clearance essential - Production-scale pipeline experience ...

Strong commercial experience in data engineering and modern data platforms. Advanced programming skills in Java or Python. Expertise working with technologies such as Kafka, Spark, Flink or similar distributed data frameworks. Experience delivering solutions within AWS or other major cloud platforms. Strong understanding of data architecture, scalability and performance ...

serving training/inference, focusing on cost efficiency, performance, and resilience. Big data & distributed processing: Develop and tune large-scale batch/stream workloads (Spark or similar); improve job efficiency, stability, and operational readiness in production. Software engineering: Strong Python + SQL; apply CI/CD, automated testing, modular ...

Python. Experience with Kubernetes and Docker. Understanding of CI/CD pipelines (e.g. GitLab). Exposure to data platforms, MLOps or machine learning environments. Spark or Scala. AWS services (e.g. S3). Elasticsearch or graph databases. OIDC/OAuth. Node.js or React. #J-18808-Ljbffr ...

solutions, and lead their implementation. Good written and verbal communication skills. Any Beneficial/Nice to have experience: Experience with Big Data technology (HDFS, Spark, Impala) Understanding of Cloud‐native development principles. Experience with Container Orchestration tools (Docker, Kubernetes, OpenShift, etc.). Proficiency in using Jira for tracking tasks ...

Azure, AWS or GCP * Define lakehouse standards, data modelling approaches and governance frameworks * Lead design of batch and streaming platforms using Delta Lake, Spark and related technologies * Establish security, access control, data quality and compliance standards * Optimise performance, scalability and cloud cost management * Lead and mentor a small team … Required experience * Strong experience as a senior or lead data engineer building and scaling production data platforms * Deep hands on expertise in Databricks including Spark, Delta Lake and Databricks Workflows * Python and SQL proficiency * Infrastructure as code experience using Terraform, Bicep or CloudFormation * Cloud data platform experience, ideally Azure ...

secure and scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with ...

Roku in Manchester is looking for a Senior Data Engineer to join the Viewer Product Device & Themed Experiences team. You will design data models and build scalable pipelines across Roku devices, apps, and web/ ...

ensure requirements are understood before design and development. The role focuses on data warehouse and large‐scale data processing using Big Data technologies (Hadoop, Spark), with programming in Scala and Python. You will guide developers, implement best practices, and drive automated testing and CI/CD to production. #J ...

stakeholders. Architecture design informed through the use of principles, patterns, technical radars, practices and standards. AWS Solution expertise and relevant certification - EMR/Spark (Hadoop)/AWS/Data Modelling-Mapping/GitHub/GitLab Technologies Azure AWS Power BI #J-18808-Ljbffr ...

depth actually gets used. AWS across the board, including S3, Glue, Redshift, Lake Formation and Kinesis Databricks and Snowflake running on top of AWS Spark and distributed processing frameworks for large-scale data Streaming technologies such as Kinesis or Kafka You're expected to pick the right tools ...

looking for a mixture of the following skills: Python Kubernetes Docker CI/CD basics (Gitlab pipelines) Data science and MLOps knowledge (highly desirable) Spark (highly desirable) Scala (highly desirable) S3 (highly desirable) Graph databases (highly desirable) Elasticsearch (highly desirable) Vector stores (highly desirable) OIDC/OAuth (highly desirable ...

secure and scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with ...

environmentFocus on delivering secure and scalable solutionsPreferred qualifications, capabilities, and skillsExperience with modern data platforms such as Databricks or SnowflakeDeep hands-on experience with Spark/PySpark and other big data processing technologiesExpertise in open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration ...

secure and scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with ...