301 to 325 of 721 Apache Spark Jobs in the UK

understanding of observability tools like Prometheus/Grafana/CloudWatch. Good hands-on experience with Scala/Python/SQL, IaC(Terraform), Glue/Spark, Lambda, CI/CD (Jenkins/Gitlab) Nice to have skills: - QuickSight/Tableau; Redshift tuning; ksqlDB/Flink; Aurora Postgres. - Edge/ ...

skills for data extraction, transformation, and pipeline development. Proficiency in Tableau, Qlik, or similar visualization tools. Experience with big data tools (Snowflake, Databricks, Spark) and ETL processes. Exposure to Python or R for automation, experimentation, or analytics. Excellent communication and storytelling skills with both technical and non-technical audiences. ...

skills for data extraction, transformation, and pipeline development. Proficiency in Tableau, Qlik, or similar visualization tools. Experience with big data tools (Snowflake, Databricks, Spark) and ETL processes. Exposure to Python or R for automation, experimentation, or analytics. Excellent communication and storytelling skills with both technical and non-technical audiences. ...

such as throughput, lag, success rate, and cost efficiency. Hands-on Engineering Develop/review code in Python, Scala, SQL . Build pipelines using Spark, AWS Glue, Lambda, Step Functions . Implement Terraform and CI/CD using GitLab/Jenkins . 🔹 Must-Have Skills & Experience Total experience: 12+ ...

such as throughput, lag, success rate, and cost efficiency. Hands-on Engineering Develop/review code in Python, Scala, SQL . Build pipelines using Spark, AWS Glue, Lambda, Step Functions . Implement Terraform and CI/CD using GitLab/Jenkins . 🔹 Must-Have Skills & Experience Total experience: 12+ ...

travel occasionally for client meetings (approx. 2 short trips per quarter). Desirable Experience with B2B products and enterprise-scale data solutions. Knowledge of Spark SQL, PySpark, and related ML libraries. Exposure to distributed data platforms (e.g., Hive, Databricks) and cloud services (AWS preferred). Understanding of advanced ...

travel occasionally for client meetings (approx. 2 short trips per quarter). Desirable Experience with B2B products and enterprise-scale data solutions. Knowledge of Spark SQL, PySpark, and related ML libraries. Exposure to distributed data platforms (e.g., Hive, Databricks) and cloud services (AWS preferred). Understanding of advanced ...

travel occasionally for client meetings (approx. 2 short trips per quarter). Desirable Experience with B2B products and enterprise-scale data solutions. Knowledge of Spark SQL, PySpark, and related ML libraries. Exposure to distributed data platforms (e.g., Hive, Databricks) and cloud services (AWS preferred). Understanding of advanced ...

Feature Store Containerisation and orchestration using Docker, Kubernetes or ECS Infrastructure as Code using Terraform or CloudFormation Large-scale data processing frameworks such as Spark or Dask Knowledge of data governance, compliance and regulated environments Experience delivering solutions within highly regulated industries such as government, finance or healthcare Security ...

containerised workloads (Docker, Kubernetes, Kubeflow, etc.) and integrating with CI/CD tools (Jenkins, GitHub Actions, GitLab CI). Familiarity with distributed computing frameworks (Spark, Ray, TensorFlow Distributed, PyTorch Distributed). Strong understanding of monitoring, logging, and observability for large-scale ML systems. Experience in cost optimisation for compute ...

containerised workloads (Docker, Kubernetes, Kubeflow, etc.) and integrating with CI/CD tools (Jenkins, GitHub Actions, GitLab CI). Familiarity with distributed computing frameworks (Spark, Ray, TensorFlow Distributed, PyTorch Distributed). Strong understanding of monitoring, logging, and observability for large-scale ML systems. Experience in cost optimisation for compute ...

containerised workloads (Docker, Kubernetes, Kubeflow, etc.) and integrating with CI/CD tools (Jenkins, GitHub Actions, GitLab CI). Familiarity with distributed computing frameworks (Spark, Ray, TensorFlow Distributed, PyTorch Distributed). Strong understanding of monitoring, logging, and observability for large-scale ML systems. Experience in cost optimisation for compute ...

containerised workloads (Docker, Kubernetes, Kubeflow, etc.) and integrating with CI/CD tools (Jenkins, GitHub Actions, GitLab CI). Familiarity with distributed computing frameworks (Spark, Ray, TensorFlow Distributed, PyTorch Distributed). Strong understanding of monitoring, logging, and observability for large-scale ML systems. Experience in cost optimisation for compute ...

containerised workloads (Docker, Kubernetes, Kubeflow, etc.) and integrating with CI/CD tools (Jenkins, GitHub Actions, GitLab CI). Familiarity with distributed computing frameworks (Spark, Ray, TensorFlow Distributed, PyTorch Distributed). Strong understanding of monitoring, logging, and observability for large-scale ML systems. Experience in cost optimisation for compute ...

containerised workloads (Docker, Kubernetes, Kubeflow, etc.) and integrating with CI/CD tools (Jenkins, GitHub Actions, GitLab CI). Familiarity with distributed computing frameworks (Spark, Ray, TensorFlow Distributed, PyTorch Distributed). Strong understanding of monitoring, logging, and observability for large-scale ML systems. Experience in cost optimisation for compute ...

containerised workloads (Docker, Kubernetes, Kubeflow, etc.) and integrating with CI/CD tools (Jenkins, GitHub Actions, GitLab CI). Familiarity with distributed computing frameworks (Spark, Ray, TensorFlow Distributed, PyTorch Distributed). Strong understanding of monitoring, logging, and observability for large-scale ML systems. Experience in cost optimisation for compute ...

containerised workloads (Docker, Kubernetes, Kubeflow, etc.) and integrating with CI/CD tools (Jenkins, GitHub Actions, GitLab CI). Familiarity with distributed computing frameworks (Spark, Ray, TensorFlow Distributed, PyTorch Distributed). Strong understanding of monitoring, logging, and observability for large-scale ML systems. Experience in cost optimisation for compute ...

containerised workloads (Docker, Kubernetes, Kubeflow, etc.) and integrating with CI/CD tools (Jenkins, GitHub Actions, GitLab CI). Familiarity with distributed computing frameworks (Spark, Ray, TensorFlow Distributed, PyTorch Distributed). Strong understanding of monitoring, logging, and observability for large-scale ML systems. Experience in cost optimisation for compute ...

containerised workloads (Docker, Kubernetes, Kubeflow, etc.) and integrating with CI/CD tools (Jenkins, GitHub Actions, GitLab CI). Familiarity with distributed computing frameworks (Spark, Ray, TensorFlow Distributed, PyTorch Distributed). Strong understanding of monitoring, logging, and observability for large-scale ML systems. Experience in cost optimisation for compute ...

containerised workloads (Docker, Kubernetes, Kubeflow, etc.) and integrating with CI/CD tools (Jenkins, GitHub Actions, GitLab CI). Familiarity with distributed computing frameworks (Spark, Ray, TensorFlow Distributed, PyTorch Distributed). Strong understanding of monitoring, logging, and observability for large-scale ML systems. Experience in cost optimisation for compute ...

Java & Spark Engineer 12 month contract Hybrid - London (3 days per week in the office) INSIDE IR35 AM Analytics offers a scalable, ML-ready platform for rapid portfolio model development and deployment. It combines data governance, Big Data, and AI—including GenAI capabilities— to boost alpha generation, enhance client … native Databricks. Responsibilities include: migrating and optimizing 500+ jobs using Databricks optimization techniques, managing 12 TB of data, tuning models for Azure with Java Spark and Delta tables, and addressing vulnerabilities through library version updates. Current Tech Stack: Python, Data Science, Gen AI (GPT, Embeddings, Document Intelligence), Java Spark ...

Java & Spark Engineer 12 month contract Hybrid - London (3 days per week in the office) INSIDE IR35 AM Analytics offers a scalable, ML-ready platform for rapid portfolio model development and deployment. It combines data governance, Big Data, and AI—including GenAI capabilities— to boost alpha generation, enhance client … native Databricks. Responsibilities include: migrating and optimizing 500+ jobs using Databricks optimization techniques, managing 12 TB of data, tuning models for Azure with Java Spark and Delta tables, and addressing vulnerabilities through library version updates. Current Tech Stack: Python, Data Science, Gen AI (GPT, Embeddings, Document Intelligence), Java Spark ...

operational processes Required Qualifications 3+ years of experience as a Data Engineer or in a similar role Strong experience with Azure Databricks (PySpark, Spark SQL) Hands-on experience with Azure Synapse Analytics (dedicated and/or serverless pools) Solid understanding of data warehousing concepts and dimensional modeling Proficiency … Experience working in Agile/Scrum environments Preferred Qualifications Azure certifications (e.g., Azure Data Engineer Associate ) Experience with streaming technologies (Event Hubs, Kafka, or Spark Structured Streaming) Knowledge of data governance tools (Purview, Unity Catalog) Experience with Power BI or other BI/analytics tools Exposure to DevOps, Infrastructure ...

operational processes Required Qualifications 3+ years of experience as a Data Engineer or in a similar role Strong experience with Azure Databricks (PySpark, Spark SQL) Hands-on experience with Azure Synapse Analytics (dedicated and/or serverless pools) Solid understanding of data warehousing concepts and dimensional modeling Proficiency … Experience working in Agile/Scrum environments Preferred Qualifications Azure certifications (e.g., Azure Data Engineer Associate ) Experience with streaming technologies (Event Hubs, Kafka, or Spark Structured Streaming) Knowledge of data governance tools (Purview, Unity Catalog) Experience with Power BI or other BI/analytics tools Exposure to DevOps, Infrastructure ...

TensorFlow, PyTorch, or Scikit-learn for ML, and Pandas, PySpark, or similar for data processing. Experience designing and orchestrating data pipelines with tools like Apache Airflow, Spark, or Kafka. Strong understanding of SQL, NoSQL, and data modeling. Familiarity with cloud platforms (AWS, Azure, GCP) for deploying ...