276 to 300 of 710 Apache Spark Jobs in the UK

Face Transformers; OpenCV for vision. Experiment tracking and reproducibility tools (e.g., MLflow, Weights & Biases). Data wrangling and analysis (Pandas, NumPy, SQL); familiarity with Spark or similar is a plus. Model optimisation and deployment fundamentals: ONNX, TorchScript, FastAPI/gRPC; GPU acceleration (CUDA basics desirable). Responsible ...

tools (e.g., Matplotlib, Seaborn, Tableau). Ability to work independently and lead projects from inception to deployment. Experience with big data technologies (e.g., Hadoop, Spark) and cloud platforms (e.g., AWS, GCP, Azure) is desirable. Rewards & Benefits TCS is consistently voted a Top Employer in the UK and globally. ...

tools (e.g., Matplotlib, Seaborn, Tableau). Ability to work independently and lead projects from inception to deployment. Experience with big data technologies (e.g., Hadoop, Spark) and cloud platforms (e.g., AWS, GCP, Azure) is desirable. Rewards & Benefits TCS is consistently voted a Top Employer in the UK and globally. ...

high-quality, secure, and scalable data solutions — gaining exposure to multiple cloud platforms (AWS, Azure, OCI, GCP) and technologies such as Palantir Foundry, Databricks, Spark, and Airflow. Other times you will be working directly with the client, using your analytical and data skills to support their decision-making. … environment. Eligible for UK Security Clearance (or 5+ years UK residency. Desirable Skills & Exposure Familiarity with data lakes, warehouses, or streaming architectures (e.g. Databricks, Spark, Kafka). Experience with ETL tools, orchestration frameworks, or automation pipelines. Understanding of version control and CI/CD (e.g. GitHub, Azure DevOps). ...

high-quality, secure, and scalable data solutions — gaining exposure to multiple cloud platforms (AWS, Azure, OCI, GCP) and technologies such as Palantir Foundry, Databricks, Spark, and Airflow. Other times you will be working directly with the client, using your analytical and data skills to support their decision-making. … environment. Eligible for UK Security Clearance (or 5+ years UK residency. Desirable Skills & Exposure Familiarity with data lakes, warehouses, or streaming architectures (e.g. Databricks, Spark, Kafka). Experience with ETL tools, orchestration frameworks, or automation pipelines. Understanding of version control and CI/CD (e.g. GitHub, Azure DevOps). ...

high-quality, secure, and scalable data solutions gaining exposure to multiple cloud platforms (AWS, Azure, OCI, GCP) and technologies such as Palantir Foundry, Databricks, Spark, and Airflow. Other times you will be working directly with the client, using your analytical and data skills to support their decision-making. … Eligible for UK Security Clearance (or 5+ years UK residency . Desirable Skills & Exposure Familiarity with data lakes, warehouses, or streaming architectures (e.g. Databricks, Spark, Kafka). Experience with ETL tools, orchestration frameworks, or automation pipelines. Understanding of version control and CI/CD (e.g. GitHub, Azure DevOps). ...

experience in data engineering and 1+ experience as Lead Data Engineer Proven expertise with Microsoft Azure Strong proficiency in Databricks with hands-on Scala (Spark) and PySpark . Expertise in Databricks for large-scale data engineering and analytics workloads. Design and implement scalable data architectures using Databricks Unity Catalog … Delta Lake, and Apache Spark Implement advanced Delta Lake features including time travel, vacuum operations, and Z-ordering. Desirable: certification in Databricks Data Engineer and/or Azure Data Engineer are a plus. ...

governance, and data architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data governance, data sharing across ...

governance, and data architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data governance, data sharing across ...

governance, and data architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data governance, data sharing across ...

governance, and data architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data governance, data sharing across ...

governance, and data architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data governance, data sharing across ...

governance, and data architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data governance, data sharing across ...

Data Engineer (Hybrid) Bristol – Spark, S3, Redshift, Lambda, EMR, Glue Avanti Recruitment is working with a rapidly growing technology business in Bristol to recruit a talented AWS Data Engineer to join their team. You will help build and evolve their AWS cloud-based data infrastructure. You’ll work with … scalable pipelines and delivering reliable data to teams across the organisation. In this role, you will develop and maintain ETL and ELT workflows using Apache Spark, Python and AWS Glue, while architecting solutions that make extensive use of AWS services including S3, Redshift, EMR, Lambda, Kinesis, DynamoDB ...

organisation Supporting a move towards a product-aligned, hub-based operating model Technology Stack Cloud-first environment with Microsoft Azure Fabric Python, PyTorch SQL Apache Spark Azure Data Factory (ADF) Git What We’re Looking For 3–4 years’ experience in AI/ML engineering, data engineering ...

organisation Supporting a move towards a product-aligned, hub-based operating model Technology Stack Cloud-first environment with Microsoft Azure Fabric Python, PyTorch SQL Apache Spark Azure Data Factory (ADF) Git What We're Looking For 3-4 years' experience in AI/ML engineering, data engineering ...

MLOps: experiment tracking (e.g., MLflow), model registry, CI/CD for ML. Serving and orchestration: AWS SageMaker, EKS, batch & real-time inference. Data pipelines: Spark/SQL, orchestration (Airflow), monitoring for drift/perf. Nice to Have Cost/performance optimisation on AWS; GPU scheduling; quantisation/distillation. Experience ...

asynchronous collaboration, and diverse tech stacks across multiple sectors. Tech stack highlights: AWS services: EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB Languages: Java, Python, Scala, Spark, SQL Big data architecture and ETL pipelines What we’re looking for: Strong problem-solving and analytical skills Experience designing and deploying production data ...

asynchronous collaboration, and diverse tech stacks across multiple sectors. Tech stack highlights: AWS services: EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB Languages: Java, Python, Scala, Spark, SQL Big data architecture and ETL pipelines What we’re looking for: Strong problem-solving and analytical skills Experience designing and deploying production data ...

maintain secure data access controls, including RBAC, token policies, and anonymisation mechanisms Support batch and real-time data flows using tools like Airflow, Kafka, Spark, and Terraform Monitor cloud platform performance and implement cost-control measures while improving reliability Collaborate with product, engineering, and governance teams to define standards ...

maintain secure data access controls, including RBAC, token policies, and anonymisation mechanisms Support batch and real-time data flows using tools like Airflow, Kafka, Spark, and Terraform Monitor cloud platform performance and implement cost-control measures while improving reliability Collaborate with product, engineering, and governance teams to define standards ...

Messaging Technologies with a good understanding of Kubernetes, Dockers and preferably some exposure to GCP (Google Cloud Platform), ReactJS, Python, Big Data Technologies like Spark, Beam Excellent personal organisation, completer/finisher, consensus builder with excellent communication skills and able to lead global development teams both directly ...

private/on-prem AI platforms (e.g. NVIDIA-based stacks, private AI platforms). Solid understanding of data engineering concepts (ETL, data lakes, Spark or similar). Experience designing scalable, distributed systems. Familiarity with model lifecycle management and MLOps practices. Proven ability to align AI initiatives to business outcomes ...

Russell — and we want you to shape it with us. Your role will involve: • Designing and developing scalable, testable data pipelines using Python and Apache Spark • Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3 • Applying modern software engineering practices: version control, CI/… modular design, and automated testing • Contributing to the development of a lakehouse architecture using Apache Iceberg • Collaborating with business teams to translate requirements into data-driven solutions • Building observability into data flows and implementing basic quality checks • Participating in code reviews, pair programming, and architecture discussions • Continuously learning about ...

Russell — and we want you to shape it with us. Your role will involve: • Designing and developing scalable, testable data pipelines using Python and Apache Spark • Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3 • Applying modern software engineering practices: version control, CI/… modular design, and automated testing • Contributing to the development of a lakehouse architecture using Apache Iceberg • Collaborating with business teams to translate requirements into data-driven solutions • Building observability into data flows and implementing basic quality checks • Participating in code reviews, pair programming, and architecture discussions • Continuously learning about ...