51 to 75 of 141 Apache Spark Jobs in London

outcomes Your Profile Experience: From 1 year in data science or analytics to Principal-level leadership Proficiency in Python, R, SQL , and familiarity with Spark, TensorFlow, PyTorch Strong knowledge of machine learning, statistical modeling, and data engineering principles Experience with cloud platforms (AWS, Azure, GCP) Excellent communication and client ...

data quality. Strong proficiency in one the programming languages, such as Python, Java, Scala, C++, etc. Experience with distributed computing frameworks such as Ray, Spark, and MapReduce. Attention to detail and a strong commitment to data integrity. Excellent problem-solving skills and ability to work in a fast-paced ...

data quality. Strong proficiency in one the programming languages, such as Python, Java, Scala, C++, etc. Experience with distributed computing frameworks such as Ray, Spark, and MapReduce. Attention to detail and a strong commitment to data integrity. Excellent problem-solving skills and ability to work in a fast-paced ...

like AWS, Azure, or Google Cloud. Data Modeling: Knowledge of data modeling principles and techniques. Big Data: Experience with big data technologies like Hadoop, Spark, etc. Data Governance: Understanding of data governance principles and practices. Data Security: Knowledge of data security principles and best practices. Project Management: Experience ...

like AWS, Azure, or Google Cloud. Data Modeling: Knowledge of data modeling principles and techniques. Big Data: Experience with big data technologies like Hadoop, Spark, etc. Data Governance: Understanding of data governance principles and practices. Data Security: Knowledge of data security principles and best practices. Project Management: Experience ...

performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout … data lifecycle. Azure Databricks Implementation: Work extensively with Azure Databricks Unity Catalog, including Delta Lake, Spark SQL, and other relevant services. Implement best practices for Databricks development and deployment. Optimise Databricks workloads for performance and cost. Need to program using the languages such as SQL, Python, R, YAML ...

performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout … data lifecycle. Azure Databricks Implementation: Work extensively with Azure Databricks Unity Catalog, including Delta Lake, Spark SQL, and other relevant services. Implement best practices for Databricks development and deployment. Optimise Databricks workloads for performance and cost. Need to program using the languages such as SQL, Python, R, YAML ...

year in a data-related role to Principal-level expertise Background in Analytics, Engineering, Data Science, or Consulting Skilled in tools like Python, SQL, Spark, Power BI , and cloud platforms ( AWS, Azure, GCP ) Strong problem-solving and communication skills Comfortable in client-facing environments Active SC or DV Clearance ...

year in a data-related role to Principal-level expertise Background in Analytics, Engineering, Data Science, or Consulting Skilled in tools like Python, SQL, Spark, Power BI , and cloud platforms ( AWS, Azure, GCP ) Strong problem-solving and communication skills Comfortable in client-facing environments Active SC or DV Clearance ...

MLOps: experiment tracking (eg, MLflow), model registry, CI/CD for ML. Serving and orchestration: AWS SageMaker, EKS, batch & Real Time inference. Data pipelines: Spark/SQL, orchestration (Airflow), monitoring for drift/perf. Nice to Have Cost/performance optimisation on AWS; GPU scheduling; quantisation/distillation. Experience ...

MLOps: experiment tracking (e.g., MLflow), model registry, CI/CD for ML. Serving and orchestration: AWS SageMaker, EKS, batch & real-time inference. Data pipelines: Spark/SQL, orchestration (Airflow), monitoring for drift/perf. Nice to Have Cost/performance optimisation on AWS; GPU scheduling; quantisation/distillation. Experience ...

asynchronous collaboration, and diverse tech stacks across multiple sectors. Tech stack highlights: AWS services: EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB Languages: Java, Python, Scala, Spark, SQL Big data architecture and ETL pipelines What we’re looking for: Strong problem-solving and analytical skills Experience designing and deploying production data ...

asynchronous collaboration, and diverse tech stacks across multiple sectors. Tech stack highlights: AWS services: EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB Languages: Java, Python, Scala, Spark, SQL Big data architecture and ETL pipelines What we’re looking for: Strong problem-solving and analytical skills Experience designing and deploying production data ...

maintain secure data access controls, including RBAC, token policies, and anonymisation mechanisms Support batch and real-time data flows using tools like Airflow, Kafka, Spark, and Terraform Monitor cloud platform performance and implement cost-control measures while improving reliability Collaborate with product, engineering, and governance teams to define standards ...

maintain secure data access controls, including RBAC, token policies, and anonymisation mechanisms Support batch and real-time data flows using tools like Airflow, Kafka, Spark, and Terraform Monitor cloud platform performance and implement cost-control measures while improving reliability Collaborate with product, engineering, and governance teams to define standards ...

Messaging Technologies with a good understanding of Kubernetes, Dockers and preferably some exposure to GCP (Google Cloud Platform), ReactJS, Python, Big Data Technologies like Spark, Beam Excellent personal organisation, completer/finisher, consensus builder with excellent communication skills and able to lead global development teams both directly ...

private/on-prem AI platforms (e.g. NVIDIA-based stacks, private AI platforms). • Solid understanding of data engineering concepts (ETL, data lakes, Spark or similar). • Experience designing scalable, distributed systems. • Familiarity with model lifecycle management and MLOps practices. • Proven ability to align AI initiatives to business outcomes ...

private/on-prem AI platforms (e.g. NVIDIA-based stacks, private AI platforms). Solid understanding of data engineering concepts (ETL, data lakes, Spark or similar). Experience designing scalable, distributed systems. Familiarity with model lifecycle management and MLOps practices. Proven ability to align AI initiatives to business outcomes ...

Russell — and we want you to shape it with us. Your role will involve: • Designing and developing scalable, testable data pipelines using Python and Apache Spark • Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3 • Applying modern software engineering practices: version control, CI/… modular design, and automated testing • Contributing to the development of a lakehouse architecture using Apache Iceberg • Collaborating with business teams to translate requirements into data-driven solutions • Building observability into data flows and implementing basic quality checks • Participating in code reviews, pair programming, and architecture discussions • Continuously learning about ...

Russell — and we want you to shape it with us. Your role will involve: • Designing and developing scalable, testable data pipelines using Python and Apache Spark • Orchestrating data workflows with AWS tools like Glue, EMR Serverless, Lambda, and S3 • Applying modern software engineering practices: version control, CI/… modular design, and automated testing • Contributing to the development of a lakehouse architecture using Apache Iceberg • Collaborating with business teams to translate requirements into data-driven solutions • Building observability into data flows and implementing basic quality checks • Participating in code reviews, pair programming, and architecture discussions • Continuously learning about ...

setting. MSc in Computer Science, Machine Learning, or a related field. Experience building data pipelines (realtime or batch) & data quality using modern toolchain (e.g., Apache Spark, Kafka, Airflow, dbt). Strong foundational knowledge of machine learning and deep learning algorithms, including deep neural networks, supervised/unsupervised learning ...

setting. MSc in Computer Science, Machine Learning, or a related field. Experience building data pipelines (realtime or batch) & data quality using modern toolchain (e.g., Apache Spark, Kafka, Airflow, dbt). Strong foundational knowledge of machine learning and deep learning algorithms, including deep neural networks, supervised/unsupervised learning ...

data extraction, transformation, and pipeline development. Experience with dashboarding and visualization tools (Tableau, Qlik, or similar). Familiarity with big data tools (Snowflake, Databricks, Spark) and ETL processes. Useful experience; Python or R for advanced analytics, automation, or experimentation support. Knowledge of statistical methods and experimentation (A/ ...

data extraction, transformation, and pipeline development. Experience with dashboarding and visualization tools (Tableau, Qlik, or similar). Familiarity with big data tools (Snowflake, Databricks, Spark) and ETL processes. Useful experience; Python or R for advanced analytics, automation, or experimentation support. Knowledge of statistical methods and experimentation (A/ ...

data extraction, transformation, and pipeline development. Experience with dashboarding and visualization tools (Tableau, Qlik, or similar). Familiarity with big data tools (Snowflake, Databricks, Spark) and ETL processes. Useful experience; Python or R for advanced analytics, automation, or experimentation support. Knowledge of statistical methods and experimentation (A/ ...