9 of 9 Permanent Apache Spark Jobs in West London

Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands ...

Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands ...

continuous learning to understand new data management systems Strong proficiency in hands-on development using industry-standard tools and languages (e.g., SQL, Python, Spark, cloud platforms), with a commitment to code quality and delivery excellence Preferred qualifications, capabilities, and skills Hands-on experience with Databricks for scalable data engineering … analytics, and collaborative development, as well as proficiency in managing large datasets using Apache Iceberg for efficient, reliable table management and data lake optimization Experience architecting and implementing enterprise-scale data warehouses on cloud platforms (e.g., AWS, Azure, GCP), including migration from legacy systems Advanced proficiency in designing ...

Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Reporting ...

Azure) Experience with: o Data warehousing and lake architectures o ETL/ELT pipeline development o SQL and NoSQL databases o Distributed computing frameworks (Spark, Kinesis etc) o Software development best practices including CI/CD, TDD and version control. o Containerisation tools like Docker or Kubernetes o Experience ...

world datasets e.g. Python, R, KNIME, Splunk, Geo data.Desirable:Industry recognised qualification/accreditation in relevant field.Experience of using big data ecosystems e.g. Hadoop, Spark and/or MapReduce.Experience of working in NATO or similar multi-national defence/security sector. Why work with us By joining our organization ...

tools e.g. Microsoft Power BI, Spotfire, TableauExperience of briefing and communication analytical products to non-technical staffExperience of using big data ecosystems e.g. Hadoop, Spark and/or MapReduce.Experience of working in NATO or similar multi-national defence/security sector. Why work with us By joining our organization ...

Python and MLflow Strong AWS/cloud-native experience ( ideally with SageMaker exposure) React frontend proficiency Docker, Kafka, and large-scale data systems (e.g. Spark) experience Strong leadership presence and senior stakeholder communication skills If you have the technical expertise, leadership experience and ambition to make an impact ...

startup, or equivalent experience navigating fast-paced startup lifecycles. Strong understanding of modern data warehouse architectures, real-time analytics, and data governance (e.g., BigQuery, Spark, Kafka). Deep technical expertise in Generative AI development (e.g., prompt engineering, model tuning, vector databases like Vertex AI Vector Search, and AI frameworks ...