26 to 50 of 289 PySpark Jobs in London

machine learning, with a strong portfolio of relevant projects. Proficiency in Python with libraries like TensorFlow, PyTorch, or Scikit-learn for ML, and Pandas, PySpark, or similar for data processing. Experience designing and orchestrating data pipelines with tools like Apache Airflow, Spark, or Kafka. Strong understanding of SQL, NoSQL More ❯

5+ years in a Data Engineering position. Strong experience with building data pipelines in the cloud (AWS, Azure or GCP). Excellent knowledge of PySpark, Python and SQL fundamentals. Familiar with Airflow, Databricks and/or BigQuery. Ability to work on messy, complex real-world data challenges. Comfortable working More ❯

and external (eBay APIs) sources Define data quality rules, set up monitoring/logging, and support architecture decisions What You Bring Strong SQL & Python (PySpark); hands-on with GCP or AWS Experience with modern ETL tools (dbt, Airflow, Fivetran) BI experience (Looker, Power BI, Metabase); Git and basic CI More ❯

and architecture Maintain comprehensive technical documentation for data systems, processes, and tools What we're looking for Strong proficiency in SQL/Python/Pyspark and/or other languages relevant to data processing Experience with Infrastructure as code e.g Terraform, for managing cloud infrastructure Experience designing, implementing, and More ❯

and architecture Maintain comprehensive technical documentation for data systems, processes, and tools What we’re looking for Strong proficiency in SQL/Python/Pyspark and/or other languages relevant to data processing Experience with Infrastructure as code e.g Terraform, for managing cloud infrastructure Experience designing, implementing, and More ❯

and architecture Maintain comprehensive technical documentation for data systems, processes, and tools What we're looking for Strong proficiency in SQL/Python/Pyspark and/or other languages relevant to da processing Experience with Infrastructure as code e.g Terraform, for managing cloud infrastructure Experience designing, implementing, and More ❯

and architecture • Maintain comprehensive technical documentation for data systems, processes, and tools What we're looking for • Strong proficiency in SQL/Python/Pyspark and/or other languages relevant to da processing • Experience with Infrastructure as code e.g Terraform, for managing cloud infrastructure • Experience designing, implementing, and More ❯

System Integration, Application Development or Data-Warehouse projects, across technologies used in the enterprise space. Software development experience using: Object-oriented languages (e.g., Python, PySpark,) and frameworks Stakeholder Management Expertise in relational and dimensional modelling, including big data technologies. Exposure across all the SDLC process, including testing and deployment. More ❯

System Integration, Application Development or Data-Warehouse projects, across technologies used in the enterprise space. Software development experience using: Object-oriented languages (e.g., Python, PySpark,) and frameworks Stakeholder Management Expertise in relational and dimensional modelling, including big data technologies. Exposure across all the SDLC process, including testing and deployment. More ❯

System Integration, Application Development or Data-Warehouse projects, across technologies used in the enterprise space. Software development experience using: Object-oriented languages (e.g., Python, PySpark,) and frameworks Stakeholder Management Expertise in relational and dimensional modelling, including big data technologies. Exposure across all the SDLC process, including testing and deployment. More ❯

System Integration, Application Development or Data-Warehouse projects, across technologies used in the enterprise space. Software development experience using: Object-oriented languages (e.g., Python, PySpark,) and frameworks Stakeholder Management Expertise in relational and dimensional modelling, including big data technologies. Exposure across all the SDLC process, including testing and deployment. More ❯

System Integration, Application Development or Data-Warehouse projects, across technologies used in the enterprise space. Software development experience using: Object-oriented languages (e.g., Python, PySpark,) and frameworks Stakeholder Management Expertise in relational and dimensional modelling, including big data technologies. Exposure across all the SDLC process, including testing and deployment. More ❯

structure and process improvement. What we value These skills will help you succeed in this role Strong skill-set, experience in Python, Scala/PySpark, PL/SQL, PERL/scripting . Skilled Data Engineer for Cloud Data Lake activities. The candidate should have industry experience (preferably in Financial More ❯

System Integration, Application Development or Data-Warehouse projects, across technologies used in the enterprise space. Software development experience using: Object-oriented languages (e.g., Python, PySpark,) and frameworks Stakeholder Management Expertise in relational and dimensional modelling, including big data technologies. Exposure across all the SDLC process, including testing and deployment. More ❯

ETL/ELT processes. Advanced knowledge of Azure Data Factory V2, Azure Databricks, Azure Data Lake Gen2, and Azure Event Hubs. Proficiency in SQL, PySpark, and Python for data transformation and scripting. Hands-on experience with DevOps practices and managing CI/CD pipelines. Expertise in big data technologies More ❯

/CD tools Key Technologies: Azure Databricks, Data Factory, Storage, Key Vault Source control experience (e.g., Git) Proficiency in SQL (Spark SQL) and Python (PySpark) Certifications: Microsoft Certified: Azure Fundamentals (AZ-900), Azure Data Fundamentals (DP-900) Curiosity about technology and adaptability Agile mindset, optimism, passion, pragmatism Willingness to More ❯

machine learning, with a strong portfolio of relevant projects. Proficiency in Python with libraries like TensorFlow, PyTorch, or Scikit-learn for ML, and Pandas, PySpark, or similar for data processing. Experience designing and orchestrating data pipelines with tools like Apache Airflow, Spark, or Kafka. Strong understanding of SQL, NoSQL More ❯

machine learning, with a strong portfolio of relevant projects. Proficiency in Python with libraries like TensorFlow, PyTorch, or Scikit-learn for ML, and Pandas, PySpark, or similar for data processing. Experience designing and orchestrating data pipelines with tools like Apache Airflow, Spark, or Kafka. Strong understanding of SQL, NoSQL More ❯

db, Cassandra) Knowledge of node based architecture, graph databases and languages – Neptune, Neo4j, Gremlin, Cypher Experience 5+ years of experience with Databricks, Spark, Scala,PySpark, Python 5+ years of experience in SQL and database technologies like Snowflake or equivalent. 3+ year of experience with data and ETL programming (Ab More ❯

the engineering community. We are looking for an experienced Data Engineer confident in investigating, ingesting, and exploiting large datasets with core skills in Python, Pyspark, EMR, AWS, SQL, CI/CD. At Sainsburys Tech, within the Media Agency, we’re unlocking petabytes of untapped potential. We have thousands of More ❯

DevOps and Infrastructure-as-Code (ideally using Terraform) Take ownership of system observability, stability, and documentation Requirements Strong experience in Python (especially Pandas and PySpark) and SQL Proven expertise in building data pipelines and working with Databricks and Lakehouse environments Deep understanding of Azure (or similar cloud platforms), including More ❯

years of experience. Strong background in System Integration, Application Development, or Data-Warehouse projects across enterprise technologies. Experience with Object-oriented languages (e.g., Python, PySpark) and frameworks. Expertise in relational and dimensional modeling, including big data technologies. Proficiency in Microsoft Azure components like Azure Data Factory, Data Lake, SQL More ❯

and external (eBay APIs) sources Define data quality rules, set up monitoring/logging, and support architecture decisions What You Bring Strong SQL & Python (PySpark); hands-on with GCP or AWS Experience with modern ETL tools (dbt, Airflow, Fivetran) BI experience (Looker, Power BI, Metabase); Git and basic CI More ❯

and external (eBay APIs) sources Define data quality rules, set up monitoring/logging, and support architecture decisions What You Bring Strong SQL & Python (PySpark); hands-on with GCP or AWS Experience with modern ETL tools (dbt, Airflow, Fivetran) BI experience (Looker, Power BI, Metabase); Git and basic CI More ❯

DevOps and Infrastructure-as-Code (ideally using Terraform) Take ownership of system observability, stability, and documentation Requirements Strong experience in Python (especially Pandas and PySpark) and SQL Proven expertise in building data pipelines and working with Databricks and Lakehouse environments Deep understanding of Azure (or similar cloud platforms), including More ❯