1 to 25 of 68 Permanent PySpark Jobs in Central London

salary, equity, and benefits. Join a supportive, high-calibre engineering team committed to quality and innovation. 📍 Location: Paddington, London 💻 Tech Stack: Python, SQL, dbt, Databricks, Azure, GCP, Airflow, Terraform, PySpark More ❯

salary, equity, and benefits. Join a supportive, high-calibre engineering team committed to quality and innovation. 📍 Location: Paddington, London 💻 Tech Stack: Python, SQL, dbt, Databricks, Azure, GCP, Airflow, Terraform, PySpark More ❯

schema, snowflake schema). Version Control Practical experience with Git (branching, merging, pull requests). Preferred Qualifications (A Plus) Experience with a distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow More ❯

schema, snowflake schema). Version Control Practical experience with Git (branching, merging, pull requests). Preferred Qualifications (A Plus) Experience with a distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow More ❯

CPG, Consumer Products, Retail, Telecom or Financial Services industries. Applied knowledge of supply chain and associated data, e.g. procurement, manufacturing, logistics Good experience in working with data (Python/PySpark/Databricks) in a cloud-based data systems environment (ideally Azure). Experience in developing using agile software development methodologies, principles such as DevOps, CI/CD, and unit More ❯

CPG, Consumer Products, Retail, Telecom or Financial Services industries. Applied knowledge of supply chain and associated data, e.g. procurement, manufacturing, logistics Good experience in working with data (Python/PySpark/Databricks) in a cloud-based data systems environment (ideally Azure). Experience in developing using agile software development methodologies, principles such as DevOps, CI/CD, and unit More ❯

are an experienced Data Engineer within financial services environments You have expertise with GCP including BigQuery, Pub/Sub, Cloud Composer and IAM You have strong Python, SQL and PySpark skills You have experience with real-time data streaming using Kafka or Spark You have a good knowledge of Data Lakes, Data Warehousing, Data Modelling You're familiar with More ❯

we’re looking for 4+ years’ experience in Azure data engineering. Strong skills with Azure Data Factory, Azure Data Fabric, Azure Synapse Analytics, Azure SQL Database. Proficiency in Python, PySpark, SQL, or Scala. Data modelling and relational database expertise. Azure certifications highly desirable. Power BI experience a bonus (but not essential). Why join? Join a forward-thinking organisation More ❯

we’re looking for 4+ years’ experience in Azure data engineering. Strong skills with Azure Data Factory, Azure Data Fabric, Azure Synapse Analytics, Azure SQL Database. Proficiency in Python, PySpark, SQL, or Scala. Data modelling and relational database expertise. Azure certifications highly desirable. Power BI experience a bonus (but not essential). Why join? Join a forward-thinking organisation More ❯

junior engineers and contribute to engineering best practices Required Skills & Experience: 5+ years of experience building and maintaining data pipelines in production environments Strong Python and SQL skills (Pandas, PySpark, query optimisation) Cloud experience (AWS preferred) including S3, Redshift, Glue, Lambda Familiarity with data warehousing (Redshift, Snowflake, BigQuery) Experience with workflow orchestration tools (Airflow, Dagster, Prefect) Understanding of distributed More ❯

junior engineers and contribute to engineering best practices Required Skills & Experience: 5+ years of experience building and maintaining data pipelines in production environments Strong Python and SQL skills (Pandas, PySpark, query optimisation) Cloud experience (AWS preferred) including S3, Redshift, Glue, Lambda Familiarity with data warehousing (Redshift, Snowflake, BigQuery) Experience with workflow orchestration tools (Airflow, Dagster, Prefect) Understanding of distributed More ❯

and machine learning use cases. Support the migration of legacy reporting tools into Databricks and modern BI solutions. Key Skills & Experience Essential: Strong hands-on experience with Databricks (SQL, PySpark, Delta Lake). Solid knowledge of BI and data visualisation tools (e.g., Power BI, Tableau, Qlik). Strong SQL and data modelling skills. Experience working with large, complex financial More ❯

and machine learning use cases. Support the migration of legacy reporting tools into Databricks and modern BI solutions. Key Skills & Experience Essential: Strong hands-on experience with Databricks (SQL, PySpark, Delta Lake). Solid knowledge of BI and data visualisation tools (e.g., Power BI, Tableau, Qlik). Strong SQL and data modelling skills. Experience working with large, complex financial More ❯

and deliver end-to-end analytics and ML/AI capabilities. This is a long-term contract role. The following skills/experience is essential: Strong expertise in Python, PySpark, and SQL Extensive hands-on experience with Databricks Familiarity with Data Science and Machine Learning frameworks Previously worked in Financial Services Trading environment Background in DevOps and Infrastructure as More ❯

and deliver end-to-end analytics and ML/AI capabilities. This is a long-term contract role. The following skills/experience is essential: Strong expertise in Python, PySpark, and SQL Extensive hands-on experience with Databricks Familiarity with Data Science and Machine Learning frameworks Previously worked in Financial Services Trading environment Background in DevOps and Infrastructure as More ❯

having delivered in Microsoft Azure Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication skills, effectively participating with Senior Stakeholders Nice to haves: Azure Data Engineering certifications Databricks certifications What's in it for you: 📍Location: London (Hybrid) 💻Remote working: Occasional More ❯

assurance, modeling, and delivery to downstream systems. Essential Technical Requirements 5+ years proven experience in a Data Engineering role, building production-ready pipelines. Deep hands-on expertise with Databricks (PySpark/SparkSQL) environments (2+ years desirable). Expert proficiency in Python and SQL development. Experience using Databricks. Experience with cloud-based data platforms (Azure, AWS, or GCP). Prior More ❯

assurance, modeling, and delivery to downstream systems. Essential Technical Requirements 5+ years proven experience in a Data Engineering role, building production-ready pipelines. Deep hands-on expertise with Databricks (PySpark/SparkSQL) environments (2+ years desirable). Expert proficiency in Python and SQL development. Experience using Databricks. Experience with cloud-based data platforms (Azure, AWS, or GCP). Prior More ❯

assurance, modeling, and delivery to downstream systems. Essential Technical Requirements 5+ years proven experience in a Data Engineering role, building production-ready pipelines. Deep hands-on expertise with Databricks (PySpark/SparkSQL) environments (2+ years desirable). Expert proficiency in Python and SQL development. Experience using Databricks. Experience with cloud-based data platforms (Azure, AWS, or GCP). Prior More ❯

improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). Hands-on experience with cloud data platforms (GCP, AWS, or Azure), orchestration frameworks (e.g., Airflow), and ELT/ETL tools. Familiarity with 2D and 3D data formats (e.g. More ❯

improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). Hands-on experience with cloud data platforms (GCP, AWS, or Azure), orchestration frameworks (e.g., Airflow), and ELT/ETL tools. Familiarity with 2D and 3D data formats (e.g. More ❯

data-driven culture all within a collaborative environment that values innovation and ownership. Tech you’ll be working with: Azure Data Lake Azure Synapse Databricks Data Factory Python, SQL, PySpark Terraform, GitHub Actions, CI/CD pipelines You’ll thrive here if you: Have strong experience building and leading Azure-based data platforms Enjoy mentoring and guiding other engineers More ❯

data-driven culture all within a collaborative environment that values innovation and ownership. Tech you’ll be working with: Azure Data Lake Azure Synapse Databricks Data Factory Python, SQL, PySpark Terraform, GitHub Actions, CI/CD pipelines You’ll thrive here if you: Have strong experience building and leading Azure-based data platforms Enjoy mentoring and guiding other engineers More ❯

Google Cloud Platform (GCP) Strong experience designing and delivering data solutions using BigQuery Proficient in SQL and Python Experience working with Big Data technologies such as Apache Spark or PySpark Excellent communication skills, with the ability to engage effectively with senior stakeholders Nice to haves: GCP Data Engineering certifications BigQuery or other GCP tool certifications What’s in it More ❯

Google Cloud Platform (GCP) Strong experience designing and delivering data solutions using BigQuery Proficient in SQL and Python Experience working with Big Data technologies such as Apache Spark or PySpark Excellent communication skills, with the ability to engage effectively with senior stakeholders Nice to haves: GCP Data Engineering certifications BigQuery or other GCP tool certifications What’s in it More ❯