Permanent PySpark Jobs in London

1 to 25 of 90 Permanent PySpark Jobs in London

Lead Data Engineer

East London, London, United Kingdom
TPXImpact Holdings Plc
with multiple data analytics tools (e.g. Power BI) Deep understanding of data wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts to both More ❯
Employment Type: Permanent
Salary: £65,000
Posted:

Data Engineer

Greater London, England, United Kingdom
Kharon
a software engineer or a data engineer and a strong passion to learn. BS/MS in Computer Science or equivalent experience in related fields. Experience in Python, Pandas, PySpark, and Notebooks. SQL knowledge and experience working with relational databases including schema design, access patterns, query performance optimization, etc. Experience with data pipeline technologies like AWS Glue, Airflow, Kafka More ❯
Posted:

Data Engineer

London, United Kingdom
Betway Group
to adapt quickly to changing environments and priorities, maintaining effectiveness in dynamic situations Proficiency using SQL Server in a highly transactional environment. Experience in either C# or Python/PySpark for data engineering or development tasks. Strong understanding of DevOps principles and experience with relevant tools e.g., Azure DevOps, Git, Terraform for CI/CD, automation, and infrastructure management. More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer

London Area, United Kingdom
Information Tech Consultants
schema, snowflake schema). Version Control Practical experience with Git (branching, merging, pull requests). Preferred Qualifications (A Plus) Experience with a distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow More ❯
Posted:

Data Engineer

City of London, London, United Kingdom
Information Tech Consultants
schema, snowflake schema). Version Control Practical experience with Git (branching, merging, pull requests). Preferred Qualifications (A Plus) Experience with a distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow More ❯
Posted:

Bioinformatics Data engineer

London Area, United Kingdom
Hlx Life Sciences
s in Bioinformatics, Computer Science, Data Engineering, or related field. 4+ years of experience in data engineering or bioinformatics data management. Strong Python and SQL skills; experience with Pandas, PySpark, Dask, or similar frameworks. Familiar with Linux, Docker, and modern data architectures (relational, object, non-relational). Experience with orchestration tools (Airflow/Prefect) and cloud platforms (AWS preferred More ❯
Posted:

Bioinformatics Data engineer

City of London, London, United Kingdom
Hlx Life Sciences
s in Bioinformatics, Computer Science, Data Engineering, or related field. 4+ years of experience in data engineering or bioinformatics data management. Strong Python and SQL skills; experience with Pandas, PySpark, Dask, or similar frameworks. Familiar with Linux, Docker, and modern data architectures (relational, object, non-relational). Experience with orchestration tools (Airflow/Prefect) and cloud platforms (AWS preferred More ❯
Posted:

AWS Data Engineer AVP - Top Investment Bank

City of London, London, United Kingdom
Caspian One
with various businesses and gaining an overview of many different sectors. What We’re Looking For 5 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for More ❯
Posted:

AWS Data Engineer AVP - Top Investment Bank

London Area, United Kingdom
Caspian One
with various businesses and gaining an overview of many different sectors. What We’re Looking For 5 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for More ❯
Posted:

AWS Data Engineer VP - Top Investment Bank

City of London, London, United Kingdom
Caspian One
with various businesses and gaining an overview of many different sectors. What We’re Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for More ❯
Posted:

AWS Data Engineer VP - Top Investment Bank

London Area, United Kingdom
Caspian One
with various businesses and gaining an overview of many different sectors. What We’re Looking For 10 + years, hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Strong experience engineering in a front-office/capital markets environment. Previous experience in implementing best practices for More ❯
Posted:

Sr.Data Engineer

London, United Kingdom
Cognizant
and prompt engineering. Mandatory Skills: Cloud Platforms:Deep experience with AWS (S3, Lambda, Glue, Redshift) and/or Azure (Data Lake, Synapse). Programming & Scripting:Proficiency in Python, SQL, PySpark etc. ETL/ELT & Streaming:Expertise in technologies like Apache Airflow, Glue, Kafka, Informatica, EventBridge etc. Industrial Data Integration:Familiarity with OT data schema originating from OSIsoft PI, SCADA More ❯
Employment Type: Permanent
Posted:

Senior Data Engineer

London Area, United Kingdom
Mars
CPG, Consumer Products, Retail, Telecom or Financial Services industries. Applied knowledge of supply chain and associated data, e.g. procurement, manufacturing, logistics Good experience in working with data (Python/PySpark/Databricks) in a cloud-based data systems environment (ideally Azure). Experience in developing using agile software development methodologies, principles such as DevOps, CI/CD, and unit More ❯
Posted:

Senior Data Engineer

City of London, London, United Kingdom
Mars
CPG, Consumer Products, Retail, Telecom or Financial Services industries. Applied knowledge of supply chain and associated data, e.g. procurement, manufacturing, logistics Good experience in working with data (Python/PySpark/Databricks) in a cloud-based data systems environment (ideally Azure). Experience in developing using agile software development methodologies, principles such as DevOps, CI/CD, and unit More ❯
Posted:

DataBricks Data Engineer DPP

London, England, United Kingdom
Korn Ferry
and client teams on solution design and delivery. Mentor junior engineers and contribute to reusable frameworks and accelerators. Skills & Experience Strong hands-on experience with Databricks , Python , SQL , and PySpark . Solid understanding of Delta Lake , Unity Catalog , and MLflow . Experience with DevOps tools (Git, CI/CD, IaC). Excellent communication and stakeholder skills. Databricks certification and More ❯
Posted:

Azure Data Engineer

London Area, United Kingdom
Hybrid/Remote Options
Recann
we’re looking for 4+ years’ experience in Azure data engineering. Strong skills with Azure Data Factory, Azure Data Fabric, Azure Synapse Analytics, Azure SQL Database. Proficiency in Python, PySpark, SQL, or Scala. Data modelling and relational database expertise. Azure certifications highly desirable. Power BI experience a bonus (but not essential). Why join? Join a forward-thinking organisation More ❯
Posted:

Azure Data Engineer

City of London, London, United Kingdom
Hybrid/Remote Options
Recann
we’re looking for 4+ years’ experience in Azure data engineering. Strong skills with Azure Data Factory, Azure Data Fabric, Azure Synapse Analytics, Azure SQL Database. Proficiency in Python, PySpark, SQL, or Scala. Data modelling and relational database expertise. Azure certifications highly desirable. Power BI experience a bonus (but not essential). Why join? Join a forward-thinking organisation More ❯
Posted:

Senior Data Engineer

London Area, United Kingdom
Xcede
junior engineers and contribute to engineering best practices Required Skills & Experience: 5+ years of experience building and maintaining data pipelines in production environments Strong Python and SQL skills (Pandas, PySpark, query optimisation) Cloud experience (AWS preferred) including S3, Redshift, Glue, Lambda Familiarity with data warehousing (Redshift, Snowflake, BigQuery) Experience with workflow orchestration tools (Airflow, Dagster, Prefect) Understanding of distributed More ❯
Posted:

Senior Data Engineer

City of London, London, United Kingdom
Xcede
junior engineers and contribute to engineering best practices Required Skills & Experience: 5+ years of experience building and maintaining data pipelines in production environments Strong Python and SQL skills (Pandas, PySpark, query optimisation) Cloud experience (AWS preferred) including S3, Redshift, Glue, Lambda Familiarity with data warehousing (Redshift, Snowflake, BigQuery) Experience with workflow orchestration tools (Airflow, Dagster, Prefect) Understanding of distributed More ❯
Posted:

DataBricks Data Engineer - Financial Services

City of London, London, United Kingdom
Miryco Consultants Ltd
and machine learning use cases. Support the migration of legacy reporting tools into Databricks and modern BI solutions. Key Skills & Experience Essential: Strong hands-on experience with Databricks (SQL, PySpark, Delta Lake). Solid knowledge of BI and data visualisation tools (e.g., Power BI, Tableau, Qlik). Strong SQL and data modelling skills. Experience working with large, complex financial More ❯
Posted:

DataBricks Data Engineer - Financial Services

London Area, United Kingdom
Miryco Consultants Ltd
and machine learning use cases. Support the migration of legacy reporting tools into Databricks and modern BI solutions. Key Skills & Experience Essential: Strong hands-on experience with Databricks (SQL, PySpark, Delta Lake). Solid knowledge of BI and data visualisation tools (e.g., Power BI, Tableau, Qlik). Strong SQL and data modelling skills. Experience working with large, complex financial More ❯
Posted:

Senior Data Engineer

London Area, United Kingdom
Hybrid/Remote Options
Primus
reviewing code, and driving best practices Collaborate with data scientists, architects, and business teams to deliver production-grade outcomes Essential skills needed: Deep hands-on experience with Databricks (SQL, PySpark, Delta Lake, Unity Catalog, Workflows) Strong proficiency in Python and Spark Solid understanding of CI/CD pipelines, DevOps, and Infrastructure as Code Proven track record designing and delivering More ❯
Posted:

Senior Data Engineer

City of London, London, United Kingdom
Hybrid/Remote Options
Primus
reviewing code, and driving best practices Collaborate with data scientists, architects, and business teams to deliver production-grade outcomes Essential skills needed: Deep hands-on experience with Databricks (SQL, PySpark, Delta Lake, Unity Catalog, Workflows) Strong proficiency in Python and Spark Solid understanding of CI/CD pipelines, DevOps, and Infrastructure as Code Proven track record designing and delivering More ❯
Posted:

Data Engineer

City of London, London, United Kingdom
Hybrid/Remote Options
Peaple Talent
having delivered in Microsoft Azure Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication skills, effectively participating with Senior Stakeholders Nice to haves: Azure Data Engineering certifications Databricks certifications What's in it for you: 📍Location: London (Hybrid) 💻Remote working: Occasional More ❯
Posted:

Data Engineer

London Area, United Kingdom
Hybrid/Remote Options
Peaple Talent
having delivered in Microsoft Azure Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication skills, effectively participating with Senior Stakeholders Nice to haves: Azure Data Engineering certifications Databricks certifications What's in it for you: 📍Location: London (Hybrid) 💻Remote working: Occasional More ❯
Posted:
PySpark
London
10th Percentile
£59,300
25th Percentile
£63,750
Median
£85,000
75th Percentile
£90,000
90th Percentile
£111,250