PySpark Jobs in the UK

101 to 125 of 582 PySpark Jobs in the UK

Data Scientist

London, England, United Kingdom
Butterworths Limited Company
patent data. Work with stakeholders across teams to identify key areas for AI-driven innovation and enhancement in data products . Use Python , SQL , PySpark and related technologies to develop scalable solutions, focusing on large-scale data processing. Qualifications: Demonstrate 3+ years of experience in data science , with a More ❯
Posted:

Vice President, Software Engineer - Finance Engineering

London, England, United Kingdom
Galaxy
issues Contribute to new Finance Engineering initiatives What We’re Looking For: Excellent programming skills in Python and strong working knowledge of Pandas and PySpark libraries Excellent knowledge of relational databases and SQL Experience with integration of multiple platforms Experience with ETL processes Experience providing first-line support for More ❯
Posted:

Lead Data Engineer - MSI

Norwich, England, United Kingdom
Baldwin Risk Partners
houses. Advanced understanding and experience with file storage layer management in data lake environment, including parquet and delta file formats. Solid experience with SPARK (PySpark) language, and data processing techniques. Solid Understanding of and experience with AZURE SYNAPSE tools and services. Some knowledge of Python preferred. Strong analytic skills More ❯
Posted:

Machine Learning Engineer

London, England, United Kingdom
Trainline
GenAI models and building agent AI systems Our technology stack Python and associated ML/DS libraries (Scikit-learn, Numpy, LightlGBM, Pandas, TensorFlow, etc...) PySpark AWS cloud infrastructure: EMR, ECS, S3, Athena, etc. MLOps: Terraform, Docker, Airflow, MLFlow, Jenkins More Information Enjoy fantastic perks like private healthcare & dental insurance More ❯
Posted:

Senior Software Engineer

London, England, United Kingdom
Hybrid / WFH Options
Our Future Health UK
Trusted Research Environments (TREs). We’re looking for candidates with strong experience in Python and cloud-native data processing and storage technologies, especially PySpark/Databricks, K8s, Postgres, Dagster, and Azure. If you have solid experience in similar technologies and are looking to widen your knowledge and experience More ❯
Posted:

Principal Data Engineer (Closing Date - 30 May 2025)

Leeds, United Kingdom
慨正橡扯
architectures with a focus on automation, performance tuning, cost optimisation, and system reliability. Proven proficiency in programming languages such as Python, T-SQL, and PySpark, with practical knowledge of test-driven development. Demonstrated capability in building secure, scalable data solutions on Azure with an in-depth understanding of data More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Pre-sales Solutions Architect (Public Sector)

London, United Kingdom
Databricks Inc
Engineering. Develop customer relationships and build internal partnerships with account executives and teams. Prior experience with coding in a core programming language (i.e., Python, PySpark, or SQL) and willingness to learn a base level of Spark. Proficient with Big Data Analytics technologies, including hands-on expertise with complex proofs More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Sr. Portfolio Data Engineer

Edinburgh, Scotland, United Kingdom
Addepar
or a related technical field Experience with object-oriented programming preferred General familiarity with some of the technologies we use: Python, Apache Spark/PySpark, Java/Spring Amazon Web Services SQL, relational databases Understanding of data structures and algorithms Interest in data modeling, visualisation, and ETL pipelines Knowledge More ❯
Posted:

Data Engineer

Derby, England, United Kingdom
Hybrid / WFH Options
Cooper Parry
warehouse, Lakehouse, Data Lake Hands-on experience with Power BI, semantic modelling, and DAX Strong SQL and data manipulation skills. Exposure to Python and PySpark is required. Experience working with open data formats like Delta Lake, Parquet, Json, Csv. Familiarity with CI/CD pipelines, version control (e.g., Git More ❯
Posted:

AWS Data Engineer – Market Data

London, England, United Kingdom
JR United Kingdom
complex data challenges that have wide-reaching impact across multiple business domains. Key Requirements: Strong experience in AWS data engineering tools (e.g., Glue, Athena, PySpark, Lake Formation) Solid skills in Python and SQL for data processing and analysis Deep understanding of data governance, quality, and security A passion for More ❯
Posted:

AWS Data Engineer – Market Data

Slough, England, United Kingdom
JR United Kingdom
complex data challenges that have wide-reaching impact across multiple business domains. Key Requirements: Strong experience in AWS data engineering tools (e.g., Glue, Athena, PySpark, Lake Formation) Solid skills in Python and SQL for data processing and analysis Deep understanding of data governance, quality, and security A passion for More ❯
Posted:

Data Engineer

London Area, United Kingdom
twentyAI
Work closely with data scientists and stakeholders Follow CI/CD and code best practices (Git, testing, reviews) Tech Stack & Experience: Strong Python (Pandas), PySpark, and SQL skills Cloud data tools (Azure Data Factory, Synapse, Databricks, etc.) Data integration experience across formats and platforms Strong communication and data literacy More ❯
Posted:

Data Engineer

City of London, London, United Kingdom
twentyAI
Work closely with data scientists and stakeholders Follow CI/CD and code best practices (Git, testing, reviews) Tech Stack & Experience: Strong Python (Pandas), PySpark, and SQL skills Cloud data tools (Azure Data Factory, Synapse, Databricks, etc.) Data integration experience across formats and platforms Strong communication and data literacy More ❯
Posted:

Data Engineer

South East London, England, United Kingdom
twentyAI
Work closely with data scientists and stakeholders Follow CI/CD and code best practices (Git, testing, reviews) Tech Stack & Experience: Strong Python (Pandas), PySpark, and SQL skills Cloud data tools (Azure Data Factory, Synapse, Databricks, etc.) Data integration experience across formats and platforms Strong communication and data literacy More ❯
Posted:

AWS Data Engineer - Market Data

London, United Kingdom
Vertus Partners
complex data challenges that have wide-reaching impact across multiple business domains. Key Requirements: Strong experience in AWS data engineering tools (e.g., Glue, Athena, PySpark, Lake Formation) Solid skills in Python and SQL for data processing and analysis Deep understanding of data governance, quality, and security A passion for More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

AWS Data Engineer – Market Data

City of London, England, United Kingdom
JR United Kingdom
complex data challenges that have wide-reaching impact across multiple business domains. Key Requirements: Strong experience in AWS data engineering tools (e.g., Glue, Athena, PySpark, Lake Formation) Solid skills in Python and SQL for data processing and analysis Deep understanding of data governance, quality, and security A passion for More ❯
Posted:

Senior Data Architect

City of London, London, United Kingdom
Anson McCade
at scale. Hands-on expertise in core GCP data services such as BigQuery, Composer, Dataform, Dataproc, and Pub/Sub. Strong programming skills in PySpark, Python, and SQL. Proficiency in ETL processes, data mining, and data storage principles. Experience with BI and data visualisation tools, such as Looker or More ❯
Posted:

Senior Data Architect

London Area, United Kingdom
Anson McCade
at scale. Hands-on expertise in core GCP data services such as BigQuery, Composer, Dataform, Dataproc, and Pub/Sub. Strong programming skills in PySpark, Python, and SQL. Proficiency in ETL processes, data mining, and data storage principles. Experience with BI and data visualisation tools, such as Looker or More ❯
Posted:

Senior Data Architect

Oxford, England, United Kingdom
JR United Kingdom
at scale. Hands-on expertise in core GCP data services such as BigQuery, Composer, Dataform, Dataproc, and Pub/Sub. Strong programming skills in PySpark, Python, and SQL. Proficiency in ETL processes, data mining, and data storage principles. Experience with BI and data visualisation tools, such as Looker or More ❯
Posted:

Senior Data Architect

Nottingham, England, United Kingdom
JR United Kingdom
at scale. Hands-on expertise in core GCP data services such as BigQuery, Composer, Dataform, Dataproc, and Pub/Sub. Strong programming skills in PySpark, Python, and SQL. Proficiency in ETL processes, data mining, and data storage principles. Experience with BI and data visualisation tools, such as Looker or More ❯
Posted:

Senior Data Architect

Basingstoke, England, United Kingdom
JR United Kingdom
at scale. Hands-on expertise in core GCP data services such as BigQuery, Composer, Dataform, Dataproc, and Pub/Sub. Strong programming skills in PySpark, Python, and SQL. Proficiency in ETL processes, data mining, and data storage principles. Experience with BI and data visualisation tools, such as Looker or More ❯
Posted:

Senior Data Architect

Basildon, England, United Kingdom
JR United Kingdom
at scale. Hands-on expertise in core GCP data services such as BigQuery, Composer, Dataform, Dataproc, and Pub/Sub. Strong programming skills in PySpark, Python, and SQL. Proficiency in ETL processes, data mining, and data storage principles. Experience with BI and data visualisation tools, such as Looker or More ❯
Posted:

Senior Data Architect

Telford, England, United Kingdom
JR United Kingdom
at scale. Hands-on expertise in core GCP data services such as BigQuery, Composer, Dataform, Dataproc, and Pub/Sub. Strong programming skills in PySpark, Python, and SQL. Proficiency in ETL processes, data mining, and data storage principles. Experience with BI and data visualisation tools, such as Looker or More ❯
Posted:

Senior Data Architect

Dartford, England, United Kingdom
JR United Kingdom
at scale. Hands-on expertise in core GCP data services such as BigQuery, Composer, Dataform, Dataproc, and Pub/Sub. Strong programming skills in PySpark, Python, and SQL. Proficiency in ETL processes, data mining, and data storage principles. Experience with BI and data visualisation tools, such as Looker or More ❯
Posted:

Senior Data Architect

Glasgow, Scotland, United Kingdom
JR United Kingdom
at scale. Hands-on expertise in core GCP data services such as BigQuery, Composer, Dataform, Dataproc, and Pub/Sub. Strong programming skills in PySpark, Python, and SQL. Proficiency in ETL processes, data mining, and data storage principles. Experience with BI and data visualisation tools, such as Looker or More ❯
Posted:
PySpark
10th Percentile
£50,000
25th Percentile
£62,500
Median
£105,000
75th Percentile
£122,500
90th Percentile
£141,750