PySpark Jobs in the UK

26 to 50 of 172 PySpark Jobs in the UK

PythonAWSSoftwareEngineerII

Glasgow, Renfrewshire, United Kingdom
Hispanic Alliance for Career Enhancement
environment with one or more modern programming languages and database querying languages Proficiency in coding one or more languages such as Java, Python or PySpark Experience in Cloud implementation with AWS Data Services, Glue ETL (or) EMR, S3, Glue Catalog, Athena, Lambda, Step Functions, Event Bridge, ECS, Data De More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Azure Databricks Data Engineer (Contract OUTSIDE IR35)

City of London, London, Farringdon, United Kingdom
Hybrid / WFH Options
83zero Ltd
similar tools is valuable (Collibra, Informatica Data Quality/MDM/Axon etc.) Data Architecture experience is a bonus Python, Scala, Databricks Spark and Pyspark with Data Engineering skills Ownership and ability to drive implementation/solution design For more information please contact Aaron Perdesi - please email your CV More ❯
Employment Type: Contract
Rate: £450 - £550/day
Posted:

Machine Learning Engineer FullTime London

London, United Kingdom
Trainline plc
and/or algorithms Our technology stack Python and associated ML/DS libraries (Scikit-learn, Numpy, LightlGBM, Pandas, LangChain/LangGraph, TensorFlow, etc ) PySpark AWS cloud infrastructure: EMR, ECS, Athena, etc. MLOps: Terraform, Docker, Airflow, MLFlow More information: Enjoy fantastic perks like private healthcare & dental insurance, a generous More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Business Intelligence Engineer, Amazon

London, United Kingdom
Amazon
finance or equivalent quantitative field - Experience with scripting languages (e.g., Python, Java, R) and big data technologies/languages (e.g. Spark, Hive, Hadoop, PyTorch, PySpark) to build and maintain data pipelines and ETL processes - Demonstrate proficiency in SQL, data analysis, and data visualization tools like Amazon QuickSight to drive More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Databricks Engineer

London, United Kingdom
Treliant, LLC
working with Databricks in a production environment. Strong background in ETL/ELT pipeline design and implementation within Databricks. Proficiency in SQL, Python, and PySpark for data processing and analysis. Experience with streaming technologies such as Kafka for real-time data processing. Experience in data migration and integration for More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineering Manager

City of London, London, United Kingdom
Hybrid / WFH Options
Ikhoi Recruitment
the Canary Wharf office, 3 days WFH, pension, life assurance, season ticket loan and lot's more. You must have experience with Python/Pyspark, Azure and managing a small team of Mid level/Senior Data Engineers. As part of the Technology Hub within the client, Data Engineer More ❯
Employment Type: Permanent, Work From Home
Salary: £90,000
Posted:

Lead Data Scientist New London

London, United Kingdom
Mesh-AI Limited
positive influence on Mesh-AI, our customers, and your team. Nice to Have NLP, LLMs, GenAI, time series forecasting, image recognition or deep learning. PySpark, OpenCV, spaCy or DVC. Exposure to MLOps. Why Mesh-AI Fast-growing start-up organisation with huge opportunity for career growth. Highly competitive salary More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Data Architect - Databricks

London, England, United Kingdom
SoCode Recruitment
Lake, Synapse, Power BI) Required Skills & Experience Proven experience as a Data Architect in enterprise environments Extensive hands-on experience with Databricks (including SQL, PySpark, Delta Lake) Solid background in data warehousing , data lakes , and big data frameworks Strong knowledge of Azure cloud services , especially in data integration Experience More ❯
Posted:

Senior Data Architect - Databricks

london, south east england, united kingdom
SoCode Recruitment
Lake, Synapse, Power BI) Required Skills & Experience Proven experience as a Data Architect in enterprise environments Extensive hands-on experience with Databricks (including SQL, PySpark, Delta Lake) Solid background in data warehousing , data lakes , and big data frameworks Strong knowledge of Azure cloud services , especially in data integration Experience More ❯
Posted:

Databricks Capability Lead

Bristol, Gloucestershire, United Kingdom
Hybrid / WFH Options
Snap Analytics
cloud-based architectures on AWS, Azure, or GCP A strong background in Databricks for building enterprise data warehouses with strong knowledge of SQL and Pyspark A deep understanding of data modelling and advanced pipeline development Knowledge and understanding of best practice CI/CD approaches utilising Git. Strategic Vision More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer

London Area, United Kingdom
Oliver Bernard
Python, SQL, and big data technologies (Hadoop, Spark, NoSQL) Hands-on experience with cloud platforms (AWS, GCP, Azure) Proficiency in data processing frameworks like PySpark A problem-solver who thrives in a fast-paced environment Excellent communication skills to collaborate with technical and non-technical stakeholders Salary: Up to More ❯
Posted:

Data Engineer

london, south east england, united kingdom
Oliver Bernard
Python, SQL, and big data technologies (Hadoop, Spark, NoSQL) Hands-on experience with cloud platforms (AWS, GCP, Azure) Proficiency in data processing frameworks like PySpark A problem-solver who thrives in a fast-paced environment Excellent communication skills to collaborate with technical and non-technical stakeholders Salary: Up to More ❯
Posted:

Data Engineer

England, United Kingdom
Oliver Bernard
Python, SQL, and big data technologies (Hadoop, Spark, NoSQL) Hands-on experience with cloud platforms (AWS, GCP, Azure) Proficiency in data processing frameworks like PySpark A problem-solver who thrives in a fast-paced environment Excellent communication skills to collaborate with technical and non-technical stakeholders Salary: Up to More ❯
Posted:

Octopus Energy

London, United Kingdom
Jointaro
a modern tech stack including SQL, Python, Airflow, Kubernetes, and various other cutting-edge technologies. You'll work with tools like dbt on Databricks, PySpark, Streamlit, and Django, ensuring robust data infrastructure that powers business-critical operations. What makes this role particularly exciting is the combination of technical depth More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Scientist

London, United Kingdom
Sneak Peek Tech
influence. A drive to learn new technologies and techniques. Experience/aptitude towards research and openness to learn new technologies. Experience with Azure, Spark (PySpark), and Kubeflow - desirable. We pay competitive salaries based on experience of the candidates. Along with this, you will be entitled to an award-winning More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Science Consultant- Architecture Focus

United Kingdom
Accenture
languages e.g. Python, R, Scala, etc.; (Python preferred). Proficiency in database technologies e.g. SQL, ETL, No-SQL, DW, and Big Data technologies e.g. pySpark, Hive, etc. Experienced working with structured and unstructured data e.g. Text, PDFs, jpgs, call recordings, video, etc. Knowledge of machine learning modelling techniques and More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Science Consultant- Architecture Focus

City, Edinburgh, United Kingdom
Accenture
languages eg. Python, R, Scala, etc.; (Python preferred). Proficiency in database technologies eg. SQL, ETL, No-SQL, DW, and Big Data technologies e.g. pySpark, Hive, etc. Experienced working with structured and also unstructured data eg. Text, PDFs, jpgs, call recordings, video, etc. Knowledge of machine learning modelling techniques More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Contract Data Engineer

Nationwide, United Kingdom
Hybrid / WFH Options
Deerfoot Recruitment Solutions Limited
Platform technologies (Synapse, Data Lakes, ADF) Expertise in data modelling, ETL/ELT pipeline development, and data integration Proficient in SQL and Python (ideally PySpark) Knowledge of tools such as Power BI, Microsoft Fabric, and DevOps (CI/CD pipelines) Experience working with enterprise data sources and APIs (e.g. More ❯
Employment Type: Contract
Rate: £450 - £550/day
Posted:

Director of Data

London Area, United Kingdom
Block MB
s or PhD in a relevant field (e.g., Computer Science, Data Science, Engineering, Applied Mathematics, Statistics, etc.). Proficiency in Python, SQL, AWS, Airflow, PySpark, PyTorch, NumPy, and related data technologies. Experience with cloud infrastructure, data pipelines, and machine learning model deployment. Proven experience leading diverse teams of data More ❯
Posted:

Director of Data

london, south east england, united kingdom
Block MB
s or PhD in a relevant field (e.g., Computer Science, Data Science, Engineering, Applied Mathematics, Statistics, etc.). Proficiency in Python, SQL, AWS, Airflow, PySpark, PyTorch, NumPy, and related data technologies. Experience with cloud infrastructure, data pipelines, and machine learning model deployment. Proven experience leading diverse teams of data More ❯
Posted:

Data Scientist

London, United Kingdom
MVF
commercial experience is a plus Strong understanding of mathematical background, focusing on statistics and linear algebra Highly proficient in Python (Pandas, Scikit-Learn, PyTorch, PySpark) and SQL Experience with Snowflake (function & procedure) and Snowpark is a plus Experience with unit and integration tests Strong understanding of machine learning algorithms More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Delivery Consultant - Data Analytics, AWS Professional Services

London, United Kingdom
Amazon
Hue, Zookeeper, HCatalog, Solr, Avro, Parquet, Iceberg, Hudi). Experience developing software and data engineering code in one or more programming languages (Java, Python, PySpark, Node, etc). AWS and other Data and AI aligned Certifications. Ability to think strategically about business, product, and technical challenges in an enterprise More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer , Amazon Music DISCO

London, United Kingdom
Amazon
the-art data analytics platform on AWS, employing the AWS Cloud Development Kit (CDK). Construct resilient and scalable data pipelines using SQL/PySpark/Airflow to effectively ingest, process, and transform substantial data volumes from diverse sources into a structured format, ensuring data quality and integrity. Devise More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Science - Customer Data Platform Manager

City, Edinburgh, United Kingdom
Accenture
experience in coding languages e.g. Python, C++, etc.; (Python preferred). Proficiency in database technologies e.g. SQL, No-SQL and Big Data technologies e.g. pySpark, Hive, etc. Experience working with structured and unstructured data e.g. Text, PDFs, jpgs, call recordings, video, etc. Knowledge of machine learning modelling techniques and More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Azure Data Engineer

London, United Kingdom
N Consulting Limited
using Azure services including Azure Databricks, Azure Data Factory, Delta Lake, Azure Data Lake (ADLS), Power BI. Solid hands-on experience with Azure Databricks - Pyspark coding and Spark SQL coding - Must have. Very good knowledge of data warehousing skills including dimensional modeling, slowly changing dimension patterns, and time travel. More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:
PySpark
10th Percentile
£50,000
25th Percentile
£75,563
Median
£110,000
75th Percentile
£122,500
90th Percentile
£147,500