1 to 25 of 79 PySpark Jobs in the North of England

Data Engineer Pay up to £38,373 , plus 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. As a Data Engineer you will be working within a high-performing team of engineers, developing data-centric solutions More ❯

Data Engineer Pay up to £38,373 , plus 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. As a Data Engineer you will be working within a high-performing team of engineers, developing data-centric solutions More ❯

predictive modelling techniques; Logistic Regression, GBMs, Elastic Net GLMs, GAMs, Decision Trees, Random Forests, Neural Nets and Clustering Experience in statistical and data science programming languages (e.g. R, Python, PySpark, SAS, SQL) A good quantitative degree (Mathematics, Statistics, Engineering, Physics, Computer Science, Actuarial Science) Experience of WTW's Radar software is preferred Proficient at communicating results in a concise More ❯

Data Engineer Pay up to £38,373 , plus 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. As a Data Engineer you will be working within a high-performing team of engineers, developing data-centric solutions More ❯

scientific discipline, backed by minimum A A A grades at A-level You have commercial Data Engineering experience working with technologies such as SQL, Apache Spark and Python including PySpark and Pandas You have a good understanding of modern data engineering best practices Ideally you will also have experience with Azure and Data Bricks You're collaborative with excellent More ❯

Data Engineer Pay up to £38,373 , plus 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. As a Data Engineer you will be working within a high-performing team of engineers, developing data-centric solutions More ❯

Data Engineer Pay up to £38,373 , plus 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. As a Data Engineer you will be working within a high-performing team of engineers, developing data-centric solutions More ❯

data engineering and reporting. Including storage, data pipelines to ingest and transform data, and querying & reporting of analytical data. You've worked with technologies such as Python, Spark, SQL, Pyspark, PowerBI etc. You’ve got a background in software engineering, including Front End technologies like JavaScript. You’re a problem-solver, pragmatically exploring options and finding effective solutions. An More ❯

Specification Strong SQL knowledge Proven experience working with Azure Git/DevOps Repos experience Demonstration of problem solving ability Synapse Analytics or similar experience - desirable Visual Files experience – desirable PySpark/Python experience – desirable Powershell experience – desirable What We Offer We aim to reward your hard work generously. You’ll be greeted in our offices with great coffee, fruit More ❯

outputs Contribute to strategy and best practice for the long-term development of the data science function Requirements Experience in a data science leadership position Expert use of Python, PySpark, and PyTorch Strong experience with AI and ML best practice and development Databricks and GCP experience Strong business and commercial acumen Excellent stakeholder management My client have already began More ❯

Clustering. Knowledge of the technical differences between different packages for some of these model types would be advantageous. Experience in statistical and data science programming languages (e.g., R, Python, PySpark, SAS, SQL). Experience of WTW’s Radar software is preferred. Proficient at communicating results concisely both verbally and in writing. Behaviours: Good communication and people management skills. Self More ❯

working with CI/CD tools Key Technology: Experience with source control systems, such as Git dbt (Data Build Tool) for transforming and modelling data SQL (Spark SQL) & Python (PySpark) Certifications: You will need to be you. Curious about technology and adaptable to new technologies Agile-minded, optimistic, passionate, and pragmatic about delivering valuable data solutions to customers Willing More ❯

transaction processing with maintaining and strengthening the modelling standards and business information. ͏ Key Responsibilities: Build and optimize Prophecy data pipelines for large scale batch and streaming data workloads using Pyspark Define end-to-end data architecture leveraging prophecy integrated with databricks or Spark or other cloud-native compute engines Establish coding standards, reusable components, and naming conventions using Prophecy … exposure to convert legacy etl tools like datastage, informatica into Prophecy pipelines using Transpiler component of Prophecy Required skill & experience: 2+ years of hands-on experience with Prophecy (Using pyspark) approach 5+ years of experience in data engineering with tools such as Spark, Databricks,scala/Pyspark or SQL Strong understanding of ETL/ELT pipelines, distributed data More ❯

to be part of a team that’s transforming how data powers retail, this is your opportunity. Your Role (Key Responsibilities) Design, build, and optimise robust data pipelines using PySpark, SparkSQL, and Databricks to ingest, transform, and enrich data from a variety of sources. Translate business requirements into scalable and performant data engineering solutions, working closely with squad members More ❯

Job Title Data Engineering Manager - Commercial & Supply Location Asda House Employment Type Full time Contract Type Permanent Hours Per Week 37.5 Salary Competitive salary plus benefits Category Data Science Closing Date 27 June 2025 The role requires on-site presence More ❯

Job Title Lead Data Engineer Location Asda House Employment Type Full time Contract Type Permanent Hours Per Week 37.5 Salary Competitive salary plus benefits Category Business Intelligence Closing Date 27 June 2025 This role requires on-site presence at Asda More ❯

re looking for the following: Good technical knowledge of Azure Databricks, Azure Data Factory, Terraform and Azure DevOps Strong grounding in both SQL and Python with extensive experience using PySpark Excellent communication skills and the ability to collaborate with different stakeholders and disciplines Ability to mentor and coach other members of the team What can we offer you? At More ❯

automated ML Ops. Ideally, you’ll also be technically skilled in most or all of the below: - Expert knowledge of Python and SQL, inc. the following libraries: Numpy, Pandas, PySpark and Spark SQL - Expert knowledge of ML Ops frameworks in the following categories: a) experiment tracking and model metadata management (e.g. MLflow) b) orchestration of ML workflows (e.g. Metaflow More ❯

for reporting. A solid understanding of Power BI (or similar tools) and a passion for creating great user experiences. Familiarity with SQL , and ideally some exposure to Python or PySpark . Experience with Azure Data Services and platforms like Databricks . A collaborative mindset and experience working in Agile teams . Strong communication skills and a proactive, problem-solving More ❯

environment (e.g., retail, healthcare, logistics).Strong leadership capabilities with experience mentoring, developing, and managing high-performing analytics teams.Advanced analytical and problem-solving skills, with hands-on expertise in Python, PySpark, and SQL for data analysis and transformation.Proficiency in Power BI, with experience building intuitive dashboards and working within the Microsoft Fabric ecosystem.Demonstrated ability to work with large, complex datasets More ❯

About Pret Pret is an international on-the-go food and drink retailer founded in1986. Our purpose is to make every day a little bit brighter, through organiccoffee, freshly prepared food, and exceptional customer service to millions ofpeople. Pret runs More ❯

with large-scale datasets using Azure Data Factory (ADF) and Databricks. Strong proficiency in SQL (T-SQL, Spark SQL) for data extraction, transformation, and optimisation. Proficiency in Azure Databricks (PySpark, Delta Lake, Spark SQL) for big data processing. Knowledge of data warehousing concepts and relational database design, particularly with Azure Synapse Analytics. Experience working with Delta Lake for schema … evolution, ACID transactions, and time travel in Databricks. Strong Python (PySpark) skills for big data processing and automation. Experience with Scala (optional but preferred for advanced Spark applications). Experience working with Databricks Workflows & Jobs for data orchestration. Strong knowledge of feature engineering and feature stores, particularly in Databricks Feature store for ML training and inference. Experience with data More ❯

you will be using the latest tools and technologies such as Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Azure DevOps and Terraform alongside languages such as Python, PySpark and SQL. Deploying pipelines through CI/CD practices. You will work with digital, data and technology colleagues collaboratively, taking an innovative and creative approach to deliver key strategic … this data in an accessible and consistent way. To deliver this you will have preferably worked with cloud technologies and have a good level of coding skills (preferably Python, PySpark and SQL). Solutions you deliver should be reusable and scalable with a focus on consistency and maintainability. You will be able to review existing processes and improve them … this data in an accessible and consistent way. To deliver this you will have preferably worked with cloud technologies and have a good level of coding skills (preferably Python, PySpark and SQL). Solutions you deliver should be reusable and scalable with a focus on consistency and maintainability. You will be able to review existing processes and improve them More ❯

collaborate effectively with stakeholders. Desirable: SnowPro certification (Core/Advanced). Experience with GCP (dataflow and BigQuery) Experience with Azure services (Synapse, Data Factory, Logic Apps). Familiarity with PySpark for distributed data processing. Experience creating CI/CD pipelines using tools such as GitHub Actions. Knowledge of Terraform for Infrastructure as Code. Experience working with PostgreSQL or other More ❯

engineering experience with data platforms and analytics support Hands-on experience with Azure Data ecosystem: Databricks, Data Factory, Data Lake, Synapse; certifications are a plus Proficiency in Python, with PySpark experience preferred Strong SQL skills Experience in building and maintaining data pipelines Managing DevOps pipelines Skills in process optimization, performance tuning, data modeling, and database design Desirable Experience in … Zero goal by 2050. We value diversity and inclusion; your anonymized diversity data helps us improve our outreach and inclusion efforts. Nice-to-Have Skills Python, Azure, Data Factory, PySpark, SQL, DevOps Work Experience & Languages Data Engineer, Data Infrastructure English Seniorities and Job Details Entry level Contract IT & Internet industry #J-18808-Ljbffr More ❯