26 to 33 of 33 PySpark Jobs in the North of England

efficient and well-documented code that follows a specification and can be maintained by others. You're confident using R or Python, SQL and PySpark to process, analyse and transform data at scale. You know how to create automated data pipelines and reusable workflows that handle both structured ...

efficient and well-documented code that follows a specification and can be maintained by others. You're confident using R or Python, SQL and PySpark to process, analyse and transform data at scale. You know how to create automated data pipelines and reusable workflows that handle both structured ...

Collaborative office environment with regular social and charity events And Much More!!! DATA ENGINEER – ESSTENTIAL SKILLS Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands-on experience with Kafka (MSK) and real-time data ingestion Strong understanding … submit (subject to required skills) your application to our client in conjunction with this vacancy only. KEY SKILLS Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data ...

project within the Public Sector, s previous experience within the NHS/Healthcare is essential. Requirements: Python, AWS (Serverless), Lambda, StepFunctions, DynamoDB are essential PySpark & Databricks are desirable Excellent communication, leadership & stakeholder management skills are required Contract Details: Principal Python Developer 6 Month Contract Inside IR35 Hybrid ...

GBMs, GAMs, Random Forests, Neural Networks and clustering techniques Knowledge of statistics and distributions commonly used in insurance Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Proficient at communicating results in a concise manner both verbally and written Behaviours: Motivated by technical excellence Driven to deliver iterative ...

maintain ETL/ELT pipelines and data models in Fabric (Data Factory, Notebooks, Spark) Write high-performance Spark SQL, T-SQL, Python/PySpark Manage ingestion, transformation, and loading from multiple sources Translate stakeholder requirements into scalable technical solutions Mentor team members and establish engineering standards, security, and governance … Leverage AI-assisted development tools like GitHub Copilot, ChatGPT, and Fabric Copilot Essential Experience: Microsoft Fabric & Azure Data ecosystem Lakehouse architectures & Data Factory Python, PySpark, Spark SQL Proven hands-on delivery in this stack What's on Offer: Salary: £70,000 Excellent benefits & annual leave package Strong progression & development ...

batch data pipelines to support fraud detection and operational decision-making. Develop event-driven solutions using Kafka, Flink, and data transformation frameworks such as PySpark or Pandas. Write maintainable, high-quality Python or Java code with strong SQL capabilities. Build and manage cloud infrastructure with AWS and Infrastructure … drive continuous improvement. What you bring 5+ experience as a senior data engineer or lead role Strong experience with AWS, SQL, Python, and PySpark, including building cloud infrastructure using IaC (CloudFormation/Terraform). Hands-on experience with streaming frameworks such as Kafka and Flink. Familiarity with data quality ...

pricing models with advanced data science techniques using WTW Radar and Emblem. Query and engineer large datasets (e.g., Python/R/SQL/PySpark) on modern platforms (e.g., Azure Databricks). Create innovative data solutions and present actionable insights to stakeholders. Communicate results clearly to key decision-makers … Street Pricing. What we’re looking for: Experience in general insurance pricing with strong modelling skills. Proficiency in programming languages such as R, Python, PySpark, SAS, or SQL. Good knowledge of Azure Databricks and modern data technologies. Experience with WTW Radar software is preferred. A quantitative degree in Mathematics ...