PySpark Jobs in the North of England

1 to 24 of 24 PySpark Jobs in the North of England

Data Engineer

SR3, New Silksworth, Sunderland, Tyne & Wear, United Kingdom
Hybrid / WFH Options
Avanti Recruitment
record in data warehousing, ETL processes, and data modelling Azure certifications in Database Administration or Data Engineering Nice to have: Experience with Python/PySpark and MySQL on Azure Additional Azure certifications (e.g., Fabric Analytics Engineer) Knowledge of data visualization platforms (Tableau/PowerBi) This is an exciting opportunity more »
Employment Type: Permanent
Salary: £60000 - £70000/annum
Posted:

Senior Data Engineer - Databricks - Sunderland - £65K

Sunderland, Tyne and Wear, Tyne & Wear, United Kingdom
Nigel Frank International
Working with and modelling data warehouses. Skills & Qualifications Strong technical expertise using SQL Server and Azure Data Factory for ETL Solid experience with Databricks, PySpark etc. Understanding of Agile methodologies including use of Git Experience with Python and Spark Benefits £60,000 - £65,000 To apply for this role more »
Employment Type: Permanent
Salary: £60000 - £65000/annum
Posted:

Principal Data Engineer

Liverpool, England, United Kingdom
Hybrid / WFH Options
Maxwell Bond
level database development and admin in both Azure cloud and on prem. Proven working experience with Azure Data Warehouse, Databricks, SQL and Python/PySpark . ETL & ETL Frameworks Experience of consuming and combining data for near real time answers. This position does not offer Visa Sponsorship , please refrain more »
Posted:

Data Engineer - Hybrid/Sunderland - £65,000

Newcastle upon Tyne, Tyne and Wear, Tyne & Wear, United Kingdom
Hybrid / WFH Options
Nigel Frank International
Working with and modelling data warehouses. Skills & Qualifications Strong technical expertise using SQL Server and Azure Data Factory for ETL Solid experience with Databricks, PySpark etc. Understanding of Agile methodologies including use of Git Experience with Python and Spark Benefits £60,000 - £65,000 This role is an urgent more »
Employment Type: Permanent
Salary: £60000 - £65000/annum
Posted:

Cloud Data Engineer

Liverpool, England, United Kingdom
Hybrid / WFH Options
Maxwell Bond
level database development and admin in both Azure cloud and on prem. Proven working experience with Azure Data Warehouse, Databricks, SQL and Python/PySpark . Experience of consuming and combining data for near real time answers. This position does not offer Visa Sponsorship , please refrain from applying if more »
Posted:

Azure Data Engineer - Newcastle - £65,000

Newcastle upon Tyne, Tyne and Wear, Tyne & Wear, United Kingdom
Nigel Frank International
To be successful in the role you will have. Strong Azure Data Platform experience Strong understanding of Databricks Coding experience with both Python/PySpark and SQL Experience working with Azure Data Factory for creating ETL solutions This is just a brief overview of the role. For the full more »
Employment Type: Permanent
Salary: £65000/annum
Posted:

Azure Data Engineer - Sunderland - £65,000

Middlesbrough, North Yorkshire, United Kingdom
Nigel Frank International
SQL Server and Azure Experience creating data pipelines with Azure Data Factory Databricks experience would be beneficial Experience working with Python/Spark/PySpark This is just a brief overview of the role. For the full information, simply apply to the role with your CV, and I will more »
Employment Type: Permanent
Salary: £50000 - £65000/annum
Posted:

Azure Data Engineer - Sunderland - £65,000

Durham, County Durham, United Kingdom
Nigel Frank International
SQL Server and Azure Experience creating data pipelines with Azure Data Factory Databricks experience would be beneficial Experience working with Python/Spark/PySpark This is just a brief overview of the role. For the full information, simply apply to the role with your CV, and I will more »
Employment Type: Permanent
Salary: £50000 - £65000/annum
Posted:

Azure Data Engineer - Sunderland - £65,000

Sunderland, Tyne and Wear, Tyne & Wear, United Kingdom
Nigel Frank International
SQL Server and Azure Experience creating data pipelines with Azure Data Factory Databricks experience would be beneficial Experience working with Python/Spark/PySpark This is just a brief overview of the role. For the full information, simply apply to the role with your CV, and I will more »
Employment Type: Permanent
Salary: £50000 - £65000/annum
Posted:

Azure Data Engineer - Sunderland - £65,000

Newcastle upon Tyne, Tyne and Wear, Tyne & Wear, United Kingdom
Nigel Frank International
SQL Server and Azure Experience creating data pipelines with Azure Data Factory Databricks experience would be beneficial Experience working with Python/Spark/PySpark This is just a brief overview of the role. For the full information, simply apply to the role with your CV, and I will more »
Employment Type: Permanent
Salary: £50000 - £65000/annum
Posted:

Machine Learning Engineering Manager

Leeds, England, United Kingdom
Hybrid / WFH Options
Fruition IT
technical stakeholders. Experience Required: Extensive experience in training, deploying and maintaining Machine Learning models. Data Warehousing and ETL tools. Python and surrounding ML tech; PySpark, Snowflake, Scikit Learn, TensorFlow, PyTorch etc. Infrastructure as Code - Terraform, Ansible. Stakeholder Management - Tech and Non-Technical. The Offer: Base Salary more »
Posted:

Pricing Analyst (Portfolio Management)

Manchester, United Kingdom
Vermelo RPO
GBMs, Elastic Net GLMs, GAMs, Decision Trees, Random Forests, Neural Nets and Clustering Experience in statistical and data science programming languages (e.g. R, Python, PySpark, SAS, SQL) A good quantitative degree (Mathematics, Statistics, Engineering, Physics, Computer Science, Actuarial Science) Experience of WTW’s Radar and Emblem software is preferred more »
Employment Type: Permanent
Posted:

Senior Pricing Analyst

Manchester, United Kingdom
Vermelo RPO
GBMs, Elastic Net GLMs, GAMs, Decision Trees, Random Forests, Neural Nets and Clustering Experience in statistical and data science programming languages (e.g. R, Python, PySpark, SAS, SQL) A good quantitative degree (Mathematics, Statistics, Engineering, Physics, Computer Science, Actuarial Science) Experience of WTW’s Radar software is preferred Proficient at more »
Employment Type: Permanent
Posted:

Senior Pricing Analyst - Modelling

Manchester, United Kingdom
Vermelo RPO
GBMs, Elastic Net GLMs, GAMs, Decision Trees, Random Forests, Neural Nets and Clustering Experience in statistical and data science programming languages (e.g. R, Python, PySpark, SAS, SQL) A good quantitative degree (Mathematics, Statistics, Engineering, Physics, Computer Science, Actuarial Science) Proven experience of modelling using WTW toolkit (Emblem and Radar more »
Employment Type: Permanent
Posted:

Principle Pricing Analyst

Manchester, United Kingdom
Vermelo RPO
GBMs, Elastic Net GLMs, GAMs, Decision Trees, Random Forests, Neural Nets and Clustering Experience in statistical and data science programming languages (e.g. R, Python, PySpark, SAS, SQL) A good quantitative degree (Mathematics, Statistics, Engineering, Physics, Computer Science, Actuarial Science) Experience of WTW’s Radar software is preferred Proficient at more »
Employment Type: Permanent
Posted:

Pricing Manager

Manchester, United Kingdom
Hybrid / WFH Options
Vermelo RPO
between different packages for some of these model types would be an advantage. Experience in statistical and data science programming languages (e.g. R, Python, PySpark, SAS, SQL) A good quantitative degree (Mathematics, Statistics, Engineering, Physics, Computer Science, Actuarial Science) Experience of WTW’s Radar software is preferred Proficient at more »
Employment Type: Permanent
Posted:

Technical Pricing Analyst

Manchester, United Kingdom
Hybrid / WFH Options
Vermelo RPO
GBMs, Elastic Net GLMs, GAMs, Decision Trees, Random Forests, Neural Nets and Clustering Experience in statistical and data science programming languages (e.g. R, Python, PySpark, SAS, SQL) A good quantitative degree (Mathematics, Statistics, Engineering, Physics, Computer Science, Actuarial Science) Experience of WTW’s Radar software is preferred Proficient at more »
Employment Type: Permanent
Posted:

Data Migration Consultant

Leeds, England, United Kingdom
Hybrid / WFH Options
Mastek
OBIEE, Workato and PL/SQL. Design and build data solutions on Azure, leveraging Databricks, Data Factory, and other Azure services. Utilize Python and PySpark for data transformation, analysis, and real-time streaming. Collaborate with cross-functional teams to gather requirements, design solutions, and deliver insights. Implement and maintain … Technologies: Databricks, Data Factory: Expertise in data engineering and orchestration. DevOps, Storage Explorer, Data Studio: Competence in deployment, storage management, and development tools. Python, PySpark: Advanced coding skills, including real-time data streaming through Autoloader. Development Tools: VS Code, Jira, Confluence, Bitbucket. Service Management: Experience with ServiceNow. API Integration more »
Posted:

Lead Data Engineer

Leeds, England, United Kingdom
HCLTech
Lead Data Engineer: We need some strong Lead data engineer profiles… they need good experience with Python, SQL, ADF and preferably Azure Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building more »
Posted:

Data Engineer

Sheffield
Hybrid / WFH Options
DWP
scalable, automated ETL pipelines in an AWS cloud environment using AWS S3 Cloud Object Storage Strong coding skills using Hive SQL, Spark SQL, Python, PySpark and Bash Experience of working with a wide variety of structured and unstructured data. You and your role As a Data Engineer at DWP … you'll be executing code across a full tech stack, including Azure, Databricks, PySpark and Pandas, helping the department to move towards a cloud computing environment, working with huge data sets as part of our DataWorks platform - a system that provides Universal Credit data to our Data Science team more »
Employment Type: Permanent
Salary: £40,201 - £58,347
Posted:

Data Engineer

Manchester
Hybrid / WFH Options
DWP
scalable, automated ETL pipelines in an AWS cloud environment using AWS S3 Cloud Object Storage Strong coding skills using Hive SQL, Spark SQL, Python, PySpark and Bash Experience of working with a wide variety of structured and unstructured data. You and your role As a Data Engineer at DWP … you'll be executing code across a full tech stack, including Azure, Databricks, PySpark and Pandas, helping the department to move towards a cloud computing environment, working with huge data sets as part of our DataWorks platform - a system that provides Universal Credit data to our Data Science team more »
Employment Type: Permanent
Salary: £40,201 - £58,347
Posted:

Data Engineer

Newcastle upon Tyne, Tyne & Wear
Hybrid / WFH Options
DWP
scalable, automated ETL pipelines in an AWS cloud environment using AWS S3 Cloud Object Storage Strong coding skills using Hive SQL, Spark SQL, Python, PySpark and Bash Experience of working with a wide variety of structured and unstructured data. You and your role As a Data Engineer at DWP … you'll be executing code across a full tech stack, including Azure, Databricks, PySpark and Pandas, helping the department to move towards a cloud computing environment, working with huge data sets as part of our DataWorks platform - a system that provides Universal Credit data to our Data Science team more »
Employment Type: Permanent
Salary: £40,201 - £58,347
Posted:

Data Engineer

Blackpool, North West
Hybrid / WFH Options
DWP
scalable, automated ETL pipelines in an AWS cloud environment using AWS S3 Cloud Object Storage Strong coding skills using Hive SQL, Spark SQL, Python, PySpark and Bash Experience of working with a wide variety of structured and unstructured data. You and your role As a Data Engineer at DWP … you'll be executing code across a full tech stack, including Azure, Databricks, PySpark and Pandas, helping the department to move towards a cloud computing environment, working with huge data sets as part of our DataWorks platform - a system that provides Universal Credit data to our Data Science team more »
Employment Type: Permanent
Salary: £40,201 - £58,347
Posted:

Data Engineer

Leeds, West Yorkshire, Yorkshire and the Humber
Hybrid / WFH Options
DWP
scalable, automated ETL pipelines in an AWS cloud environment using AWS S3 Cloud Object Storage Strong coding skills using Hive SQL, Spark SQL, Python, PySpark and Bash Experience of working with a wide variety of structured and unstructured data. You and your role As a Data Engineer at DWP … you'll be executing code across a full tech stack, including Azure, Databricks, PySpark and Pandas, helping the department to move towards a cloud computing environment, working with huge data sets as part of our DataWorks platform - a system that provides Universal Credit data to our Data Science team more »
Employment Type: Permanent
Salary: £40,201 - £58,347
Posted:
PySpark
the North of England
25th Percentile
£44,738
Median
£55,000
75th Percentile
£77,500
90th Percentile
£90,000