26 to 33 of 33 PySpark Jobs in the North of England

Azure Data Engineer - £500 - Hybrid

Hiring Organisation
Tenth Revolution Group
Location
Newcastle upon Tyne, Tyne and Wear, Tyne & Wear, United Kingdom
Employment Type
Contract
Contract Rate
£450 - £550/day
services, data modeling, ETL/ELT development, and collaborative engineering practices. Key Responsibilities * Design, develop, and maintain scalable data pipelines using Azure Databricks (Python, PySpark, SQL). * Build and optimize ETL/ELT workflows that ingest data from various on-prem and cloud-based sources. * Work with Azure services … standards and best practices. Required Skills and Experience * Proven experience as a Data Engineer working with Azure cloud services. * Strong proficiency in Databricks, including PySpark, Spark SQL, notebooks, Delta Lake, and job orchestration. * Strong SQL and data modeling skills (e.g., dimensional modeling, data vault). * Experience with Azure Data ...

Cloud Data Engineer

Hiring Organisation
Accenture
Location
Leeds, West Yorkshire, England, United Kingdom
Employment Type
Full-Time
Salary
Competitive salary
data for critical client projects. How to develop and enhance your knowledge of agile ways of working and working in open source stack (PySpark/PySql). Quality engineering professionals utilise Accenture delivery assets to plan and implement quality initiatives to ensure solution quality throughout delivery. As a Data ...

Senior Database & Cloud Engineer

Hiring Organisation
Conferma
Location
Manchester, UK
Employment Type
Full-time
. Maintain/implement data warehousing solutions and manage large-scale data storage systems (e.g. Microsoft Fabric) Build and optimise SQL queries, stored procedures, PySpark notebooks and database objects to ensure data performance and reliability. Migrate and modernise legacy databases to cloud-based architectures. Database Administration Administer, monitor … normalisation, indexing, query optimisation). Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse and Medallion architectures. Understanding of API integrations ...

Senior Database & Cloud Engineer

Hiring Organisation
Conferma
Location
Warrington, Cheshire, UK
Employment Type
Full-time
. Maintain/implement data warehousing solutions and manage large-scale data storage systems (e.g. Microsoft Fabric) Build and optimise SQL queries, stored procedures, PySpark notebooks and database objects to ensure data performance and reliability. Migrate and modernise legacy databases to cloud-based architectures. Database Administration Administer, monitor … normalisation, indexing, query optimisation). Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse and Medallion architectures. Understanding of API integrations ...

Senior Database Engineer

Hiring Organisation
Conferma Ltd
Location
Manchester, North West, United Kingdom
Employment Type
Permanent
Salary
£70,000
. Maintain/implement data warehousing solutions and manage large-scale data storage systems (e.g. Microsoft Fabric) Build and optimise SQL queries, stored procedures, PySpark notebooks and database objects to ensure data performance and reliability. Migrate and modernise legacy databases to cloud-based architectures. Database Administration Administer, monitor … normalisation, indexing, query optimisation). Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse and Medallion architectures. Understanding of API integrations ...

Lead Data and AI Engineer

Hiring Organisation
Hays Technology
Location
Leeds, West Yorkshire, United Kingdom
Employment Type
Permanent
Salary
£70000 - £100000/annum £70,000-£100,000 Package
Your new company This is a pivotal opportunity to join the Data and Innovation division of a large complex organisation leading the delivery of SAM (Supervisory Analytics and Metrics)-a transformative programme enhancing supervisory decision ...

Staff Machine Learning Engineer (India based, relocation provided)

Hiring Organisation
Agoda
Location
Warrington, Cheshire, UK
Employment Type
Full-time
efficiency of our existing ML systems and processes. Build, administer and scale ML processing pipelines. Be comfortable navigating the following technology stack: Python3, Pyspark, scripting (Bash/Python), Hadoop, SQL, S3 etc. Should be able to understand internals of ML models such as Random Forest, CNN, Regression models … systems/engineering/related field 8+ years of experience in software engineering with a minimum of 4+ years in ML Good experience in Pyspark Expert level understanding of Python with design patterns and object-oriented programming. Experience debugging and reasoning about production issues is desirable. A good understanding ...

Staff Machine Learning Engineer (India based, relocation provided)

Hiring Organisation
Agoda
Location
Old Swan, Merseyside, UK
Employment Type
Full-time
efficiency of our existing ML systems and processes. Build, administer and scale ML processing pipelines. Be comfortable navigating the following technology stack: Python3, Pyspark, scripting (Bash/Python), Hadoop, SQL, S3 etc. Should be able to understand internals of ML models such as Random Forest, CNN, Regression models … systems/engineering/related field 8+ years of experience in software engineering with a minimum of 4+ years in ML Good experience in Pyspark Expert level understanding of Python with design patterns and object-oriented programming. Experience debugging and reasoning about production issues is desirable. A good understanding ...