1 to 25 of 29 PySpark Jobs in the North of England

pipelines. Experience working with cloud data platforms (AWS preferred). Exposure to data warehousing, data lakes and modern data architecture. Python experience (including PySpark) is beneficial but not essential. Exposure to BI platforms such as Power BI, Tableau or QuickSight, with an understanding of how backend data models support ...

Microsoft Fabric, Azure Data Platform technologies, and modern cloud data architectures Hands-on experience with Databricks, Unity Catalog, and Delta Lake Advanced SQL and PySpark development skills Experience implementing Medallion Architecture principles Strong data modelling expertise, including Star Schema and Data Vault methodologies Solid understanding of data governance, security ...

with Microsoft Fabric, Azure Data Platform technologies and modern Lakehouse architecture Hands-on experience with Databricks, Unity Catalog and Delta Lake Strong SQL and PySpark skills Experience implementing Medallion Architecture principles Knowledge of data modelling methodologies including Star Schema and Data Vault Strong understanding of data governance, security ...

solutions Requirements: Enterprise data warehouse architecture and design Microsoft Fabric, Azure Data Platform technologies and modern Lakehouse architectures Databricks, Unity Catalog and Delta Lake PySpark, Databricks, SQL Medallion Architecture implementation Data modelling approaches including Star Schema and Data Vault Data governance, security and access management Why This Opportunity Greenfield ...

solutions Requirements: Enterprise data warehouse architecture and design Microsoft Fabric, Azure Data Platform technologies and modern Lakehouse architectures Databricks, Unity Catalog and Delta Lake PySpark, Databricks, SQL Medallion Architecture implementation Data modelling approaches including Star Schema and Data Vault Data governance, security and access management Why This Opportunity Greenfield ...

experience with Axiom (plus) and regulatory reporting flows (plus) Excellent communication; proven stakeholder engagement Ability to learn/adapt to new technologies Skilled PySpark, HDFS, SQL, Airflow, data modeling, and ETL processing. Familiarity with GitLab and Jupyter Notebook is preferred, and knowledge of Java will be considered an added ...

work effectively with both technical teams and senior business stakeholders. Experience across areas such as Medallion Architecture, Microsoft Purview, data governance, Python/PySpark, real-time/streaming, metadata-driven engineering or AI-enabled data products would be advantageous, but we're not expecting one person to tick every ...

Kubernetes Experience in creating production grade coding and SOLID programming principles, including test-driven development (TDD) approaches Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Experience in source-control software, e.g., GitHub Proficient at communicating results in a concise manner both verbally and written Experience in data ...

promote best practice across the analytics function. Independently own projects from discovery through to delivery. Skills & Experience Strong SQL skills. Python and/or PySpark experience. Experience within Product Analytics or Digital Analytics. Strong understanding of experimentation and A/B testing. Good grounding in statistics and analytical methodologies. ...

Private equity-backed organisation with ambitious growth plans Essential Skills & Experience Strong experience as a Data Engineer within modern cloud data environments Expertise in PySpark, SQL and data transformation practices Experience building production-grade data pipelines Knowledge of Microsoft Fabric Experience working with Delta Lake and Lakehouse architectures ...

performance optimisation. Hands-on delivery experience within hospitality reporting and commercial reporting environments. Experience working with Databricks is useful. Ability to interpret Python/PySpark is beneficial. If you are interested in this Power BI Developer role please apply with your most recent CV or reach out on jordan ...

visible role where you'll combine strong technical skills with commercial thinking to drive meaningful product improvements. Your Skills & Experience Strong SQL skills Python (PySpark experience is beneficial) Experience in Product Analytics Strong knowledge of A/B testing and experimentation Excellent statistical analysis skills, with exposure to modelling ...

Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client is a global innovator and world leader … with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience is also key, as are excellent communication skills ...

delivery. What You'll Be Doing Design, develop and maintain data pipelines and data engineering solutions using Databrick sBuild scalable data processing solutions using PySpark and SQL Work across Databricks Lakehouse environments, supporting implementation, optimisation and ongoing improvement Develop and optimise batch and data processing workflows Contribute to technical … transformation journeys What We're Looking For Strong commercial experience in Data Engineering Hands-on experience with Databricks and/or Apache Spark Strong PySpark and SQL development skills Experience designing, building and supporting data pipelines Experience working with Azure or AWS Good understanding of modern data platforms ...

GBMs, GAMs, Random Forests, Neural Networks and clustering techniques Knowledge of statistics and distributions commonly used in insurance Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Proficient at communicating results in a concise manner both verbally and written Behaviours: Motivated by technical excellence Driven to deliver iterative ...

Microsoft Fabric Data Engineer SQL, Python, PySpark Microsoft Fabric pipelines, Lakehouses, Warehouses and semantic models Microsoft Fabric Data Engineer – Contract (Hybrid 2-3 days/wk) Greater Manchester Our Financial Services client has a contract vacancy for an experienced Microsoft Fabric Data Engineer to join their Data & Business Architecture … quality and operational efficiency. Develop technical documentation, runbooks and support procedures. Skills & Experience Strong hands-on experience with Microsoft Fabric. Excellent SQL, Python and PySpark skills. Experience with Fabric Lakehouse, Warehouse, Pipelines and semantic models. Practical experience of Git, Azure DevOps and CI/CD. Strong troubleshooting and analytical ...

Data Engineer - Manchester (Hybrid) - Microsoft Fabric - Databricks - PySpark - Up to £55,000 We're partnering with a highly successful, private equity-backed organisation that is investing heavily in its data and technology capabilities. With a business-wide data transformation programme underway, this is a rare opportunity to join … Designing and building scalable ETL/ELT data pipelines. Microsoft Fabric, including Data Factory, Dataflow Gen2 and Fabric Notebooks. Databricks Workflows and Lakehouse technologies. PySpark, SQL and Delta Lake environments. Data ingestion, transformation and orchestration processes. Data governance, security and quality initiatives. Enterprise-wide analytics and reporting solutions, including ...

purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon … delivery practices. Ability to optimise data processing, storage, and queries to improve performance and data quality. Experience designing and automating ETL pipelines using PySpark and Spark SQL.A strong full stack development background with technologies that include .NET 4,8, C#, JavaScript, C++ and Java. You and your role ...

purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon … delivery practices. Ability to optimise data processing, storage, and queries to improve performance and data quality. Experience designing and automating ETL pipelines using PySpark and Spark SQL.A strong full stack development background with technologies that include .NET 4,8, C#, JavaScript, C++ and Java. You and your role ...

purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon … delivery practices. Ability to optimise data processing, storage, and queries to improve performance and data quality. Experience designing and automating ETL pipelines using PySpark and Spark SQL.A strong full stack development background with technologies that include .NET 4,8, C#, JavaScript, C++ and Java. You and your role ...

purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon … delivery practices. Ability to optimise data processing, storage, and queries to improve performance and data quality. Experience designing and automating ETL pipelines using PySpark and Spark SQL.A strong full stack development background with technologies that include .NET 4,8, C#, JavaScript, C++ and Java. You and your role ...

purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon … delivery practices. Ability to optimise data processing, storage, and queries to improve performance and data quality. Experience designing and automating ETL pipelines using PySpark and Spark SQL.A strong full stack development background with technologies that include .NET 4,8, C#, JavaScript, C++ and Java. You and your role ...

purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon … delivery practices. Ability to optimise data processing, storage, and queries to improve performance and data quality. Experience designing and automating ETL pipelines using PySpark and Spark SQL.A strong full stack development background with technologies that include .NET 4,8, C#, JavaScript, C++ and Java. You and your role ...

Logging, tracking and managing defects through to resolution Contributing to testing strategies, quality frameworks and continuous improvement initiatives Supporting testing activities within Databricks and PySpark environments SKILLS AND EXPERIENCE The successful Data QA Engineer will have the following skills and experience: Experience in a Data QA, Software Testing … Quality Assurance role Strong experience testing data platforms, pipelines and data products Hands-on experience with Databricks, SQL, Python and PySpark Strong stakeholder communication and collaboration skills Able to work independently and take ownership of testing activities and quality standards BENEFITS The successful Data QA Engineer will receive ...

Logging, tracking and managing defects through to resolution Contributing to testing strategies, quality frameworks and continuous improvement initiatives Supporting testing activities within Databricks and PySpark environments SKILLS AND EXPERIENCE The successful Data QA Engineer will have the following skills and experience: Experience in a Data QA, Software Testing … Quality Assurance role Strong experience testing data platforms, pipelines and data products Hands-on experience with Databricks, SQL, Python and PySpark Strong stakeholder communication and collaboration skills Able to work independently and take ownership of testing activities and quality standards BENEFITS The successful Data QA Engineer will receive ...