51 to 58 of 58 PySpark Jobs in the North of England

Engineer (AWS) - Manchester (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with … with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience is also key, as are excellent communication skills ...

Data Engineer - Manchester (Hybrid) - Microsoft Fabric - Databricks - PySpark - Up to £55,000 We're partnering with a highly successful, private equity-backed organisation that is investing heavily in its data and technology capabilities. With a business-wide data transformation programme underway, this is a rare opportunity to join … Designing and building scalable ETL/ELT data pipelines. Microsoft Fabric, including Data Factory, Dataflow Gen2 and Fabric Notebooks. Databricks Workflows and Lakehouse technologies. PySpark, SQL and Delta Lake environments. Data ingestion, transformation and orchestration processes. Data governance, security and quality initiatives. Enterprise-wide analytics and reporting solutions, including ...

modern data platform. Develop and maintain Medallion Architecture data layers, ensuring data is available for reporting and analytics. Create high-performance data transformations using PySpark, Databricks and Fabric Notebooks. Implement data governance and access controls through Databricks Unity Catalog. Support CI/CD deployment processes using Git integration … within a Data Engineering environment, delivering reliable and scalable data solutions. Strong hands-on experience with Microsoft Fabric and Databricks. Strong programming capability across PySpark and T-SQL. Experience working with Delta Lake, Lakehouse architectures and modern cloud data platforms. Understanding of data quality frameworks, testing approaches and governance ...

Data Engineer - Python/PySpark/Microsoft Fabric £55,000 - £65,000 + Benefits St Helens - 1-2 days per week This is an opportunity to join an organisation at a particularly interesting point in the development of its data capability. The business has invested heavily in modernising … procedures and drag-and-drop development. The team is deliberately moving towards a more code-led engineering approach, with a strong emphasis on Python, PySpark and notebook-based development. What you'll be working with The environment includes: Python/PySpark Microsoft Fabric Spark and notebook development Lakehouse ...

engineers, analysts and client stakeholders to deliver robust data solutions for government, defence and regulated sectors. You’ll work with AWS and Azure services, PySpark, SQL and Java/Python, implement data quality and monitoring, and contribute to runbooks, data dictionaries and scalable #J-18808-Ljbffr ...

Sheffield-based with 3 days on-site per week. You will design, develop and support enterprise-scale data pipelines, optimise Spark performance using PySpark and Databricks, and resolve runtime issues in a complex, large-scale environment. Inside IR35, initial six-month engagement. #J-18808-Ljbffr ...

champion best-practice methods; upskill the team through coaching and code reviews. Query and engineer large datasets (e.g., Python/R/SQL/PySpark) on modern platforms (e.g., Azure Databricks). Communicate pricing proposals and insights clearly and persuasively to stakeholders at all levels. Collaborate with Modelling, Optimisation … problem solving capabilities with the ability to apply market standard pricing techniques to non-standard products. Proficiency in programming languages such as R, Python, PySpark, SAS, or SQL. Good knowledge of Azure Databricks and modern data technologies. Technical expertise in predictive modelling techniques e.g. GLMs. Experience with WTW Radar ...

much as building models. The Role You will: Build, validate and deploy machine learning and statistical models Work with Python, SQL, Databricks and PySpark to analyse large datasets Solve pricing and risk-related business challenges Explore new data sources and test innovative ideas Own projects from problem definition through … mentor junior Data Scientists Your Skills & Experience Strong commercial Data Science experience Advanced Python and SQL skills Experience with Databricks and/or PySpark Knowledge of machine learning techniques such as XGBoost and LightGBM Strong statistical modelling capability Excellent problem-solving and stakeholder management skills Experience in insurance, financial ...