8 of 8 PySpark Jobs in Manchester

Skills and Experience Hands-on experience Azure services such as Synapse, Data Factory or Databricks Strong SQL skills Proficiency in Python and/or PySpark Experience with Power BI and data modelling What is on offer Salary up to £65,000 Fully remote working from anywhere ...

Days Cycle to work scheme And More.. DATA ENGINEER – ESSTENTIAL SKILLS Proven experience building data pipelines using Databricks . Strong understanding of Apache Spark (PySpark or Scala) and Structured Streaming . Experience working with Kafka (MSK) and handling real-time data . Good knowledge of Delta Lake/Delta ...

STEM subject or equivalent experience with strong statistical understanding * Proven experience delivering machine learning models into production environments * Strong Python, SQL and PySpark skills for scalable, production-grade development * Hands-on experience establishing MLOps processes within Databricks * Experience building data pipelines for structured and unstructured data * Strong stakeholder communication ...

. Maintain/implement data warehousing solutions and manage large-scale data storage systems (e.g. Microsoft Fabric) Build and optimise SQL queries, stored procedures, PySpark notebooks and database objects to ensure data performance and reliability. Migrate and modernise legacy databases to cloud-based architectures. Database Administration Administer, monitor … normalisation, indexing, query optimisation). Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse and Medallion architectures. Understanding of API integrations ...

expertise in data processing within a cloud-based data platform. Junior Data Engineer duties: Develop, test, and maintain scalable data pipelines using Python and PySpark within an Azure Databricks development environment Clean, aggregate, and transform complex datasets to meet business requirements. Assist with data quality checks and support data … Junior Data Engineer, you will have: Strong proficiency in Python, particularly for data manipulation and automation scripts; experience in libraries such as pandas, PySpark, numpy, pyodbc or associated would be beneficial Hands-on experience (or academic project experience) using PySpark. An understanding of ETL/ELT processes and/ ...

Data Engineer (Azure) Salary to £55,000 + Bonus Fully Remote or Hybrid This is an exciting opportunity for an Azure Data Engineer with PySpark, Python, and SQL skills (and ideally experience with Databricks) to take the next step in their career. Youll work on greenfield projects, designing … designing and building end-to-end data solutions within an enterprise environment on Microsoft Azure based projects. Good data engineering and database skills, including PySpark , SQL and Azure technologies such as Data Factory, Synapse, Databricks . Experience working with large, event-based datasets, with a solid understanding ...

Our client is an industry leading market-research company who use data-driven insights to provide unique and actionable data for some of the world's most recognised brands. Over the last 12 months they ...

pricing models with advanced data science techniques using WTW Radar and Emblem. Query and engineer large datasets (e.g., Python/R/SQL/PySpark) on modern platforms (e.g., Azure Databricks). Create innovative data solutions and present actionable insights to stakeholders. Communicate results clearly to key decision-makers … Street Pricing. What we're looking for: Experience in general insurance pricing with strong modelling skills. Proficiency in programming languages such as R, Python, PySpark, SAS, or SQL. Good knowledge of Azure Databricks and modern data technologies. Experience with WTW Radar software is preferred. A quantitative degree in Mathematics ...