21 of 21 PySpark Jobs in Manchester

Have: 8+ years’ experience in data engineering and 1+ experience as Lead Data Engineer Proven expertise with Microsoft Azure Strong proficiency in Databricks with hands-on Scala (Spark) and PySpark . Expertise in Databricks for large-scale data engineering and analytics workloads. Design and implement scalable data architectures using Databricks Unity Catalog, Delta Lake, and Apache Spark Implement advanced More ❯

Have: 8+ years’ experience in data engineering and 1+ experience as Lead Data Engineer Proven expertise with Microsoft Azure Strong proficiency in Databricks with hands-on Scala (Spark) and PySpark . Expertise in Databricks for large-scale data engineering and analytics workloads. Design and implement scalable data architectures using Databricks Unity Catalog, Delta Lake, and Apache Spark Implement advanced More ❯

knowledge sharing sessions and self-development. About You Experience with finance/financial systems and concepts Azure Databricks Azure Data Factory Excellent SQL skills Good Python/Spark/pyspark skills Experience of Kimball Methodology and star schemas (dimensional model). Experience of working with enterprise data warehouse solutions. Experience of working with structured and unstructured data Experience of More ❯

Deliver end-to-end BI solutions using Azure Synapse, ADF, and Power BI (Datasets & Reports) Design and implement scalable data models and architectures Develop robust pipelines using SQL, Python (PySpark), and ideally other OOP languages Manage CI/CD processes using Git and modern deployment tools Debug, monitor, and optimize BI solutions across Microsoft's stack, including legacy tools More ❯

Deliver end-to-end BI solutions using Azure Synapse, ADF, and Power BI (Datasets & Reports) Design and implement scalable data models and architectures Develop robust pipelines using SQL, Python (PySpark), and ideally other OOP languages Manage CI/CD processes using Git and modern deployment tools Debug, monitor, and optimize BI solutions across Microsoft's stack, including legacy tools More ❯

front-end development (HTML, Stream-lit, Flask.) Familiarity with model deployment and monitoring in cloud environments (AWS). Understanding of machine learning lifecycle and data pipelines. Proficiency with Python, Pyspark, Big-data ecosystems Hands-on experience with MLOps tools (e.g., MLflow, Airflow, Docker, Kubernetes) Secondary Skill : Experience with RESTful APIs and integrating backend services ABOUT CAPGEMINI Capgemini is a More ❯

front-end development (HTML, Stream-lit, Flask.) Familiarity with model deployment and monitoring in cloud environments (AWS). Understanding of machine learning lifecycle and data pipelines. Proficiency with Python, Pyspark, Big-data ecosystems Hands-on experience with MLOps tools (e.g., MLflow, Airflow, Docker, Kubernetes) Secondary Skill : Experience with RESTful APIs and integrating backend services ABOUT CAPGEMINI Capgemini is a More ❯

Azure. Especially Synapse, ADF and Power BI (Datasets and Reports). Ideally SSIS, SSRS, SSAS with some understanding of Power App design and delivery Proficient in SQL and Python (PySpark) languages Understanding of data modelling concepts Experience of working with code management & deployment tools Proficient in debugging, monitoring, tuning and troubleshooting BI solutions. Knowledge and a proven track record More ❯

with deploying services in Docker and Kubernetes Experience in creating production grade coding and SOLID programming principles, including test-driven development (TDD) approaches Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Experience in source-control software, e.g., GitHub Proficient at communicating results in a concise manner both verbally and written Experience in data and model monitoring is More ❯

with deploying services in Docker and Kubernetes Experience in creating production grade coding and SOLID programming principles, including test-driven development (TDD) approaches Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Experience in source-control software, e.g., GitHub Proficient at communicating results in a concise manner both verbally and written Experience in data and model monitoring is More ❯

understanding of AI/ML/DL and Statistics, as well as coding proficiency using related open source libraries and frameworks. Significant proficiency in SQL and languages like Python, PySpark and/or Scala. Can lead, work independently as well as play a key role in a team. Good communication and interpersonal skills for working in a multicultural work More ❯

financial services or a related sector, with exposure to portfolio or risk analysis. Desirable Experience working in cloud environments such as AWS. Familiarity with distributed data frameworks such as PySpark for handling large-scale data. Understanding of marketing and digital channels, and how their performance is measured. Experience with CRM systems or customer data platforms. Background in financial services More ❯

financial services or a related sector, with exposure to portfolio or risk analysis. Desirable Experience working in cloud environments such as AWS. Familiarity with distributed data frameworks such as PySpark for handling large-scale data. Understanding of marketing and digital channels, and how their performance is measured. Experience with CRM systems or customer data platforms. Background in financial services More ❯

Health & Safety. About You: Here’s what we’re looking for: · Proficiency in Python and SQL for analysis, model development, and data interrogation. · Experience in handling large datasets with PySpark and managing distributed data processing. · Comfortable deploying statistical or ML models into production environments. · Strong understanding of cloud infrastructure, preferably AWS. · A methodical, problem-solving mindset with high attention More ❯

Health & Safety. About You: Here’s what we’re looking for: · Proficiency in Python and SQL for analysis, model development, and data interrogation. · Experience in handling large datasets with PySpark and managing distributed data processing. · Comfortable deploying statistical or ML models into production environments. · Strong understanding of cloud infrastructure, preferably AWS. · A methodical, problem-solving mindset with high attention More ❯

Knowledge of the technical differences between different packages for some of these model types would be an advantage. Experience in statistical and data science programming languages (e.g. R, Python, PySpark, SAS, SQL) A good quantitative degree (Mathematics, Statistics, Engineering, Physics, Computer Science, Actuarial Science) Experience of WTW's Radar software is preferred Proficient at communicating results in a concise More ❯

s passionate about building scalable, cloud-native data platforms. You'll be a key player in a growing team, helping to shape the future of data infrastructure using AWS, PySpark, Iceberg, and more. From designing high-performance pipelines to supporting a full-scale migration from SQL Server to AWS, this role offers the chance to work on real-time … practices Staying ahead of the curve with emerging data technologies What You'll Bring: Solid hands-on experience with AWS (Glue, Lambda, S3, Redshift, EMR) Strong Python, SQL, and PySpark skills Deep understanding of data warehousing and lakehouse concepts Problem-solving mindset with a focus on performance and scalability Excellent communication skills across technical and non-technical teams Familiarity More ❯

alerting systems to maintain data health and accuracy Define KPIs and thresholds in collaboration with technical and non-technical stakeholders Develop and productionise machine learning and statistical models (Python, PySpark) Deploy monitoring solutions on AWS infrastructure Create scalable frameworks for future monitoring needs Investigate anomalies and ensure quick resolution of issues in the data pipeline Advocate for data quality … best practices across the business Provide mentorship and contribute to a culture of continuous improvement About You: Proficient in Python and SQL Experience working with large datasets, preferably using PySpark Solid understanding of AWS or similar cloud infrastructure Methodical, detail-oriented, and comfortable working independently Able to translate business needs into technical solutions Previous experience building monitoring or data More ❯

reporting for various business departments. Utilising modern AWS Services and cutting-edge technology to push the scope of data processes and enable the adoption of future tech. Technology: Python, Pyspark, SQL, AWS Salary: £50,000 + bonus Location/Hybrid: 2 days per week to Central Manchester (M2) Requirements: Strong experience with Python and PySpark Strong knowledge and More ❯

reporting for various business departments. Utilising modern AWS Services and cutting-edge technology to push the scope of data processes and enable the adoption of future tech. Technology: Python, Pyspark, SQL, AWS Salary: £50,000 + bonus Location/Hybrid: 2 days per week to Central Manchester (M2) Requirements: Strong experience with Python and PySpark Strong knowledge and More ❯

data quality initiatives across multiple teams and projects. Must-have skills and experience: Proficiency in Python and SQL for analytical modelling, data interrogation, and scripting Hands-on experience with PySpark and distributed data processing at scale Production deployment of statistical or machine learning models Cloud infrastructure experience , preferably with AWS Methodical problem-solving mindset with exceptional attention to detail … monitoring and alerting systems across data platforms Collaborating with stakeholders to define relevant metrics, thresholds, and KPIs Building and maintaining production-level statistical and ML models using Python and PySpark Deploying solutions within AWS cloud infrastructure Developing scalable frameworks to support future monitoring needs across departments Investigating and resolving data anomalies and pipeline irregularities Driving data quality standards and More ❯