16 of 16 PySpark Jobs in Manchester

pipelines and working with lakehouse architectures Knowledge of tools such as Azure Data Factory and/or Fabric Data Pipelines Experience with Python or PySpark for data transformation Understanding of data modelling (dimensional modelling, medallion architecture) Strong communication skills and ability to work with non-technical stakeholders Desirable: Experience ...

Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication skills, effectively participating with Senior Stakeholders Nice to haves: Azure/AWS Data Engineering certifications Databricks certifications What ...

business needs Ensure data quality, governance and best practice Key Requirements Strong leadership experience (5+ engineers) Solid Data Engineering/DataOps background Python/PySpark for data pipelines AWS experience (design & deployment) Strong data modelling & warehousing knowledge Agile (Jira/Azure DevOps) experience Get in touch for more details ...

Support production systems and troubleshoot issues Write clean, tested, and maintainable code Tech Stack Python & SQL AWS (EMR, Athena, Lambda) Apache Spark (Scala or PySpark) Big data/distributed processing tools What They’re Looking For Strong experience as a Data Engineer using Python and SQL Experience working with ...

data projects Key Requirements Proven leadership of multiple engineering teams Strong Data Engineering/DataOps background Experience in large, dataheavy environments Python/PySpark for endto-end pipelines Strong AWS experience (design & deployment) Deep knowledge of data modelling, warehousing & lakehouse concepts Strong stakeholder management and communication skills Agile delivery ...

production. Key skills and experience: Strong experience as a Data Engineer Advanced Python and SQL skills Experience with cloud platforms (AWS preferred) Proficiency in PySpark and/or Pandas Familiarity with data quality tools (e.g., Great Expectations) Experience with infrastructure as code (Terraform or CloudFormation) Understanding of modern development ...

will have the following skills and experience: Deep expertise with Azure Databricks, including development, deployment, and platform-level engineering. Strong software engineering capability across Pyspark, Spark SQL and Azure Data Factory. Solid understanding of DevOps practices including CI/CD and automated testing. Experience with monitoring, logging, and alerting ...

Data Engineer; Python, PySpark - Salford, Manchester, Onsite. We are seeking an experienced Data Engineer to join a growing Data Team within a fast-paced, e-commerce-led business that is growing at an astonishing rate. The company operates in the direct-to-consumer retail space, and the role will ...

Kubernetes Experience in creating production grade coding and SOLID programming principles, including test-driven development (TDD) approaches Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Experience in source-control software, e.g., GitHub Proficient at communicating results in a concise manner both verbally and written Experience in data ...

dashboards, DAX, M queries and semantic modelling. Build robust, optimised SQL Server data models and queries. Work within a Databricks environment (SQL/PySpark exposure is beneficial; training provided if needed). Engage directly with business stakeholders to gather requirements, understand challenges and translate them into technical solutions. Support ...

dashboards, DAX, M queries and semantic modelling. Build robust, optimised SQL Server data models and queries. Work within a Databricks environment (SQL/PySpark exposure is beneficial; training provided if needed). Engage directly with business stakeholders to gather requirements, understand challenges and translate them into technical solutions. Support ...

GBMs, GAMs, Random Forests, Neural Networks and clustering techniques Knowledge of statistics and distributions commonly used in insurance Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Proficient at communicating results in a concise manner both verbally and written Behaviours: Motivated by technical excellence Driven to deliver iterative ...

deploying the Lakehouse platform in Azure. Owning Databricks engineering, administration and platform optimisation. Designing end-to-end data platform solutions Leading implementation using Databricks, PySpark, Spark SQL and Azure Data Factory. Creating and maintaining CI/CD pipelines and automated testing frameworks. Developing APIs to support integration Implementing monitoring … logging and alerting for platform reliability. YOUR SKILLS AND EXPERIENCE: Deep expertise in Databricks, PySpark, Python and SQL. Proven experience designing and delivering Lakehouse solutions. Strong DevOps capabilities, including CI/CD and automated testing. Experience with Infrastructure as Code and cloud automation. Familiarity with monitoring, logging and alerting ...

data models within the Lakehouse Owning the transformation from enriched to curated datasets, enabling trusted reporting and insight Developing and maintaining robust SQL and PySpark transformation pipelines in Databricks Embedding data quality, testing, reliability and performance into the curated layer Working closely with data engineers, BI teams and business … Engineer within a modern data platform Excellent data modelling capability, including dimensional and semantic modelling Advanced SQL skills and strong hands on experience with PySpark Experience working with Databricks and Lakehouse architectures A solid grounding in engineering best practices, testing and data quality Confidence mentoring others and taking ownership ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...

business. Design and own analytics data models, transforming data from enriched layers into curated, analytics ready datasets. Develop and maintain robust SQL and PySpark transformations within Databricks. Work closely with data engineers, BI teams and stakeholders to translate complex requirements into trusted reporting. SKILLS AND EXPERIENCE The successful Analytics … following skills and experience: Strong commercial experience as an analytics focused engineer, rather than an analyst. Advanced data modelling capability, including dimensional modelling. Strong PySpark and SQL skills in production environments. Hands on experience with Databricks, including pipelines and governed data environments. A solid grounding in engineering best practices ...