1 to 25 of 49 PySpark Jobs in the North West

About Pret Pret is an international on-the-go food and drink retailer founded in1986. Our purpose is to make every day a little bit brighter, through organiccoffee, freshly prepared food, and exceptional customer service to millions ofpeople. Pret runs More ❯

building scalable, reliable data pipelines, managing data infrastructure, and supporting data products across various cloud environments, primarily Azure. Key Responsibilities: Develop end-to-end data pipelines using Python, Databricks, PySpark, and SQL. Integrate data from various sources including APIs, Excel, CSV, JSON, and databases. Manage data lakes, warehouses, and lakehouses within Azure cloud environments. Apply data modelling techniques such More ❯

you will be using the latest tools and technologies such as Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Azure DevOps and Terraform alongside languages such as Python, PySpark and SQL. Deploying pipelines through CI/CD practices. You will work with digital, data and technology colleagues collaboratively, taking an innovative and creative approach to deliver key strategic … this data in an accessible and consistent way. To deliver this you will have preferably worked with cloud technologies and have a good level of coding skills (preferably Python, PySpark and SQL). Solutions you deliver should be reusable and scalable with a focus on consistency and maintainability. You will be able to review existing processes and improve them … this data in an accessible and consistent way. To deliver this you will have preferably worked with cloud technologies and have a good level of coding skills (preferably Python, PySpark and SQL). Solutions you deliver should be reusable and scalable with a focus on consistency and maintainability. You will be able to review existing processes and improve them More ❯

collaborate effectively with stakeholders. Desirable: SnowPro certification (Core/Advanced). Experience with GCP (dataflow and BigQuery) Experience with Azure services (Synapse, Data Factory, Logic Apps). Familiarity with PySpark for distributed data processing. Experience creating CI/CD pipelines using tools such as GitHub Actions. Knowledge of Terraform for Infrastructure as Code. Experience working with PostgreSQL or other More ❯

using Azure Synapse, ensuring data integrity and security Build, deploy, and manage ETL processes to support real-time and batch data processing using tooling across the Azure estate, Databricks, PySpark, and SQL Oversee data storage across both relational and non-relational databases, ensuring efficient data retrieval Design and implement data security protocols to safeguard sensitive information Collaborate with DBAs … continuous learning and improvement What we are looking for: 5+ years of experience in data engineering Expertise in Azure DWH and AWS Databricks Strong programming skills in Python/PySpark or other relevant languages for data manipulation and ETL workflows Proficiency in SQL and experience with both relational (e.g., SQL Server, MySQL) and non-relational databases (e.g., MongoDB, Cassandra More ❯

warehouse and data infrastructure to support advanced analytics and reporting needs for a fast-growing organisation. Key Responsibilities: Design, develop, and maintain scalable data pipelines using SQL and Python (PySpark) . Ingest, transform, and curate data from multiple sources into Azure Data Lake and Delta Lake formats. Build and optimize datasets for performance and reliability in Azure Databricks . … to governance policies. Monitor and troubleshoot production jobs and processes. Preferred Skills & Experience: Strong proficiency in SQL for data transformation and performance tuning. Solid experience with Python , ideally using PySpark in Azure Databricks . Hands-on experience with Azure Data Lake Storage Gen2 . Understanding of data warehouse concepts , dimensional modelling , and data architecture . Experience working with Delta More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £50,000 - £77,500 - depending on experience Department: Technology and Data We’re 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has More ❯

About Pret Pret is an international on-the-go food and drink retailer founded in 1986. Our purpose is to make every day a little bit brighter, through organic coffee, freshly prepared food, and exceptional customer service to millions of More ❯

Description We're seeking a talented and motivated Data Platform Engineer to join our Data Platform and Engineering team. Our aim is to deliver a robust platform that enables Machine Learning and analytics to drive indemnity savings, efficiency benefits and More ❯

presentation skills, with the ability to engage both technical and non-technical stakeholders Desirable Criteria Experience with Matillion products and competitive ETL solutions Knowledge of big data technologies (Spark, PySpark), data lakes, and MPP databases (Teradata, Vertica, Netezza) Familiarity with version control tools such as Git, and experience with Python Degree in Computer Science or related field (or equivalent More ❯

commercial, and operations — and this role will have a big say in what we build next. You’ll be responsible for designing and building robust, scalable data pipelines using PySpark, SQL and Databricks — enabling our analytics, BI and data science colleagues to unlock real value across the business. This is a brilliant opportunity for someone who’s passionate about … your expertise further — especially with tools like Databricks. Here’s what will help you thrive in this role: 2–5 years in data engineering or a related field Strong PySpark and advanced SQL skills Practical experience building and maintaining ETL/ELT pipelines in Databricks Familiarity with CI/CD pipelines and version control practices Nice to have: Experience More ❯

commercial, and operations — and this role will have a big say in what we build next. You’ll be responsible for designing and building robust, scalable data pipelines using PySpark, SQL and Databricks — enabling our analytics, BI and data science colleagues to unlock real value across the business. About You You’re a problem-solver who enjoys working collaboratively … strong foundation in data engineering and are ready to grow your expertise further — especially with tools like Databricks. 2–5 years in data engineering or a related field Strong PySpark and advanced SQL skills Practical experience building and maintaining ETL/ELT pipelines in Databricks Familiarity with CI/CD pipelines and version control practices Nice to have: Experience More ❯

enhance cloud capabilities. Key Skills & Experience: Strong proficiency in SQL and Python. Experience in cloud data solutions (AWS, GCP, or Azure). Experience in AI/ML. Experience with PySpark or equivalent. Strong problem-solving and analytical skills. Excellent attention to detail. Ability to manage stakeholder relationships effectively. Strong communication skills and a collaborative approach. Why Join Us? Work More ❯

enhance cloud capabilities. Key Skills & Experience: Strong proficiency in SQL and Python. Experience in cloud data solutions (AWS, GCP, or Azure). Experience in AI/ML. Experience with PySpark or equivalent. Strong problem-solving and analytical skills. Excellent attention to detail. Ability to manage stakeholder relationships effectively. Strong communication skills and a collaborative approach. Why Join Us? Work More ❯

enhance cloud capabilities. Key Skills & Experience: Strong proficiency in SQL and Python. Experience in cloud data solutions (AWS, GCP, or Azure). Experience in AI/ML. Experience with PySpark or equivalent. Strong problem-solving and analytical skills. Excellent attention to detail. Ability to manage stakeholder relationships effectively. Strong communication skills and a collaborative approach. Why Join Us? Work More ❯

enhance cloud capabilities. Key Skills & Experience: Strong proficiency in SQL and Python. Experience in cloud data solutions (AWS, GCP, or Azure). Experience in AI/ML. Experience with PySpark or equivalent. Strong problem-solving and analytical skills. Excellent attention to detail. Ability to manage stakeholder relationships effectively. Strong communication skills and a collaborative approach. Why Join Us? Work More ❯

years in data engineering or backend development focused on data platforms. Strong hands-on experience with AWS services, especially Glue, Athena, Lambda, and S3 . Proficient in Python (ideally PySpark) and modular SQL for transformations and orchestration. Solid grasp of data modeling (partitioning, file formats like Parquet, etc.). Comfort with CI/CD, version control, and infrastructure-as More ❯

years in data engineering or backend development focused on data platforms. Strong hands-on experience with AWS services, especially Glue, Athena, Lambda, and S3 . Proficient in Python (ideally PySpark) and modular SQL for transformations and orchestration. Solid grasp of data modeling (partitioning, file formats like Parquet, etc.). Comfort with CI/CD, version control, and infrastructure-as More ❯

alerts for “Data Engineer” roles. Manchester, England, United Kingdom 1 month ago Manchester, England, United Kingdom 1 month ago Manchester, England, United Kingdom 3 months ago Data Engineer , Python, PySpark, and SQL, AWS Software Engineer (Python) - Data Platform Manchester, England, United Kingdom 1 month ago We’re unlocking community knowledge in a new way. Experts add insights directly into More ❯

two years experience working with moderately complex software systems in production and have a curiosity and interest in learning more. In this role, you will be using python (specifically pyspark) and Node.js for processing data, backed by various Hadoop stack technologies such as HDFS and HBase. MongoDB and Elasticsearch are used for indexing smaller datasets. Airflow & Nifi are used … have at least two years experience working with moderately complex software systems in production and have a curiosity and interest in learning more. You will be using Python (specifically pyspark) and Node.js for processing data You will be using Hadoop stack technologies such as HDFS and HBase Experience using MongoDB and Elasticsearch for indexing smaller datasets would be beneficial More ❯

Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: For airports, for partners, for people. We are CAVU. At CAVU our purpose is to find new and better ways to make More ❯

practices. This is a fantastic opportunity for a curious, solutions-focused data scientist to help build out our capability, working with cutting-edge tools like Databricks, AWS data services, PySpark, and CI/CD pipelines. What's in it for you? You'll be joining a collaborative, supportive team with a real passion for data-led innovation. It's … business impact - we'd love to hear from you. About you: 2-5 years of experience in Data Science or a related field Strong programming skills in Python and PySpark Strong data science modelling skills across classification, regression, forecasting, and/or NLP Analytical mindset with the ability to present insights to both technical and non-technical audiences Experience More ❯

of the listed Data and AI Platforms: Google Cloud Platform, Amazon Web Services, Microsoft Azure, Databricks. Experience in one or more of the listed Languages or Packages: Python, R, Pyspark, Scala, PowerBI, Tableau. Proven experience in successfully delivering multiple complex data rich workstreams in parallel to supporting wider strategic ambitions and supporting others in their teams on their personal More ❯

of the listed Data and AI Platforms: Google Cloud Platform, Amazon Web Services, Microsoft Azure, Databricks. Experience in one or more of the listed Languages or Packages: Python, R, Pyspark, Scala, PowerBI, Tableau. WHAT YOU’LL LOVE ABOUT WORKING HERE? Data Science Consulting brings an inventive quantitative approach to our clients’ biggest business and data challenges to unlock tangible More ❯

Skills and Expertise: Advanced knowledge of Cloud Services (preferably Azure) for data engineering, storage, and analytics. Solid expertise in solution architecture and data modeling. Proficiency in programming languages like PySpark or Python. Strong experience with SQL and NoSQL databases. Deep understanding of data warehousing, virtualization, and analytics concepts. Applying: If you feel you have the required skills for this More ❯