23 of 23 PySpark Jobs in the North of England

integration, and the software development lifecycle (SDLC). Hands-on experience with big data frameworks such as Spark, Hadoop, or Hive, including derivatives like PySpark (preferred), Spark Scala, or Spark SQL, along with familiarity with development-accelerating libraries and frameworks. Experience using data modelling tools such as ERwin ...

quality and security best practices Excellent stakeholder management and communication skills Experience operating within Agile delivery environments Desirable Experience Microsoft Fabric Power BI development PySpark REST API integrations Lakehouse architectures AI and Machine Learning platforms Retrieval Augmented Generation (RAG) Vector databases Generative AI solutions Power Platform technologies Data transformation ...

Methodology, Master Data Services, Data Quality (DQ), Purview * Azure Data Lake, Azure Data Factory, Logic Apps, Azure Databricks, Azure Functions, Azure Synapse * Python, Scala, PySpark * SharePoint, PowerPivot, Power BI, Data integration layers, Database and storage models, Delta loading, External data loads Desirable Experience * PowerShell scripting, Agile delivery environments ...

practitioner level. Knowledge Essential Extensive knowledge with integration and transformation within Cloud Data Warehouses (e.g Azure, AWS, GCP) including languages such as Python, SQL, PySpark, Java Knowledge and experience with programming languages such as React, Typescript, Javascript is desirable. Skills and Experience Essential Able to design appropriate solutions with ...

experience. Knowledge Essential Good working knowledge with integration and transformation within Cloud Data Warehouses (e.g Azure, AWS, GCP) including languages such as Python, SQL, PySpark, Java Knowledge and experience with programming languages such as React, Typescript, Javascript is desirable Skills and Experience Essential Can deliver well-scoped work independently ...

Builder or Code Repositories. Experience with Delta Lake, Parquet, Iceberg, CSV and JSON. Data governance, lineage, secure data-sharing and access approval experience. Python, PySpark or SQL development experience. CI/CD experience using GitLab, GitHub Actions, Azure DevOps or similar. Key Deliverables Configured and validated Foundry Databricks connector. ...

someone who combines strong engineering capability with a solid understanding of the cyber domain. Key skills required: Strong Python development experience Databricks and PySpark expertise Experience with cloud-based data platforms (AWS, Azure and/or GCP) Data Engineering and analytics at scale Apache Spark ecosystems Cyber Security ...

within NHS England, UK Health Security Agency, Department of Health and Social Care, or another central government data environment (Essential) Solid experience with Python, PySpark, Power BI, and AWS Strong communication skills - able to engage confidently with both technical peers and non-technical clinical or operational stakeholders Available ...

motivated and analytical individual to join their team as a Data Analyst Apprentice. Role Develop and maintain scalable data solutions within Microsoft Fabric using PySpark, Python, and SQL to cleanse, validate, transform, and automate business data processes across multiple datasets Create and manage Power BI reports and dashboards within ...

Kubernetes Experience in creating production grade coding and SOLID programming principles, including test-driven development (TDD) approaches Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Experience in source-control software, e.g., GitHub Proficient at communicating results in a concise manner both verbally and written Experience in data ...

questions. Person Specification Qualifications Essential Degree or equivalent experience. Knowledge Essential Awareness of cloud platforms and data tools including languages such as Python, SQL, PySpark, Java Knowledge and experience with programming languages such as React, Typescript, Javascript is desirable Skills and Experience Essential Delivers tasks with guidance Writes maintainable ...

qualification in Computer Science, AI, Data Science, or related fields. Strong knowledge of AI, machine learning, deep learning, and probabilistic modeling. Proficient in Python, PySpark, data modeling, and microservices. Experience in MLOps, AI lifecycle management, and LLM orchestration on cloud platforms (AWS, GCP, Azure). Familiar with DevOps tools ...

qualification in Computer Science, AI, Data Science, or related fields. Strong knowledge of AI, machine learning, deep learning, and probabilistic modeling. Proficient in Python, PySpark, data modeling, and microservices. Experience in MLOps, AI lifecycle management, and LLM orchestration on cloud platforms (AWS, GCP, Azure). Familiar with DevOps tools ...

Data Engineer; Python, PySpark - Salford, Onsite. Be part of a retail phenomenon! This is a brand new role at a company experiencing huge growth, offering a lot of autonomy and the opportunity to grow as the company grows. My client is seeking an experienced Data Engineer to join ...

mentoring, and peer-reviewing the work of junior colleagues. What We Are Looking For The Core Tech Stack: Advanced proficiency in Python (most critical), PySpark, SQL, and Snowflake. Experimentation Expertise: Strong, demonstrable working knowledge of experiment design, A/B testing methodologies, and randomisation. Data Visualisation: Expert capability ...

team What We're Looking For Proven experience in Data Analytics or a similar role Strong SQL skills and experience with Python/PySpark Experience with data visualisation tools (e.g. Tableau, Power BI) Hands-on experience with A/B testing and experimentation Familiarity with customer analytics tools (e.g. ...

hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well-governed data assets … data programme - designing, building, and maintaining data pipelines that process large volumes of data across a modern AWS-native stack. Using Apache Spark and PySpark for distributed data processing, Apache Airflow for orchestration, and a range of AWS services for storage, compute, and analytics, you will help deliver reliable ...

ACCA/CIMA Qualified Experience in a Systems Accountant role Experience in using PowerBI/Microsoft Fabric an advantage Experience in using SQL/PySpark beneficial Strong Excel skills Driven to improve processes and clarity of outputs Strong communicator and able to engage with key internal and external stakeholders ...

Collaborative office environment with regular social and charity events And Much More!!! DATA ENGINEER - ESSTENTIAL SKILLS Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands-on experience with Kafka (MSK) and real-time data ingestion Strong understanding … submit (subject to required skills) your application to our client in conjunction with this vacancy only. KEY SKILLS Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data ...

GBMs, GAMs, Random Forests, Neural Networks and clustering techniques Knowledge of statistics and distributions commonly used in insurance Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Proficient at communicating results in a concise manner both verbally and written Behaviours: Motivated by technical excellence Driven to deliver iterative ...

Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client is a global innovator and world leader … with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience is also key, as are excellent communication skills ...

design and implementation of modern data lakehouse and data warehousing architectures. Build and optimise real-time and batch data processing solutions using PySpark and related technologies. Collaborate with Data Scientists, Analysts, and business stakeholders to deliver data-driven solutions. Stay current with emerging technologies and industry best practices. Provide … Lambda, S3, Redshift, and EMR. Proven experience building and maintaining data pipelines and ETL frameworks. Strong Python and SQL development skills. Experience working with PySpark and large-scale data processing environments. Solid understanding of data warehousing concepts and best practices. Experience working within Agile delivery environments. Understanding of data ...

actions, this could be a great fit. What you'll be doing ✨ Investigating production data to identify issues, anomalies, and trends ✨ Using SQL and PySpark to explore data, validate assumptions, and uncover root causes ✨ Supporting data scientists and engineers with queries, investigations, and data related challenges ✨ Gathering requirements through … Experience working as a Business Analyst in a data focused environment ✔ Strong SQL skills and confidence working directly with production data ✔ Exposure to PySpark or large scale data platforms ✔ Excellent stakeholder engagement and communication skills ✔ Experience working within regulated or highly governed environments ✔ Someone who enjoys problem solving, digging ...