17 of 17 PySpark Jobs in Yorkshire

code analysis for effective quality assurance and to resolve processing issues. Experience of one or more programming/coding languages listed: Python/PySpark, SQL, Proc SQL, NoSQL, MySQL, SQLite, Spark SQL, Hive SQL, PostgreSQL, SAS, SAS E-guide, Scala, RegEx, Java, R Investigate problems in systems, processes ...

storage, data pipelines to ingest and transform data, and querying & reporting of analytical data. You've worked with technologies such as Python, Spark, SQL, Pyspark, PowerBI etc. You’ve got a background in software engineering, including Front End technologies like JavaScript. You’re a problem-solver, pragmatically exploring options ...

Experience: Strong proficiency in SQL and Python. Experience in cloud data solutions (AWS, GCP, or Azure). Experience in AI/ML. Experience with PySpark or equivalent. Strong problem-solving and analytical skills. Excellent attention to detail. Ability to manage stakeholder relationships effectively. Strong communication skills and a collaborative ...

practitioner level. Knowledge Essential Extensive knowledge with integration and transformation within Cloud Data Warehouses (e.g Azure, AWS, GCP) including languages such as Python, SQL, PySpark, Java Knowledge and experience with programming languages such as React, Typescript, Javascript is desirable. Skills and Experience Essential Able to design appropriate solutions with ...

experience. Knowledge Essential Good working knowledge with integration and transformation within Cloud Data Warehouses (e.g Azure, AWS, GCP) including languages such as Python, SQL, PySpark, Java Knowledge and experience with programming languages such as React, Typescript, Javascript is desirable Skills and Experience Essential Can deliver well-scoped work independently ...

specialist area.. Knowledge Essential Extensive knowledge with integration and transformation within Cloud Data Warehouses (e.g Azure, AWS, GCP) including languages such as Python, SQL, PySpark, Java Knowledge and experience with programming languages such as React, Typescript, Javascript is desirable. Skills and Experience Essential Proven ability to use data engineering ...

master data management principles, data quality frameworks and data governance best practices. Understanding of Azure Data Factory, Fabric and similar technologies Tech Stack – Python, PySpark, SQL, Xpath, XML, Azure-based Data Science tools, BI tools, Data Visualisation, Agile. The company have an excellent reputation within their sector and have ...

within NHS England, UK Health Security Agency, Department of Health and Social Care, or another central government data environment (Essential) Solid experience with Python, PySpark, Power BI, and AWS Strong communication skills - able to engage confidently with both technical peers and non-technical clinical or operational stakeholders Available ...

Experience of cloud technologies including AWS, Snowflake, SQL, and Apache Airflow, SQL and programming languages such as PL/SQL and Python, Spark, and Pyspark Good knowledge of modern code development practices Strong communication skills with the ability to proactively engage with a wide range of stakeholders ...

questions. Person Specification Qualifications Essential Degree or equivalent experience. Knowledge Essential Awareness of cloud platforms and data tools including languages such as Python, SQL, PySpark, Java Knowledge and experience with programming languages such as React, Typescript, Javascript is desirable Skills and Experience Essential Delivers tasks with guidance Writes maintainable ...

qualification in Computer Science, AI, Data Science, or related fields. Strong knowledge of AI, machine learning, deep learning, and probabilistic modeling. Proficient in Python, PySpark, data modeling, and microservices. Experience in MLOps, AI lifecycle management, and LLM orchestration on cloud platforms (AWS, GCP, Azure). Familiar with DevOps tools ...

Senior Data Engineer| AWS/Databricks/PySpark | London/Glasgow (Hybrid) | August Start Role: Senior Data Engineer Location: This is a hybrid engagement represented by 2 days/week onsite, either in Central London or Glasgow. Start Date: Must be able to start mid-August. Salary … design. Requirements Proven experience as a Data Engineer in cloud-first environments. Strong commercial knowledge of AWS services (e.g. S3, Glue, Redshift). Advanced PySpark and Databricks experience (Delta Lake, Unity Catalog, Databricks Jobs etc). Proficient in SQL (T-SQL/SparkSQL) and Python for data transformation ...

Data Software Engineer (Python PySpark) Remote UK to £95k Are you a data savvy Software Engineer with strong Python coding skills? You could be progressing your career in a senior, hands-on Data Software Engineer role as part of a friendly and supportive international team at a growing … About you: You are degree educated in a relevant discipline, e.g. Computer Science, Mathematics You have a software engineering background with advanced Python and PySpark coding skills You have experience in batch, distributed data processing and near real-time streaming data pipelines with technologies such as Kafka You have ...

maintain ETL/ELT pipelines and data models in Fabric (Data Factory, Notebooks, Spark) Write high-performance Spark SQL, T-SQL, Python/PySpark Manage ingestion, transformation, and loading from multiple sources Translate stakeholder requirements into scalable technical solutions Mentor team members and establish engineering standards, security, and governance … assisted development tools like GitHub Copilot, ChatGPT, and Fabric CopilotEssential Experience: Microsoft Fabric is essential Azure Data ecosystem Lakehouse architectures & Data Factory Python, PySpark, Spark SQL Proven hands-on delivery in this stackIf you're an experienced Data Engineer with s... ...

maintain ETL/ELT pipelines and data models in Fabric (Data Factory, Notebooks, Spark) Write high-performance Spark SQL, T-SQL, Python/PySpark Manage ingestion, transformation, and loading from multiple sources Translate stakeholder requirements into scalable technical solutions Mentor team members and establish engineering standards, security, and governance … assisted development tools like GitHub Copilot, ChatGPT, and Fabric Copilot Essential Experience: Microsoft Fabric is essential Azure Data ecosystem Lakehouse architectures & Data Factory Python, PySpark, Spark SQL Proven hands-on delivery in this stack If you're an experienced Data Engineer with strong Microsoft Fabric and Azure experience, this ...

Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using … Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must ...

finish, guaranteeing that datasets are robust, tested, secure, and business-ready. Our data platform is built using Databricks, with data pipelines written in PySpark and orchestrated using Airflow. You will be expected to challenge and improve current transformations, ensuring they meet our performance, scalability, and data governance needs. This … meaningful collaboration in either Leeds or Thame. Key Responsibilities Ensure end-to-end data quality, from raw ingested data to business-ready datasets Optimise PySpark-based data transformation logic for performance and reliability Build scalable and maintainable pipelines in Databricks and Airflow Implement and uphold GDPR-compliant processes around ...