21 of 21 PySpark Jobs in Manchester

code analysis for effective quality assurance and to resolve processing issues. Experience of one or more programming/coding languages listed: Python/PySpark, SQL, Proc SQL, NoSQL, MySQL, SQLite, Spark SQL, Hive SQL, PostgreSQL, SAS, SAS E-guide, Scala, RegEx, Java, R Investigate problems in systems, processes ...

quality and security best practices Excellent stakeholder management and communication skills Experience operating within Agile delivery environments Desirable Experience Microsoft Fabric Power BI development PySpark REST API integrations Lakehouse architectures AI and Machine Learning platforms Retrieval Augmented Generation (RAG) Vector databases Generative AI solutions Power Platform technologies Data transformation ...

storage, data pipelines to ingest and transform data, and querying & reporting of analytical data. You've worked with technologies such as Python, Spark, SQL, Pyspark, PowerBI etc. You’ve got a background in software engineering, including Front End technologies like JavaScript. You’re a problem-solver, pragmatically exploring options ...

Methodology, Master Data Services, Data Quality (DQ), Purview * Azure Data Lake, Azure Data Factory, Logic Apps, Azure Databricks, Azure Functions, Azure Synapse * Python, Scala, PySpark * SharePoint, PowerPivot, Power BI, Data integration layers, Database and storage models, Delta loading, External data loads Desirable Experience * PowerShell scripting, Agile delivery environments ...

data lineage. Experience managing compute across Fabric and Databricks environments. CI/CD knowledge using Azure DevOps, GitHub, and Databricks Asset Bundles. Proficiency in PySpark, Databricks SQL, T‐SQL, and Delta Lake internals. Strong understanding of Medallion Architecture and modern data modelling (Star Schema, Data Vault 2.0). Experience ...

someone who combines strong engineering capability with a solid understanding of the cyber domain. Key skills required: Strong Python development experience Databricks and PySpark expertise Experience with cloud-based data platforms (AWS, Azure and/or GCP) Data Engineering and analytics at scale Apache Spark ecosystems Cyber Security ...

Experience of cloud technologies including AWS, Snowflake, SQL, and Apache Airflow, SQL and programming languages such as PL/SQL and Python, Spark, and Pyspark Good knowledge of modern code development practices Strong communication skills with the ability to proactively engage with a wide range of stakeholders ...

lifecycle Collaborating across squads and upskilling within the Databricks ecosystem YOUR SKILLS AND EXPERIENCE: You will bring strong capability in: Python development Databricks Azure PySpark Understanding of data engineering principles A proactive, growth-mindset approach with strong collaboration skills THE BENEFITS: You will receive a salary ...

Kubernetes Experience in creating production grade coding and SOLID programming principles, including test-driven development (TDD) approaches Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Experience in source-control software, e.g., GitHub Proficient at communicating results in a concise manner both verbally and written Experience in data ...

qualification in Computer Science, AI, Data Science, or related fields. Strong knowledge of AI, machine learning, deep learning, and probabilistic modeling. Proficient in Python, PySpark, data modeling, and microservices. Experience in MLOps, AI lifecycle management, and LLM orchestration on cloud platforms (AWS, GCP, Azure). Familiar with DevOps tools ...

supporting growth and knowledge sharing across the team What They're Looking For Strong hands-on data engineering experience within a complex environment Advanced PySpark expertise (essential) Solid experience working with AWS data services (e.g. S3, Glue, Redshift, Lambda) Proven track record working on large-scale data platform ...

mentoring, and peer-reviewing the work of junior colleagues. What We Are Looking For The Core Tech Stack: Advanced proficiency in Python (most critical), PySpark, SQL, and Snowflake. Experimentation Expertise: Strong, demonstrable working knowledge of experiment design, A/B testing methodologies, and randomisation. Data Visualisation: Expert capability ...

Snowflake‐optimised query design and features such as materialized views Knowledge of snowpark, or transferable knowledge from other dataframe‐based frameworks such as PySpark Experience implementing batch data ingestion pipelines using technologies such as Azure Data Factory, Openflow or similar Experience delivering data solutions on Snowflake hosted in Microsoft ...

team What We're Looking For Proven experience in Data Analytics or a similar role Strong SQL skills and experience with Python/PySpark Experience with data visualisation tools (e.g. Tableau, Power BI) Hands-on experience with A/B testing and experimentation Familiarity with customer analytics tools (e.g. ...

Senior Data Engineer| AWS/Databricks/PySpark | London/Glasgow (Hybrid) | August Start Role: Senior Data Engineer Location: This is a hybrid engagement represented by 2 days/week onsite, either in Central London or Glasgow. Start Date: Must be able to start mid-August. Salary … design. Requirements Proven experience as a Data Engineer in cloud-first environments. Strong commercial knowledge of AWS services (e.g. S3, Glue, Redshift). Advanced PySpark and Databricks experience (Delta Lake, Unity Catalog, Databricks Jobs etc). Proficient in SQL (T-SQL/SparkSQL) and Python for data transformation ...

ACCA/CIMA Qualified Experience in a Systems Accountant role Experience in using PowerBI/Microsoft Fabric an advantage Experience in using SQL/PySpark beneficial Strong Excel skills Driven to improve processes and clarity of outputs Strong communicator and able to engage with key internal and external stakeholders ...

Collaborative office environment with regular social and charity events And Much More!!! DATA ENGINEER - ESSTENTIAL SKILLS Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands-on experience with Kafka (MSK) and real-time data ingestion Strong understanding … submit (subject to required skills) your application to our client in conjunction with this vacancy only. KEY SKILLS Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data ...

GBMs, GAMs, Random Forests, Neural Networks and clustering techniques Knowledge of statistics and distributions commonly used in insurance Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Proficient at communicating results in a concise manner both verbally and written Behaviours: Motivated by technical excellence Driven to deliver iterative ...

Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client is a global innovator and world leader … with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience is also key, as are excellent communication skills ...

Data Architect (Databricks or Microsoft Fabric) £110,000–£125,000 Hybrid – 2 days a week in London, Manchester, or Edinburgh We’re looking for a twoexperienced Data Architects to design and deliver modern, scalable data ...

finish, guaranteeing that datasets are robust, tested, secure, and business-ready. Our data platform is built using Databricks, with data pipelines written in PySpark and orchestrated using Airflow. You will be expected to challenge and improve current transformations, ensuring they meet our performance, scalability, and data governance needs. This … meaningful collaboration in either Leeds or Thame. Key Responsibilities Ensure end-to-end data quality, from raw ingested data to business-ready datasets Optimise PySpark-based data transformation logic for performance and reliability Build scalable and maintainable pipelines in Databricks and Airflow Implement and uphold GDPR-compliant processes around ...