17 of 17 PySpark Jobs in Manchester

quality and security best practices Excellent stakeholder management and communication skills Experience operating within Agile delivery environments Desirable Experience Microsoft Fabric Power BI development PySpark REST API integrations Lakehouse architectures AI and Machine Learning platforms Retrieval Augmented Generation (RAG) Vector databases Generative AI solutions Power Platform technologies Data transformation ...

data lineage. Experience managing compute across Fabric and Databricks environments. CI/CD knowledge using Azure DevOps, GitHub, and Databricks Asset Bundles. Proficiency in PySpark, Databricks SQL, T‐SQL, and Delta Lake internals. Strong understanding of Medallion Architecture and modern data modelling (Star Schema, Data Vault 2.0). Experience ...

data providers-ensuring data is reliable, auditable, and delivered at scale. Data Engineer Responsibilities Act as the subject matter expert across ADF, Databricks, Python, PySpark, and Spark SQL Manage the daily ingestion and processing of raw data into enterprise data platforms Collaborate with the wider team to define data ...

genuinely influence engineering direction within a scaling business What they’re looking for 👇 😍 Strong hands-on Data Engineering experience across Python, Spark, SQL and PySpark 😍 Experience working with hyperscaler cloud platforms such as AWS, Azure or GCP 😍 Exposure to modern tooling including Databricks, Microsoft Fabric and PowerBI 😍 Previous experience ...

someone who combines strong engineering capability with a solid understanding of the cyber domain. Key skills required: Strong Python development experience Databricks and PySpark expertise Experience with cloud-based data platforms (AWS, Azure and/or GCP) Data Engineering and analytics at scale Apache Spark ecosystems Cyber Security ...

making Your Skills and Experience Strong commercial experience as a data engineer in modern, cloud based environments Advanced Python and SQL, with experience using PySpark or similar distributed processing frameworks Experience building and maintaining data pipelines in AWS using services such as S3, Glue or EKS Hands on experience ...

Kubernetes Experience in creating production grade coding and SOLID programming principles, including test-driven development (TDD) approaches Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Experience in source-control software, e.g., GitHub Proficient at communicating results in a concise manner both verbally and written Experience in data ...

qualification in Computer Science, AI, Data Science, or related fields. Strong knowledge of AI, machine learning, deep learning, and probabilistic modeling. Proficient in Python, PySpark, data modeling, and microservices. Experience in MLOps, AI lifecycle management, and LLM orchestration on cloud platforms (AWS, GCP, Azure). Familiar with DevOps tools ...

Data Engineer; Python, PySpark - Salford, Onsite. Be part of a retail phenomenon! This is a brand new role at a company experiencing huge growth, offering a lot of autonomy and the opportunity to grow as the company grows. My client is seeking an experienced Data Engineer to join ...

Snowflake optimised query design and features such as materialized views Knowledge of snowpark, or transferable knowledge from other dataframe based frameworks such as PySpark Experience implementing batch data ingestion pipelines using technologies such as Azure Data Factory, Openflow or similar Experience delivering data solutions on Snowflake hosted in Microsoft ...

Snowflake‐optimised query design and features such as materialized views Knowledge of snowpark, or transferable knowledge from other dataframe‐based frameworks such as PySpark Experience implementing batch data ingestion pipelines using technologies such as Azure Data Factory, Openflow or similar Experience delivering data solutions on Snowflake hosted in Microsoft ...

Collaborative office environment with regular social and charity events And Much More!!! DATA ENGINEER - ESSTENTIAL SKILLS Strong experience with Databricks and Apache Spark (PySpark or Scala) Experience building streaming and batch pipelines using Spark Structured Streaming Hands-on experience with Kafka (MSK) and real-time data ingestion Strong understanding … submit (subject to required skills) your application to our client in conjunction with this vacancy only. KEY SKILLS Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data ...

GBMs, GAMs, Random Forests, Neural Networks and clustering techniques Knowledge of statistics and distributions commonly used in insurance Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Proficient at communicating results in a concise manner both verbally and written Behaviours: Motivated by technical excellence Driven to deliver iterative ...

Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client is a global innovator and world leader … with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience is also key, as are excellent communication skills ...

Engineer (AWS) - Manchester (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with … with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience is also key, as are excellent communication skills ...

data warehousing solutions Improve data quality, performance & scalability Partner with Data Science & Analytics teams Tech stack: AWS (Glue, Lambda, S3, Redshift, EMR) Python, SQL, PySpark Modern ETL/orchestration tools What we’re looking for: Strong AWS data engineering experience Solid Python & SQL skills Experience with large-scale data … pipelines & PySpark Good understanding of data warehousing/lakehouse concepts This would be a great role for someone who enjoys building scalable data platforms and solving complex data challenges in a collaborative environment. Candidates must be within a commutable distance of the location as well as full right ...

Data Engineer | AWS | PySpark | 📍 Manchester City Centre (Hybrid) up to £60,000 base + 10% Bonus + Benefits One of the North West's most recognisable technology businesses is continuing to invest heavily in its Data Engineering capability and modern cloud data platform. They're looking for a Data … modern AWS environment. This is an opportunity to work on a platform used by millions of customers, whilst gaining exposure to technologies including AWS, PySpark, Iceberg, Redshift, Glue and Lambda. The role sits within a growing team and has a clear progression path into a Senior Data Engineer position ...