6 of 6 PySpark Jobs in Manchester

with Distributed computing frameworks knowledge: Hive/Hadoop, Apache Spark, Kafka, Airflow Working with programming languages Python , Java, SQL. Working on building ETL (Extraction Transformation and Loading) solution using PySpark Experience in SQL/NoSQL database design Deep understanding in software architecture, object oriented design principles, and data structures Extensive experience in developing microservices using Java, Python Good experience More ❯

Enhanced Maternity & Paternity Charity Volunteer Days Cycle to work scheme And More.. DATA ENGINEER – ESSTENTIAL SKILLS Proven experience building data pipelines using Databricks . Strong understanding of Apache Spark (PySpark or Scala) and Structured Streaming . Experience working with Kafka (MSK) and handling real-time data . Good knowledge of Delta Lake/Delta Live Tables and the Medallion More ❯

a blend of the following: Strong knowledge of AWS data services (Glue, S3, Lambda, Redshift, etc.) Solid understanding of ETL processes and data pipeline management Proficiency in Python and PySpark Experience working with SQL-based platforms Previous involvement in migrating on-premise solutions to cloud is highly desirable Excellent collaboration skills and ability to mentor others The Benefits: Salary More ❯

within a cross-functional environment. Experience in line management or team leadership, with a track record of developing and supporting engineers. AWS (Lambda, Glue, ECS, S3, etc.) Python and PySpark (data pipelines, APIs, automation) TypeScript and React (frontend development) Excellent communication and stakeholder management skills. Demonstrated expertise in technical design and architecture of distributed systems. Familiarity with fraud detection More ❯

within a cross-functional environment. Experience in line management or team leadership, with a track record of developing and supporting engineers. AWS?(Lambda, Glue, ECS, S3, etc.) Python and PySpark?(data pipelines, APIs, automation) TypeScript and React?(frontend development) Excellent communication and stakeholder management skills. Demonstrated expertise in technical design and architecture of distributed systems. Familiarity with fraud detection More ❯

Engineer Location: Manchester (hybrid) Type: Permanent Must have skills Working with AWS cloud services to manage and process data. Using AWS Glue for building and running data pipelines. Writing PySpark code in Python, along with SQL, to handle big data processing. Creating and running SQL queries to analyze and manage data More ❯