3 of 3 Permanent Apache Spark Jobs in Manchester

Development Opportunities Enhanced Maternity & Paternity Charity Volunteer Days Cycle to work scheme And More.. DATA ENGINEER - ESSTENTIAL SKILLS Proven experience building data pipelines using Databricks . Strong understanding of Apache Spark (PySpark or Scala) and Structured Streaming . Experience working with Kafka (MSK) and handling real-time data . Good knowledge of Delta Lake/Delta Live Tables More ❯

consulting firm specializing in Big Data Engineers. Currently, we are in pursuit of a highly proficient Big Data Engineer. Requirements Strong experience with big data technologies such as Hadoop, Spark, and Kafka. Experience building and optimizing data pipelines, architectures, and data sets. Proficiency in programming languages such as Java, Scala, or Python. In-depth knowledge of distributed file systems More ❯

Google Cloud, Databricks) are a strong plus Technical Skills: • Proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL) • Familiarity with data pipeline and workflow management tools (e.g., Apache Airflow) • Experience with programming languages such as Python, Java, or Scala. Python is highly preferred • Basic understanding of cloud platforms and services (e.g., AWS, Azure, Google Cloud) • Knowledge of … big data technologies (e.g., Spark) is a plus Analytical Skills: • Strong problem-solving skills and attention to detail • Ability to analyse data sets and identify patterns or anomalies Soft Skills: • Excellent communication and teamwork skills, with a collaborative mindset. • Eagerness to learn, adapt to new technologies, and grow within the data engineering field. • Ability to manage multiple tasks effectively More ❯