26 to 31 of 31 Apache Spark Jobs in the South East

large-scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward ...

ongoing basis. Contribute to the planning, research, recommendation, and implementation of current and future IT strategies. PERSON SPECIFICATION: Essential Demonstrable experience of Spark (PySpark) and SQL. Demonstrable experience of Fabric components. Demonstrable experience of working on enterprise environments. Experience of designing architectural Fabric processes. Experience of Azure Data Factory. ...

expected. Highly Desirable Background working on public sector, aerospace, or similarly regulated engineering projects. Familiarity with distributed computing and messaging services (such as Spark or Kafka). Experience developing APIs and rapid internal interfaces (such as FastAPI, Flask, Streamlit, or Gradio). Insight into sensor analytics, data synthesis ...

with experience shaping technical direction across teams and stakeholders Solid expertise in relevant technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg or similar table formats, as well ...

Purpose of position Data sits at the heart of the company. This role ensures that Awin can fully leverage the data available across the group, enabling the development of robust reporting capabilities that support stronger ...

quality, integrity, and accuracy of large-scale data processing solutions across cloud-based data platforms, working across ETL testing, data pipeline validation, and Spark-based environments in an Agile delivery team. Key Responsibilities: Design, develop, and execute test cases for data pipelines and ETL processes Validate data quality, integrity … transformation, and migration across systems and environments Develop and execute SQL and PySpark scripts to support data validation activities Perform testing of Spark and Databricks-based data solutions Identify, document, and track defects through to resolution, collaborating with data engineers, developers, and business stakeholders Participate in Agile ceremonies including ...