9 of 9 Parquet Jobs in the UK excluding London

data integration components and services, including Java-based microservices where required Prepare, transform and validate structured and semi-structured data, including formats such as parquet, avro and JSON Write efficient SQL to query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse ...

data integration components and services, including Java-based microservices where required Prepare, transform and validate structured and semi-structured data, including formats such as parquet, avro and JSON Write efficient SQL to query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse ...

troubleshooting. Supporting + maintaining production data pipelines, including incident investigation, safe recovery, root cause analysis + permanent remediation. Experience of Spark SQL, Delta Lake, Parquet + Hive metastore tables, including schemas, partitions and the relationship between table metadata and underlying files. Hands-on AWS experience, particularly ...

troubleshooting. Supporting + maintaining production data pipelines, including incident investigation, safe recovery, root cause analysis + permanent remediation. Experience of Spark SQL, Delta Lake, Parquet + Hive metastore tables, schemas, partitions and the relationship between table metadata and underlying files. Hands-on AWS experience, particularly S3, IAM and CloudWatch ...

sources Knowledge of Azure DevOps, repositories and CI/CD pipelines. Desirable Skills: C#/.NET development experience. Bash/Linux. Azure Blob Storage, Parquet, DuckDB and bulk data loading. SSDT/DACPAC. Experience migrating legacy systems into modern cloud platforms. Experience with containerisation and API-based integrations. Familiarity ...

Learning – Understanding of AI/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications • Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications • Advanced Data Management – Strong SQL design, query optimization ...

evaluation sets. Where relevant, develop your knowledge of custom agent and pipeline tooling, data-processing libraries such as Polars or pandas, and columnar or Parquet-based storage, assessing their usefulness against the problem being solved. Product & Business Understanding: Align your work with YAGROs business objectives and customer needs, contributing ...

modern data stack, building data ingestion pipelines and working with ETL and orchestration tools (e.g., Airflow, Luigi, Argo, dbt), big data technologies (Spark, Kafka, Parquet), and web frameworks for model serving (e.g. Flask or FastAPI). Data Science: Familiarity or experience with classical NLP techniques (BERT, topic modelling, summarisation ...

data contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate data from REST APIs and other source systems, working with Parquet and S3-compatible object storage. Implement data validation, assurance, metadata management and traceability to ensure data is accurate, complete and fit for purpose. Develop … routing, transformation and orchestration. Experience of data modelling and schema design, including defining data contracts or Interface Control Documents (ICDs). Experience working with Parquet and S3-compatible object storage. Experience integrating REST APIs and troubleshooting data exchanges between systems. Experience deploying or supporting data solutions within OpenShift ...