19 of 19 Parquet Jobs in the UK excluding London

data integration components and services, including Java-based microservices where required Prepare, transform and validate structured and semi-structured data, including formats such as parquet, avro and JSON Write efficient SQL to query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse ...

data integration components and services, including Java-based microservices where required Prepare, transform and validate structured and semi-structured data, including formats such as parquet, avro and JSON Write efficient SQL to query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse ...

similar cloud-specific services. Transformation & Orchestration tools Database Technologies Libraries & Schema Management Storage Formats: Familiarity managing diverse data types through formats like JSON and Parquet Containerisation DevOps and DataOps We are interested in Engineers with a solid understanding of DevOps to enable ownership of cloud infrastructure and different environments ...

similar cloud-specific services. Transformation & Orchestration tools Database Technologies Libraries & Schema Management Storage Formats: Familiarity managing diverse data types through formats like JSON and Parquet Containerisation DevOps and DataOps We are interested in Engineers with a solid understanding of DevOps to enable ownership of cloud infrastructure and different environments ...

Glue Database Technologies Data processing libraries & Schema Management tools like Pandas and Pydantic Storage Formats: Familiarity with data types such as JSON and Parquet DevOps and DataOps Experience of IaC tools, particularly Terraform Understanding of implementing logging, monitoring and alerting for enterprise level pipelines Understanding of access controls, policies ...

Glue Database Technologies Data processing libraries & Schema Management tools like Pandas and Pydantic Storage Formats: Familiarity with data types such as JSON and Parquet DevOps and DataOps Experience of IaC tools, particularly Terraform Understanding of implementing logging, monitoring and alerting for enterprise level pipelines Understanding of access controls, policies ...

Fabric, Medallion and Data Products. Hands on mindset : Fluent in the language of data, whether SQL, Python, PySpark, R or Scala. Open formats including Parquet, Iceberg and JSON. Agile Ways of Working Run and contribute to agile ceremonies, helping to shape and improve the agile process Work with ...

patterns (Debezium or equivalent) Stream processing (Apache Flink, Spark Structured Streaming, or equivalent) SQL and query optimisation at scale Data and table formats (Parquet, Avro, Apache Iceberg or Delta Lake) Experience designing SaaS data models, tenant isolation, shared schemas, access patterns, at scale. Ability to communicate architecture decisions ...

sources Knowledge of Azure DevOps, repositories and CI/CD pipelines. Desirable Skills: C#/.NET development experience. Bash/Linux. Azure Blob Storage, Parquet, DuckDB and bulk data loading. SSDT/DACPAC. Experience migrating legacy systems into modern cloud platforms. Experience with containerisation and API-based integrations. Familiarity ...

production environments Develop ingestion and egress patterns to support reliable data access and integration Work with structured and semi-structured data (e.g. JSON, Parquet) Build and maintain data models across a cloud data platform Design and implement APIs to expose data for downstream consumers Contribute to cloud-based data ...

Learning – Understanding of AI/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications Advanced Data Management – Strong SQL design, query optimization ...

Learning – Understanding of AI/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications • Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications • Advanced Data Management – Strong SQL design, query optimization ...

OLAP platform would be particularly valuable, although strong candidates from SQL Server, Oracle or other database backgrounds will also be considered. Exposure to Azure, Parquet or querying data in object storage would be beneficial. What's on offer £70,000-£80,000 depending on experience. Hybrid working, with ...

experience MergeTree family design, partitioning, TTLs, materialised views, Distributed tables and sharding ETL/ELT pipeline design and operation; batch + near-real-time Parquet and object storage (Azure Blob or S3) as a query tier Query performance tuning and capacity planning Strong SQL; PostgreSQL competence Desired Criteria: Clickhouse ...

other genome browser Experience working in a multi-person team delivering production services Experience with large-scale biological datasets Experience working with the Apache Parquet file format Experience implementing AI/ML approaches for quality control and/or genome annotation Behaviours we value in our team: You bring ...

Senior Data Engineer – Remote (Senior Data Engineer, Data Engineer, SQL, T-SQL, SQL Server, Azure SQL, Python, PySpark, Microsoft Fabric, Databricks, Synapse, Delta/Parquet, Power BI, Agentic AI, Infrastructure as code, IaC, CI/CD, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … modelling experience and strong Python (PySpark, notebooks). Exposure to Microsoft Fabric is required, or at least Databricks/Synapse and the Delta/Parquet ecosystem, as well as Power BI semantic modelling. You will also need an understanding of information security and data protection in an engineering context ...

Senior Data Engineer – Remote (Senior Data Engineer, Data Engineer, SQL, T-SQL, SQL Server, Azure SQL, Python, PySpark, Microsoft Fabric, Databricks, Synapse, Delta/Parquet, Power BI, Agentic AI, Infrastructure as code, IaC, CI/CD, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … modelling experience and strong Python (PySpark, notebooks). Exposure to Microsoft Fabric is required, or at least Databricks/Synapse and the Delta/Parquet ecosystem, as well as Power BI semantic modelling. You will also need an understanding of information security and data protection in an engineering context ...

/platform engineer to join our Engineering team in Belfast. The role focuses on expanding our data platform with ClickHouse and PostgreSQL while leveraging Parquet and cloud object storage. You will participate in a dynamic development environment, influence technical decisions, and help deliver secure, high-quality software across ...

At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market. What ...