1 to 25 of 33 Remote/Hybrid Parquet Jobs in the UK

data integration components and services, including Java-based microservices where required Prepare, transform and validate structured and semi-structured data, including formats such as parquet, avro and JSON Write efficient SQL to query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse ...

data integration components and services, including Java-based microservices where required Prepare, transform and validate structured and semi-structured data, including formats such as parquet, avro and JSON Write efficient SQL to query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse ...

similar cloud-specific services. Transformation & Orchestration tools Database Technologies Libraries & Schema Management Storage Formats: Familiarity managing diverse data types through formats like JSON and Parquet Containerisation DevOps and DataOps We are interested in Engineers with a solid understanding of DevOps to enable ownership of cloud infrastructure and different environments ...

similar cloud-specific services. Transformation & Orchestration tools Database Technologies Libraries & Schema Management Storage Formats: Familiarity managing diverse data types through formats like JSON and Parquet Containerisation DevOps and DataOps We are interested in Engineers with a solid understanding of DevOps to enable ownership of cloud infrastructure and different environments ...

similar cloud-specific services. Transformation & Orchestration tools Database Technologies Libraries & Schema Management Storage Formats: Familiarity managing diverse data types through formats like JSON and Parquet Containerisation DevOps and DataOps We are interested in Engineers with a solid understanding of DevOps to enable ownership of cloud infrastructure and different environments ...

Glue Database Technologies Data processing libraries & Schema Management tools like Pandas and Pydantic Storage Formats: Familiarity with data types such as JSON and Parquet DevOps and DataOps Experience of IaC tools, particularly Terraform Understanding of implementing logging, monitoring and alerting for enterprise level pipelines Understanding of access controls, policies ...

Glue Database Technologies Data processing libraries & Schema Management tools like Pandas and Pydantic Storage Formats: Familiarity with data types such as JSON and Parquet DevOps and DataOps Experience of IaC tools, particularly Terraform Understanding of implementing logging, monitoring and alerting for enterprise level pipelines Understanding of access controls, policies ...

Glue Database Technologies Data processing libraries & Schema Management tools like Pandas and Pydantic Storage Formats: Familiarity with data types such as JSON and Parquet DevOps and DataOps Experience of IaC tools, particularly Terraform Understanding of implementing logging, monitoring and alerting for enterprise level pipelines Understanding of access controls, policies ...

based environment Advanced experience working and understanding the tradeoffs of at least one of the following Data Lake table/file formats: Delta Lake, Parquet, Iceberg, Hudi Experience working with lakehouse/medallion architectures in Databricks Experience with experimentation support tooling (such as Optimizely) A genuine curiosity about ...

Data Build Tool (DBT) with a demonstrated ability indeveloping data models, contracts, tests, validation, and transformations Experienceworking with modern data distributed file formats (i.e., Parquet, Delta,Iceberg, Hudi) Demonstratedexperience with building data ingestion pipelines from REST API data sources. Strongability to produce technical documentation that can be understood ...

troubleshooting. Supporting + maintaining production data pipelines, including incident investigation, safe recovery, root cause analysis + permanent remediation. Experience of Spark SQL, Delta Lake, Parquet + Hive metastore tables, including schemas, partitions and the relationship between table metadata and underlying files. Hands-on AWS experience, particularly ...

troubleshooting. Supporting + maintaining production data pipelines, including incident investigation, safe recovery, root cause analysis + permanent remediation. Experience of Spark SQL, Delta Lake, Parquet + Hive metastore tables, schemas, partitions and the relationship between table metadata and underlying files. Hands-on AWS experience, particularly S3, IAM and CloudWatch ...

including Kafka, Azure Functions or Azure Service Bus. Strong understanding of Spark processing and performance tuning. Experience working with file formats and partitioning, including Parquet, JSON, XML and CSV. Experience with Azure DevOps/GitHub and CI/CD. Strong programming experience in Python, with knowledge of other programming ...

supporting non‐technical stakeholders in getting the most out of the data warehouse Experience ingesting and processing structured and unstructured files (CSV, JSON, XML, Parquet, PDF) from a variety of sources, including cloud storage buckets and third‐party exports. Desired but not essential skills and experience include Broader Google ...

invalidation, persistence strategy, data consistency MongoDB TimescaleDB NATS JetStream AWS S3/Glue Data lake staging, archival, batch ingestion into Snowflake Partitioning, file format (Parquet/ORC), Lake Formation governance Finance Domain Knowledge Candidates should have hands‐on data architecture experience in one or more of the following financial ...

handling Delta Lake formats Hands-on experience building production pipelines inside Databricks workspaces and Fabric capacities Practical knowledge of structural data formats including Parquet, JSON, and CSV Experience with orchestration tools, scheduling dependencies, and error handling in a cloud environment Familiarity with unit testing data pipelines and implementing automated ...

standards such as metrics and use of test tools Here’s a snapshot of the technologies that we use: Scala Apache Spark Databricks Apache Parquet Azure Cloud Platform Azure DevOps (Test plans, Backlogs, Pipelines) GIT We’d love to hear from you if you have Good experience in creating ...

ways of working, and presenting these to the community Here’s a snapshot of the technologies that we use: Scala Apache Spark Databricks Apache Parquet Azure Cloud Platform Azure DevOps (Test plans, Backlogs, Pipelines) GIT What we’re looking for We’d love to hear from ...

production environments Develop ingestion and egress patterns to support reliable data access and integration Work with structured and semi-structured data (e.g. JSON, Parquet) Build and maintain data models across a cloud data platform Design and implement APIs to expose data for downstream consumers Contribute to cloud-based data ...

evolve the platform. Experience is helpful, but not essential: Languages: Python, SQL, Terragrunt, JavaScript Cloud: AWS (primary), some GCP Warehouse & Storage: Snowflake, S3/Parquet Data & ETL: dbt, Fivetran Platform & Infra: Kubernetes, Kafka, RabbitMQ, Argo, GitHub Actions, HashiCorp Vault Observability: Datadog, Grafana Dashboarding: Preset Other : Claude What ...

these capabilities responsibly. Modern Data Platform Expertise You're familiar with contemporary data platforms and tools, including data lakes, open table formats such as Parquet and Iceberg, ETL and ELT pipelines, multiple query engines, and BI tools such as Power BI. You're comfortable working across cloud environments including ...

experience MergeTree family design, partitioning, TTLs, materialised views, Distributed tables and sharding ETL/ELT pipeline design and operation; batch + near-real-time Parquet and object storage (Azure Blob or S3) as a query tier Query performance tuning and capacity planning Strong SQL; PostgreSQL competence Desired Criteria: Clickhouse ...

SOAP services, file transfers, batch ingestion, legacy adapters and bespoke interfaces. Experience with structured, semi-structured and unstructured data formats including CSV, XML, JSON, Parquet, Avro and proprietary formats. Experience designing solutions that operate across multiple security classifications and secure domains. Strong knowledge of data governance, lineage, metadata management ...

Glue Amazon S3 AWS Lake Formation Amazon Athena Experience building Lakehouse architectures and modern data platforms. Experience working with data formats such as Parquet and Iceberg tables. Strong experience with Terraform for infrastructure automation. #J-18808-Ljbffr ...

ability to analyse and address issues and queries quickly and effectively. Recent hands-on experience with Python plus SQL Server and ideally some Parquet exposure. Evidence of strong delivery throughout the entire lifecycle. Strong problem-solving skills and capability to write code quickly and accurately, plus experience of troubleshooting ...