5 of 5 Remote/Hybrid Parquet Jobs in the UK

data pipelines from SAP and non-SAP sources into cloud platforms such as Snowflake, Databricks, and Fabric. Design medallion and lakehouse architectures using Parquet, Iceberg, Delta, and cloud-native services . Establish CI/CD frameworks, automation, metadata-driven ingestion, and orchestration strategies. Governance, Security & Quality Define data governance ...

PowerShell scripting o Jira, Confluence, ServiceNow o Azure Log Analytics, Workbooks, App Insights Additional Skills Familiarity with data formats such as GRIB, NETCDF, Parquet, JSON is a plus. Strong communication, analytical thinking, and problem-solving skills. Experience supporting production applications. Ability to anticipate problems and propose robust solutions. Azure ...

ingest cost, reducing low-value telemetry, retention/lifecycle strategy security lake/long retention approaches (e.g., Amazon Security Lake (OCSF) + S3/Parquet; lakehouse stacks like Databricks/Snowflake/Trino/Athena) open detection layer awareness (e.g., OpenSearch Security Analytics; Splunk ES/ESCU where relevant ...

/low level performance Skills: 2 - 15 years of experience as a C++ Developer Strong knowledge of optimization/performance Knowledge of Arrow/Parquet is a plus Experience working with Boost ASIO is a plus An interest in Rust is a nice plus Experience working at a large ...

Apache Iceberg . Simplify existing data architecture to improve maintainability and reduce operational overhead. Assess and advise on converting Iceberg datasets into optimised Parquet formats. Implement solutions to improve pipeline stability and reduce AWS operational costs. Document existing architecture, identify technical debt, and create remediation strategies. Work closely with … Data Catalog) Amazon Athena (query tuning, partitioning strategies) AWS Lambda (event driven workloads) Apache Iceberg (schema evolution, table formats, time travel) Deep understanding of Parquet, Iceberg, ORC and performance trade offs. Proven track record of diagnosing and resolving complex pipeline performance issues. Strong SQL skills and experience with query ...