10 of 10 Parquet Jobs in the UK

lake storage layer. Experience in building ETL/ELT pipelines for batch and near-real-time data processing. Experience with data formats such as Parquet, Avro, ORC, JSON, and CSV. Good understanding of data modelling, data warehousing, and dimensional modelling concepts. Experience with data validation, reconciliation, data quality, audit ...

/or PySpark for data transformation and automation. Understanding of Power BI, semantic models, DAX and reporting requirements. Experience working with APIs, JSON, CSV, Parquet, Delta tables and common enterprise data formats. Knowledge of data governance, access control, data quality, metadata and lineage. Good documentation skills and the ability ...

issues across Foundry, Databricks and AWS. Desirable Skills Experience with Foundry Virtual Tables, Ontology, Workshop, Pipeline Builder or Code Repositories. Experience with Delta Lake, Parquet, Iceberg, CSV and JSON. Data governance, lineage, secure data-sharing and access approval experience. Python, PySpark or SQL development experience. CI/CD experience ...

Unity Catalog experience, including grants, external locations, storage credentials and governed data access. Terraform or similar Infrastructure as Code experience. Good understanding of Delta, Parquet, CSV and JSON data formats. Strong troubleshooting, documentation and stakeholder communication skills. Desirable Skills Palantir Foundry experience, especially Databricks connector, Data Connection, datasets, syncs ...

modules (FI/CO/MM/SD/PP etc.) required for December cutover. Build scalable ingestion pipelines using Delta Lake/Parquet and modern orchestration tools (ADF, dbx, Airflow, etc.). Collaborate with SAP functional teams to validate business logic, deltas, and data quality. Implement CI/ ...

schema mismatches and query failures. Technical Environment : Palantir Foundry, Foundry Virtual Tables, Ontology, Workshop, Pipeline Builder, Code Repositories, AWS, Databricks, Terraform, IaC, Delta Lake, Parquet, Iceberg, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions. ...

access, metadata, schema, query and connectivity issues across AWS, Databricks and downstream integrations. Technical Environment: AWS, Databricks, Unity Catalog, Palantir Foundry, Terraform, IaC, Delta, Parquet, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions. ...

C#/.NET | Reading Java | HTTP/JavaScript development/CGI | Claude Code use but with demonstrable manual programming ability | DuckDB/Parquet/PostgreSQL | Windows Scripting (.bat/PS1) | Excel Macros & VBA Technical Skills Experience using SQL and/or other relevant coding languages for data extraction, analysis ...

working on data infrastructure and AI-driven tooling that supports trading, analytics, and operational workflows. Requirements: 5+ years of Python development with strong data (Parquet) and AI (Claude Code) experience Experience working with large datasets and columnar data formats An AI-native mindset, with exposure to agent-based ...

processing (face detection, quality assessment, tracking) Improve training performance across single and multi-node setups using PyTorch and Ray Build evaluation and experimentation systems (Parquet/Iceberg) for model output analysis Own model versioning, lifecycle management, and promotion to production Optimise inference pipelines using Triton; build model ensembles … loading, preprocessing Practical distributed systems experience (Ray, DDP, or similar) Experience handling TB-scale or high-throughput data pipelines Familiarity with columnar formats: Arrow, Parquet, Iceberg Nice to Have Exposure to video or visual media pipelines (FFmpeg, encoding, frame extraction) Vector search or embedding system experience Triton or production ...