4 of 4 Parquet Jobs in London

/or PySpark for data transformation and automation. Understanding of Power BI, semantic models, DAX and reporting requirements. Experience working with APIs, JSON, CSV, Parquet, Delta tables and common enterprise data formats. Knowledge of data governance, access control, data quality, metadata and lineage. Good documentation skills and the ability ...

clustering problems. Familiarity with cost optimization for high-throughput data pipelines. Technologies we use: AWS serverless architectures Kubernetes Spark Flink Java Python Databricks RisingWave Parquet, Iceberg, Delta, Paimon Terraform GitHub AI at Chainalysis AI is not a feature at Chainalysis – it is a new way of working. One that ...

access, metadata, schema, query and connectivity issues across AWS, Databricks and downstream integrations. Technical Environment: AWS, Databricks, Unity Catalog, Palantir Foundry, Terraform, IaC, Delta, Parquet, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions. ...

processing (face detection, quality assessment, tracking) Improve training performance across single and multi-node setups using PyTorch and Ray Build evaluation and experimentation systems (Parquet/Iceberg) for model output analysis Own model versioning, lifecycle management, and promotion to production Optimise inference pipelines using Triton; build model ensembles … loading, preprocessing Practical distributed systems experience (Ray, DDP, or similar) Experience handling TB-scale or high-throughput data pipelines Familiarity with columnar formats: Arrow, Parquet, Iceberg Nice to Have Exposure to video or visual media pipelines (FFmpeg, encoding, frame extraction) Vector search or embedding system experience Triton or production ...