9 of 9 Parquet Jobs in England

/or PySpark for data transformation and automation. Understanding of Power BI, semantic models, DAX and reporting requirements. Experience working with APIs, JSON, CSV, Parquet, Delta tables and common enterprise data formats. Knowledge of data governance, access control, data quality, metadata and lineage. Good documentation skills and the ability ...

Learning – Understanding of AI/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications • Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications • Advanced Data Management – Strong SQL design, query optimization ...

modules (FI/CO/MM/SD/PP etc.) required for December cutover. Build scalable ingestion pipelines using Delta Lake/Parquet and modern orchestration tools (ADF, dbx, Airflow, etc.). Collaborate with SAP functional teams to validate business logic, deltas, and data quality. Implement CI/ ...

clustering problems. Familiarity with cost optimization for high-throughput data pipelines. Technologies we use: AWS serverless architectures Kubernetes Spark Flink Java Python Databricks RisingWave Parquet, Iceberg, Delta, Paimon Terraform GitHub AI at Chainalysis AI is not a feature at Chainalysis – it is a new way of working. One that ...

tuning, prompt engineering, LLM evaluation, or model serving Technical stack: strong Python across production services and data pipelines, data engineering fundamentals (Spark, Delta tables, Parquet) Platform and infrastructure: Databricks (MLflow, Unity Catalog, Model Serving), AWS (EKS/Kubernetes, IAM), Terraform, GitHub Actions Cross-domain flexibility: comfort working across ...

access, metadata, schema, query and connectivity issues across AWS, Databricks and downstream integrations. Technical Environment: AWS, Databricks, Unity Catalog, Palantir Foundry, Terraform, IaC, Delta, Parquet, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions. ...

C#/.NET | Reading Java | HTTP/JavaScript development/CGI | Claude Code use but with demonstrable manual programming ability | DuckDB/Parquet/PostgreSQL | Windows Scripting (.bat/PS1) | Excel Macros & VBA Technical Skills Experience using SQL and/or other relevant coding languages for data extraction, analysis ...

cluster scale, service mesh (Istio/Envoy), Terraform, and AWS and/or GCP. A track record of evolving storage and query architectures (TSDB, Parquet, distributed processing) for cost, scale and latency. Nice to have: OpenTelemetry/OpenMetrics standards work, CNCF open-source contributions, security-in-platform experience ...

processing (face detection, quality assessment, tracking) Improve training performance across single and multi-node setups using PyTorch and Ray Build evaluation and experimentation systems (Parquet/Iceberg) for model output analysis Own model versioning, lifecycle management, and promotion to production Optimise inference pipelines using Triton; build model ensembles … loading, preprocessing Practical distributed systems experience (Ray, DDP, or similar) Experience handling TB-scale or high-throughput data pipelines Familiarity with columnar formats: Arrow, Parquet, Iceberg Nice to Have Exposure to video or visual media pipelines (FFmpeg, encoding, frame extraction) Vector search or embedding system experience Triton or production ...