6 of 6 Permanent Parquet Jobs in the UK

with analysts and AI engineers to deliver robust and reusable data products Manage data lakes and warehouses using formats such as Delta Lake and Parquet Implement best practices for data governance, performance, and security Continuously evaluate and adopt new technologies to evolve the organisation's data platform Provide technical ...

workloads and the unified analytics environment. Strong proficiency in Python, SQL , and Spark-based processing frameworks. Solid understanding of lakehouse architecture , including Delta/Parquet formats and data modelling. Experience designing secure, compliant, and well-governed data platforms. Nice-to-have: MS Fabric certification Your characteristics as a Consultant ...

feed handlers Strong programming/scripting skills (Python, PowerShell, C#, SQL or similar) Experience with time-series databases (e.g., KDB, OneTick) Knowledge of Parquet-based data storage Solid experience in Linux environments and scripting (Bash, Perl) Experience building and maintaining high-performance data pipelines Strong understanding of data validation ...

clearance (essential). Desirable technical strengths: Terraform (IaC), Python and PySpark, Azure DevOps pipelines, Docker/Docker-Compose, Trivy scanning, medallion architecture with ADLS, parquet and delta tables, and strong SQL. Why Join? High-autonomy Lead Architect contract on a strategic, multi-workstream Azure and Databricks programme at national ...

document metadata, lineage, catalogues and source-to-target mapping. Contribute to ETL design and data movement patterns across platforms. Work with JSON, XML, Parquet and other semi-structured formats used across financial systems. Engage senior stakeholders and guide best practice within multidisciplinary teams. Principal level: provide thought leadership, support ...

design sessions, and team alignment. What You’ll Do Build serverless and containerised services on AWS Design data pipelines and analytics workflows (Athena/Parquet) Develop event-driven systems using SQS and Step Functions Create and maintain GraphQL APIs Work with DynamoDB and Postgres Write production-quality Python Manage … Terraform/Terraform Cloud Improve reliability, scalability, and observability Tech Stack AWS (Lambda, ECS, SQS, Step Functions, Cognito) · Terraform · Terraform Cloud · Docker · GraphQL · Athena · Parquet · DynamoDB · Postgres · GitLab · Python What We’re Looking For Senior-level experience in backend and/or data engineering Strong AWS and cloud-native ...