21 of 21 Parquet Jobs in the UK

lake storage layer. Experience in building ETL/ELT pipelines for batch and near-real-time data processing. Experience with data formats such as Parquet, Avro, ORC, JSON, and CSV. Good understanding of data modelling, data warehousing, and dimensional modelling concepts. Experience with data validation, reconciliation, data quality, audit ...

Secrets Manager Data Modelling Skills Star Schema Snowflake Schema Dimensional Modeling Data Vault Data Warehouse Design Data Lake Architecture Data Formats Experience working with: Parquet Avro JSON CSV ORC CI/CD & DevOps Git GitHub GitLab Bitbucket Jenkins GitHub Actions GitLab CI/CD AWS DevOps Tools Domain Experience ...

Secrets Manager Data Modelling Skills Star Schema Snowflake Schema Dimensional Modeling Data Vault Data Warehouse Design Data Lake Architecture Data Formats Experience working with: Parquet Avro JSON CSV ORC CI/CD & DevOps Git GitHub GitLab Bitbucket Jenkins GitHub Actions GitLab CI/CD AWS DevOps Tools Domain Experience ...

environment. Experience working with distributed data processing frameworks such as Apache Spark . Working knowledge of common data formats such as JSON , Avro and Parquet . Technology Environment The role will involve working with a modern and evolving data stack. Candidates are not expected to have deep expertise ...

environment. Experience working with distributed data processing frameworks such as Apache Spark . Working knowledge of common data formats such as JSON , Avro and Parquet . Technology Environment The role will involve working with a modern and evolving data stack. Candidates are not expected to have deep expertise ...

patterns (Debezium or equivalent) Stream processing (Apache Flink, Spark Structured Streaming, or equivalent) SQL and query optimisation at scale Data and table formats (Parquet, Avro, Apache Iceberg or Delta Lake) Experience designing SaaS data models, tenant isolation, shared schemas, access patterns, at scale. Ability to communicate architecture decisions ...

invalidation, persistence strategy, data consistency MongoDB TimescaleDB NATS JetStream AWS S3/Glue Data lake staging, archival, batch ingestion into Snowflake Partitioning, file format (Parquet/ORC), Lake Formation governance Finance Domain Knowledge Candidates should have hands‐on data architecture experience in one or more of the following financial ...

Learning – Understanding of AI/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications • Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications • Advanced Data Management – Strong SQL design, query optimization ...

Strong scripting abilities in SQL, Python, and/or PowerShell. Data Formats: Experience working with structured and semi-structured data formats (CSV, JSON, XML, Parquet, MDF, BAK). Problem Solving: Exceptional troubleshooting, automation, and analytical capabilities. How to Apply Please include your most recent CV and a brief summary ...

Strong scripting abilities in SQL, Python, and/or PowerShell. Data Formats: Experience working with structured and semi-structured data formats (CSV, JSON, XML, Parquet, MDF, BAK). Problem Solving: Exceptional troubleshooting, automation, and analytical capabilities. How to Apply Please include your most recent CV and a brief summary ...

tuning, prompt engineering, LLM evaluation, or model serving Technical stack: strong Python across production services and data pipelines, data engineering fundamentals (Spark, Delta tables, Parquet) Platform and infrastructure: Databricks (MLflow, Unity Catalog, Model Serving), AWS (EKS/Kubernetes, IAM), Terraform, GitHub Actions Cross-domain flexibility: comfort working across ...

data - grounded in a desire to genuinely understand the data‐generating processes and domain context. Comfortable working across common data formats (e.g. CSV, JSON, Parquet) - loading, inspecting, joining, and aggregating as needed - and understanding what it means for the work when data is slowly changing versus arriving in near ...

work effectively with remote teams"**Experience with the Following is Desirable:*** Go* Pinot or other time-series/OLAP-style database* Iceberg* Kubernetes* Jenkins* Parquet* Protocol Buffers/GRPC#LI-MZ1**Benefits of Working at CrowdStrike:*** Market leader in compensation and equity awards* Comprehensive physical and mental wellness programs* Competitive ...

Azure AD B2C, PowerShell, Git, ARM Templates, Bicep, Terraform, JIRA, Confluence, and ServiceNow. Experience with SQL and NoSQL environments. Familiarity with GRIB, NETCDF, Parquet, and JSON data formats. Azure Developer certification. If you have the relevant skills and experience, please do apply promptly to be considered. ...

/Pyspark 3/4 Python behave - for Behaviour Driven Development and testing Python coverage - Code coverage Strong knowledge of Databricks, including delta parquet data format and the medallion data architecture Strong knowledge of YAML. Understanding of Azure Devops Understanding of Git and code release best practices The role ...

Glue Amazon S3 AWS Lake Formation Amazon Athena Experience building Lakehouse architectures and modern data platforms. Experience working with data formats such as Parquet and Iceberg tables. Strong experience with Terraform for infrastructure automation. #J-18808-Ljbffr ...

Modern C++ Distributed systems Large-scale data processing High-performance microservices Data infrastructure and analytics pipelines Bonus points for SQL Boost ASIO Apache Arrow, Parquet, Protocol Buffers or FlatBuffers gRPC, REST or WebSockets Docker, Kubernetes, AWS or Google Cloud Rust, Python or Q This is an opportunity to solve ...

Glue Amazon S3 AWS Lake Formation Amazon Athena Experience building Lakehouse architectures and modern data platforms. Experience working with data formats such as Parquet and Iceberg tables. Strong experience with Terraform for infrastructure automation. Hands‐on experience with AWS. #J-18808-Ljbffr ...

relational database knowledge, including data extraction and quality management Experience working with Data Warehouse and ETL processes, alongside formats such as CSV, JSON and Parquet Excellent stakeholder management skills with the ability to influence decision-making at all levels of the business Successful candidates must be able to obtain ...

ticks, Level 1 & 2 quotes, order books, reference data and corporate actions. Implement automated data quality, reconciliation and monitoring frameworks. Optimise data storage using Parquet, Arrow and modern data lake technologies. Partner with quantitative researchers, traders and engineering teams to deliver trusted datasets. Essential Skills Strong Python and SQL. … data engineering with proven experience building reliable, scalable data platforms. Our non-negotiable requirements are: Expert Python Strong SQL Scalable data pipeline development Apache Parquet Market data normalisation Automated data quality controls Deep tick and market data expertise Experience in MLOps is advantageous but not essential. We welcome candidates ...

involved with the design, scaling, and optimisation of this modern, cloud-scale lakehouse built on Apache Spark, AWS Glue, and Apache Iceberg/Parquet, transforming complex broadcast & archival media metadata into structured, aggregated, unified, high-performance data assets. In this role, you will bridge the gap between data analysis … delivering data-powered applications in production - Hands-on experience with modern cloud data analysis & engineering (we use SQL, Python, AWS Glue, Apache Iceberg, Apache Parquet, Apache Spark) - Experience of modern data transformation pipeline tools such as dbt or SQLMesh - Working experience of data modelling (e.g. Entity-Relationship) - Experience ...