1 to 25 of 30 Remote Parquet Jobs

data integration components and services, including Java-based microservices where required Prepare, transform and validate structured and semi-structured data, including formats such as parquet, avro and JSON Write efficient SQL to query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse ...

storage and exchange formats for each workload, including row‐based and columnar storage, Delta and Iceberg table formats, and file and message formats (e.g. Parquet, CSV, Excel, XML, JSON, Protobuf). Optimise platform performance and cost, including partitioning vs. liquid clustering, file sizing, Photon, and cluster and SQL warehouse ...

data integration components and services, including Java-based microservices where required Prepare, transform and validate structured and semi-structured data, including formats such as parquet, avro and JSON Write efficient SQL to query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse ...

best practices for structuring data for analytics, reporting and downstream consumption Confident working with large, complex datasets across various formats (databases, Excel, CSV, JSON, Parquet, APIs), while optimising performance Experience integrating data from social platforms such as YouTube and Meta, or working with advertising, audience, performance and revenue data ...

similar cloud-specific services. Transformation & Orchestration tools Database Technologies Libraries & Schema Management Storage Formats: Familiarity managing diverse data types through formats like JSON and Parquet Containerisation DevOps and DataOps We are interested in Engineers with a solid understanding of DevOps to enable ownership of cloud infrastructure and different environments ...

similar cloud-specific services. Transformation & Orchestration tools Database Technologies Libraries & Schema Management Storage Formats: Familiarity managing diverse data types through formats like JSON and Parquet Containerisation DevOps and DataOps We are interested in Engineers with a solid understanding of DevOps to enable ownership of cloud infrastructure and different environments ...

similar cloud-specific services. Transformation & Orchestration tools Database Technologies Libraries & Schema Management Storage Formats: Familiarity managing diverse data types through formats like JSON and Parquet Containerisation DevOps and DataOps We are interested in Engineers with a solid understanding of DevOps to enable ownership of cloud infrastructure and different environments ...

Glue Database Technologies Data processing libraries & Schema Management tools like Pandas and Pydantic Storage Formats: Familiarity with data types such as JSON and Parquet DevOps and DataOps Experience of IaC tools, particularly Terraform Understanding of implementing logging, monitoring and alerting for enterprise level pipelines Understanding of access controls, policies ...

Glue Database Technologies Data processing libraries & Schema Management tools like Pandas and Pydantic Storage Formats: Familiarity with data types such as JSON and Parquet DevOps and DataOps Experience of IaC tools, particularly Terraform Understanding of implementing logging, monitoring and alerting for enterprise level pipelines Understanding of access controls, policies ...

Glue Database Technologies Data processing libraries & Schema Management tools like Pandas and Pydantic Storage Formats: Familiarity with data types such as JSON and Parquet DevOps and DataOps Experience of IaC tools, particularly Terraform Understanding of implementing logging, monitoring and alerting for enterprise level pipelines Understanding of access controls, policies ...

Data Build Tool (DBT) with a demonstrated ability indeveloping data models, contracts, tests, validation, and transformations Experienceworking with modern data distributed file formats (i.e., Parquet, Delta,Iceberg, Hudi) Demonstratedexperience with building data ingestion pipelines from REST API data sources. Strongability to produce technical documentation that can be understood ...

supporting non‐technical stakeholders in getting the most out of the data warehouse Experience ingesting and processing structured and unstructured files (CSV, JSON, XML, Parquet, PDF) from a variety of sources, including cloud storage buckets and third‐party exports. Desired but not essential skills and experience include Broader Google ...

integration.Exposure to Market Data systems, financial data models, or vendor contract management domains.Experience with high-performance analytics engines or in-memory data processing (DuckDB, Parquet, Kafka).Education & ExperienceBachelor’s/Master’s degree in Computer Science, Software Engineering, or equivalent practical experience.Track record of technical delivery and leadership ...

production environments Develop ingestion and egress patterns to support reliable data access and integration Work with structured and semi-structured data (e.g. JSON, Parquet) Build and maintain data models across a cloud data platform Design and implement APIs to expose data for downstream consumers Contribute to cloud-based data ...

Modern Tech Stack: Experience is helpful, but not essential: Languages: Python, SQL, Terragrunt, JavaScript Cloud: AWS (primary), some GCP Warehouse & Storage: Snowflake, S3/Parquet Data & ETL: dbt, Fivetran Platform & Infra: Kubernetes, Kafka, RabbitMQ, Argo, GitHub Actions, HashiCorp Vault Observability: Datadog, Grafana Dashboarding: Preset Other: Claude WHAT ...

scalable environments for our data platforms. You will leverage cloud-native technologies and AWS tools such as AWS S3, EKS, Glue, Airflow, Trino, and Parquet, while preparing to adopt Apache Iceberg for even greater performance and flexibility. You’ll tackle high-performance data workloads, ensuring seamless execution of massive ...

these capabilities responsibly. Modern Data Platform Expertise You're familiar with contemporary data platforms and tools, including data lakes, open table formats such as Parquet and Iceberg, ETL and ELT pipelines, multiple query engines, and BI tools such as Power BI. You're comfortable working across cloud environments including ...

Glue Amazon S3 AWS Lake Formation Amazon Athena Experience building Lakehouse architectures and modern data platforms. Experience working with data formats such as Parquet and Iceberg tables. Strong experience with Terraform for infrastructure automation. #J-18808-Ljbffr ...

OLAP platform would be particularly valuable, although strong candidates from SQL Server, Oracle or other database backgrounds will also be considered. Exposure to Azure, Parquet or querying data in object storage would be beneficial. What's on offer £70,000-£80,000 depending on experience. Hybrid working, with ...

experience MergeTree family design, partitioning, TTLs, materialised views, Distributed tables and sharding ETL/ELT pipeline design and operation; batch + near-real-time Parquet and object storage (Azure Blob or S3) as a query tier Query performance tuning and capacity planning Strong SQL; PostgreSQL competence Desired Criteria: Clickhouse ...

management, and de-identification processes. Google Cloud Platform expertise, including BigQuery, Cloud Run, GKE, and Cloud SQL. Experience with modern data formats such as Parquet, Arrow, and Zarr. Infrastructure as Code using Terraform and Docker. Experience working within regulated environments involving sensitive healthcare or clinical data. Experience leveraging … coding assistants and agent-driven workflows. Key Technologies Python | GCP | BigQuery | SQL | DICOM | Medical Imaging | ETL/ELT | Cloud Storage | Parquet | AI & Machine Learning Guidant, Carbon60, Lorien & SRG - The Vertage Group Portfolio are acting as an Employment Business in relation to this vacancy. ...

Python (3.11+), pandas and NumPy skills. Production-grade Streamlit dashboard development. Data integration using Snowflake, OpenSearch, REST APIs and SQL. AWS experience (boto3, S3, Parquet). Data visualisation with Plotly, Matplotlib or Seaborn. Experience with Docker, Kubernetes, CI/CD and pytest. Knowledge of statistical analysis, anomaly detection ...

other genome browser Experience working in a multi‐person team delivering production services Experience with large‐scale biological datasets Experience working with the Apache Parquet file format Experience implementing AI/ML approaches for quality control and/or genome annotation Behaviours we value in our team You bring ...

other genome browser Experience working in a multi-person team delivering production services Experience with large-scale biological datasets Experience working with the Apache Parquet file format Experience implementing AI/ML approaches for quality control and/or genome annotation Behaviours we value in our team: You bring ...

Apache DataFusion, Apache Comet, and Velox for data processing and query execution Apache Iceberg for table management and catalog interoperability Apache Arrow and Apache Parquet for in-memory data processing and columnar storage Gradle and Cargo for builds, and GitHub for collaboration You do not need prior experience with ...