26 to 41 of 41 Parquet Jobs in London

SSIS, Azure Data Factory and related cloud services. Support API-based integrations, with Workday integration experience considered good to have. Contribute to data snapshotting, Parquet-based storage and Fabric/lakehouse development where required. Apply good engineering practices, including source control, testing, peer review, monitoring and controlled deployments. Identify ...

ability to analyse and address issues and queries quickly and effectively.* Recent hands-on experience with Python plus SQL Server and ideally some Parquet exposure.* Evidence of strong delivery throughout the entire lifecycle.* Strong problem-solving skills and capability to write code quickly and accurately, plus experience of troubleshooting ...

Role Description The Business Analyst/Project Manager will support a transformation program for a top-tier banking client, aligned to an ECB Remediation approach. The Technical Analyst will support a Data Governance & Controls remediation ...

Job Title Senior Data Engineer Job Description Summary Senior Data Engineer | Databricks | Agentic AI | EMEA & APAC We are the team leading the data transformation of our EMEA and APAC business, and we are hiring a ...

engineering experience: schema design, storage formats, compression, I/O trade-offs, and pipelines processing hundreds of terabytes. Experience with columnar formats such as Parquet or Arrow, or comparable domain‐specific formats used for event logs, telemetry, or replays. Experience designing and operating services or platforms used by other ...

building agent-driven data workflows. Google Cloud; services such as Cloud Run, GKE, Artifact Registry and Cloud SQL. Modern columnar and array formats (Parquet, Arrow, Zarr) and thoughtful storage layout for large datasets. Infrastructure as Code (IaC); ideally Terraform, Docker containers. Experience working with sensitive data under GDPR, HIPAA … transfer controls and provenance tracking. Background in biology, medicine or biomedical data (genomics, transcriptomics, proteomics, EHR, clinical images). Key Skills Python, GCP, DICOM, Parquet, Image Data, Cloud, SQL, BigQuery All profiles will be reviewed against the required skills and experience. Due to the high number of applications ...

Python and best practices. The role requires strong Python skills, experience with cloud platforms (Azure), Spark/Databricks, and data storage technologies such as Parquet/Delta Lake. #J-18808-Ljbffr ...

bring the right engine, from BigQuery to Dataflow to Trino, to the job. The work has two parts. Hecate enables Iceberg for the Parquet datasets that already exist across Spotify, so teams get the benefits without rewriting their data. Alongside it, we're building the foundations ...

Backend: Distributed, event-driven core Java (90% of the code-base), MySQL, Kafka Frontend: Javascript, Vue.js Deployment: Kubernetes, Nomad Data analytics: Python & Jupyter notebooks, Parquet, Docker Testing: JUnit, JMH, JCStress, Jenkins, Selenium, many in-house tools... OS: Linux (Fedora for development, Rocky in production) The LMAX ...

Apache DataFusion, Apache Comet, and Velox for data processing and query execution Apache Iceberg for table management and catalog interoperability Apache Arrow and Apache Parquet for in-memory data processing and columnar storage Gradle and Cargo for builds, and GitHub for collaboration You do not need prior experience with ...

Apache DataFusion, Apache Comet, and Velox for data processing and query execution Apache Iceberg for table management and catalog interoperability Apache Arrow and Apache Parquet for in-memory data processing and columnar storage Industry-standard build tooling, including Gradle, Cargo, and GitHub. Core Responsibilities Designing and implementing query planning ...

high-quality production code Strong foundation in operating systems and systems programming Proven track record in performance engineering Familiarity with tools like Apache Arrow, Parquet, DataFusion, Clickhouse, or DuckDB is a plus Understanding of cutting-edge ML infrastructure stack (e.g. PyTorch, CUDA) is also a plus Experience with Rust ...

At Movar, we understand that project delivery is getting increasingly complex. Since 2013, we’ve been helping companies of all sizes improve the way projects are delivered. Our mission is to be the number one ...

capabilities across large tables and diverse workloads. You will work with Java, Rust, Scala, or C++ and engage with Spark, DataFusion, Iceberg, Arrow, and Parquet in a high-performance environment that values #J-18808-Ljbffr ...

At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market. What ...

Macquarie Group is seeking a Data Platform Engineer to design, build and optimize a petabyte-scale data platform powered by modern cloud technologies in a hybrid work model. You will manage a Data Lake, ensure ...