1 to 25 of 28 Parquet Jobs in London

Secrets Manager Data Modelling Skills Star Schema Snowflake Schema Dimensional Modeling Data Vault Data Warehouse Design Data Lake Architecture Data Formats Experience working with: Parquet Avro JSON CSV ORC CI/CD & DevOps Git GitHub GitLab Bitbucket Jenkins GitHub Actions GitLab CI/CD AWS DevOps Tools Domain Experience ...

e.g., EPAM) delivery models is beneficial.Understanding of data quality principles, including validation, monitoring, alerting, and resolution.Experience with lakehouse and medallion architecture patterns, Delta/Parquet-based data products, semantic model readiness and data product lifecycle management.Strong software engineering discipline, including source control, peer review, unit/integration testing, deployment ...

environment. Experience working with distributed data processing frameworks such as Apache Spark . Working knowledge of common data formats such as JSON , Avro and Parquet . Technology Environment The role will involve working with a modern and evolving data stack. Candidates are not expected to have deep expertise ...

environment. Experience working with distributed data processing frameworks such as Apache Spark . Working knowledge of common data formats such as JSON , Avro and Parquet . Technology Environment The role will involve working with a modern and evolving data stack. Candidates are not expected to have deep expertise ...

invalidation, persistence strategy, data consistency MongoDB TimescaleDB NATS JetStream AWS S3/Glue Data lake staging, archival, batch ingestion into Snowflake Partitioning, file format (Parquet/ORC), Lake Formation governance Finance Domain Knowledge Candidates should have hands‐on data architecture experience in one or more of the following financial ...

compliance efforts to ensure adherence to standards and regulations.Required qualifications, capabilities and skillsExperience in working with technical data formats (JSON/Avro/Parquet)Formal training or certification on data engineering concepts and applied experienceRecent hands-on professional experience in a reporting, data analysis or business intelligence roleExperience ...

Orchestra for task orchestration Terraform for infrastructure Lightdash for data applications Airflow and Astronomer for job scheduling and tracking Circle CI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Spark for data processing SparkSQL for analytics Why else you'll love it here ...

unifying and normalising data into a relational store with proper versioning and lineage; polling an external API and landing it as a Hive-partitioned Parquet dataset; storing document blobs and their metadata via a document-management approach. There will be many more shapes; your job is to choose ...

technology stack through reusable libraries, APIs, and robust engineering practices.Optimise performance, scalability, and reliability of quantitative applications.Skills required:Python data engineering stack: Pandas/Parquet/FastAPI/Jupyter/Airflow/Streamlit/RayExperience with high-performance data stores and query engines like Trino/SnowflakeExperience with financial ...

issues to resolutionBonus Points:Experience deploying and operating services across multiple cloud providers (AWS, GCP, Azure, OCI)Knowledge of data serialization formats (Avro, Protobuf, Parquet) and schema managementExperience with observability platforms (Prometheus, Grafana, Datadog, Splunk)Understanding of data governance, security, and compliance requirementsContributions to open-source streaming or distributed ...

Strong scripting abilities in SQL, Python, and/or PowerShell. Data Formats: Experience working with structured and semi-structured data formats (CSV, JSON, XML, Parquet, MDF, BAK). Problem Solving: Exceptional troubleshooting, automation, and analytical capabilities. How to Apply Please include your most recent CV and a brief summary ...

Strong scripting abilities in SQL, Python, and/or PowerShell. Data Formats: Experience working with structured and semi-structured data formats (CSV, JSON, XML, Parquet, MDF, BAK). Problem Solving: Exceptional troubleshooting, automation, and analytical capabilities. How to Apply Please include your most recent CV and a brief summary ...

high quality code and building lean processesExperience with distributed data processingExperience with monitoring, testing, and data qualityExperience building robust pipelines from diverse sources e.g. parquet, SQL & no-SQL databases, API endpointsIt would be helpful to have experience/expertise/knowledge in the following:PythonAWSKubernetesSpark & distributed computingdbtTerraformData Warehousing ...

work effectively with remote teams"**Experience with the Following is Desirable:*** Go* Pinot or other time-series/OLAP-style database* Iceberg* Kubernetes* Jenkins* Parquet* Protocol Buffers/GRPC#LI-MZ1**Benefits of Working at CrowdStrike:*** Market leader in compensation and equity awards* Comprehensive physical and mental wellness programs* Competitive ...

Glue Amazon S3 AWS Lake Formation Amazon Athena Experience building Lakehouse architectures and modern data platforms. Experience working with data formats such as Parquet and Iceberg tables. Strong experience with Terraform for infrastructure automation. #J-18808-Ljbffr ...

desks and ability to analyse and address issues and queries quickly and effectively.Recent hands-on experience with Python plus SQL Server and ideally some Parquet exposure.Evidence of strong delivery throughout the entire lifecycle.Strong problem-solving skills and capability to write code quickly and accurately, plus experience of troubleshooting production ...

PostgreSQL, and cloud databases Proven track record with complex data migration projects (terabyte+ datasets, multiple legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing ...

Modern C++ Distributed systems Large-scale data processing High-performance microservices Data infrastructure and analytics pipelines Bonus points for SQL Boost ASIO Apache Arrow, Parquet, Protocol Buffers or FlatBuffers gRPC, REST or WebSockets Docker, Kubernetes, AWS or Google Cloud Rust, Python or Q This is an opportunity to solve ...

learn new technologies and frameworksNice to have:Knowledge of databases, SQLFamiliarity with Boost ASIOFamiliarity with data serialization formats such Apache Arrow/Parquet, Google Protocol Buffers, FlatbuffersExperience with gRPC, http/REST and Websocket protocolsExperience with Google Cloud/AWS and/or containerization in Docker/KubernetesExperience with ...

/ranking experience (relevant to in-app content recommendation work)healthcare, regulated-industry, or safety-critical AI systems experiencedata engineering fundamentals (Spark, Delta tables, Parquet)#LI-KP1 #LI-Hybrid Annual Salary Range (ranges may vary based on skills and experience)120,000—150,000 GBPHow we workWe ...

finance, high-yield, private credit, distressed, and the data pain points those teams have.Fluent in how data and quant teams actually consume APIs today. Parquet, DuckDB, Polars, Snowflake shares, not just pandas in a Jupyter notebook. You can rip through a notebook live on a call.Exposure to MEDDPICC/ ...

Job TitleSenior Data Engineer EMEAJob Description SummaryAbout the teamWe are a Centre of Excellence within a larger EMEA team, with deep specialization in data engineering. Our mission is to build the platform that defines how ...

engineering, with a deep understanding of open-source technologies used in these domainsExperience with modern ML frameworks and tooling, including PyTorch, JAX, Apache Arrow, Parquet, Polars, Ray and related training and inference toolingFamiliarity with GPU/accelerator workflows, CUDA-based software packaging and the practical realities of running ...

The OpportunityJoin a team building the data foundations that support the firm’s AI and analytics capabilities. This role sits within the engineering effort to develop a modern Lakehouse and AI data platform that enables ...

ticks, Level 1 & 2 quotes, order books, reference data and corporate actions. Implement automated data quality, reconciliation and monitoring frameworks. Optimise data storage using Parquet, Arrow and modern data lake technologies. Partner with quantitative researchers, traders and engineering teams to deliver trusted datasets. Essential Skills Strong Python and SQL. … data engineering with proven experience building reliable, scalable data platforms. Our non-negotiable requirements are: Expert Python Strong SQL Scalable data pipeline development Apache Parquet Market data normalisation Automated data quality controls Deep tick and market data expertise Experience in MLOps is advantageous but not essential. We welcome candidates ...