51 to 69 of 69 Parquet Jobs

work with the founders and a lead data scientist to implement LLM-driven extraction, sentiment scoring and rapid anomaly detection on a Parquet data lake hosted on AWS. The role combines hands-on engineering with leadership, offers meaningful equity and a salary #J-18808-Ljbffr ...

Apache DataFusion, Apache Comet, and Velox for data processing and query execution Apache Iceberg for table management and catalog interoperability Apache Arrow and Apache Parquet for in-memory data processing and columnar storage Gradle and Cargo for builds, and GitHub for collaboration You do not need prior experience with ...

Apache DataFusion, Apache Comet, and Velox for data processing and query execution Apache Iceberg for table management and catalog interoperability Apache Arrow and Apache Parquet for in-memory data processing and columnar storage Industry-standard build tooling, including Gradle, Cargo, and GitHub. Core Responsibilities Designing and implementing query planning ...

Engineering or a similar technical disciplineYou'll work withModern C++Distributed systemsLarge-scale data processingHigh-performance microservicesData infrastructure and analytics pipelinesBonus points forSQLBoost ASIOApache Arrow, Parquet, Protocol Buffers or FlatBuffersgRPC, REST or WebSocketsDocker, Kubernetes, AWS or Google CloudRust, Python or QThis is an opportunity to solve complex engineering problems ...

cloud-native infrastructure and data engineering Someone comfortable debugging complex production issues and making architectural decisions independently Experience with Kafka, Iceberg, Athena or Parquet would be a bonus. You'll be the go-to engineer for MLOps within a lean technical team, with genuine ownership over the platform rather ...

Backend: Distributed, event-driven core Java (90% of the code-base), MySQL, Kafka Frontend: Javascript, Vue.js Deployment: Kubernetes, Nomad Data analytics: Python & Jupyter notebooks, Parquet, Docker Testing: JUnit, JMH, JCStress, Jenkins, Selenium, many in-house tools... OS: Linux (Fedora for development, Rocky in production) The LMAX ...

Backend: Distributed, event-driven core Java (90% of the code-base), MySQL, Kafka •Frontend: Javascript, Vue.js •Deployment: Kubernetes, Nomad •Data analytics: Python & Jupyter notebooks, Parquet, Docker •Testing: JUnit, JMH, JCStress, Jenkins, Selenium, many in-house tools... •OS: Linux (Fedora for development, Rocky in production) The LMAX ...

At Movar, we understand that project delivery is getting increasingly complex. Since 2013, we’ve been helping companies of all sizes improve the way projects are delivered. Our mission is to be the number one ...

high-quality production code Strong foundation in operating systems and systems programming Proven track record in performance engineering Familiarity with tools like Apache Arrow, Parquet, DataFusion, Clickhouse, or DuckDB is a plus Understanding of cutting-edge ML infrastructure stack (e.g. PyTorch, CUDA) is also a plus Experience with Rust ...

Senior Data Engineer – Remote (Senior Data Engineer, Data Engineer, SQL, T-SQL, SQL Server, Azure SQL, Python, PySpark, Microsoft Fabric, Databricks, Synapse, Delta/Parquet, Power BI, Agentic AI, Infrastructure as code, IaC, CI/CD, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … modelling experience and strong Python (PySpark, notebooks). Exposure to Microsoft Fabric is required, or at least Databricks/Synapse and the Delta/Parquet ecosystem, as well as Power BI semantic modelling. You will also need an understanding of information security and data protection in an engineering context ...

Senior Data Engineer – Remote (Senior Data Engineer, Data Engineer, SQL, T-SQL, SQL Server, Azure SQL, Python, PySpark, Microsoft Fabric, Databricks, Synapse, Delta/Parquet, Power BI, Agentic AI, Infrastructure as code, IaC, CI/CD, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … modelling experience and strong Python (PySpark, notebooks). Exposure to Microsoft Fabric is required, or at least Databricks/Synapse and the Delta/Parquet ecosystem, as well as Power BI semantic modelling. You will also need an understanding of information security and data protection in an engineering context ...

/platform engineer to join our Engineering team in Belfast. The role focuses on expanding our data platform with ClickHouse and PostgreSQL while leveraging Parquet and cloud object storage. You will participate in a dynamic development environment, influence technical decisions, and help deliver secure, high-quality software across ...

capabilities across large tables and diverse workloads. You will work with Java, Rust, Scala, or C++ and engage with Spark, DataFusion, Iceberg, Arrow, and Parquet in a high-performance environment that values #J-18808-Ljbffr ...

At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market. What ...

At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market. What ...

evaluations that prove the output is accurate and keep it accurate as the models change underneath us The data layer on AWS. Our Parquet data lake, the pipelines that feed it and the query layer that lets clients analyse long date ranges quickly Technology partners. Finding, assessing and recommending … will do the job better, cheaper and more reliably Our stack Python, with Polars, Pandera and Celery SQL and MongoDB Columnar analytics on a Parquet data lake Docker AWS, managed as infrastructure as code What you’ll need An experienced data engineer, typically with seven years or more ...

supporting EMEA Equities business closely with trading desks in the region. The skills include KDB/Q, Python w (cloud/iceberg/Parquet) etc. The Developer Support role (Associate) will have opportunities of supporting large scale of global platform with low-latency real-time data and big data … historical data, learning KDB/Q skills and other programing languages (e.g. Python w cloud/iceberg/Parquet, Java), and contributing to global platform development with hybrid presence (on-prem & cloud).Proven experience managing large financial databases and datasets consisting of real-time and historical data and excellent ...

supporting EMEA Equities business closely with trading desks in the region. The skills include KDB/Q, Python w (cloud/iceberg/Parquet) etc. The developer role (VP) will be working very closely with global team in other locations (New York, Hong Kong, Pune, etc), building out EMEA … team including traders/quant in EMEAAbility to learn new technologies and business knowledgeOther language experience required Python w/(cloud/iceberg/parquet), Java (a plus), Unix/LinuxExperience of agile methodologies will be an advantageHighly ValuedCapital markets experience, e.g. Derivs, Stocks, index, ETFs tradingProven delivery track ...

Macquarie Group is seeking a Data Platform Engineer to design, build and optimize a petabyte-scale data platform powered by modern cloud technologies in a hybrid work model. You will manage a Data Lake, ensure ...