51 to 69 of 69 Parquet Jobs in England

ability to analyse and address issues and queries quickly and effectively. Recent hands-on experience with Python plus SQL Server and ideally some Parquet exposure. Evidence of strong delivery throughout the entire lifecycle. Strong problem-solving skills and capability to write code quickly and accurately, plus experience of troubleshooting ...

Job Title Senior Data Engineer Job Description Summary Senior Data Engineer | Databricks | Agentic AI | EMEA & APAC We are the team leading the data transformation of our EMEA and APAC business, and we are hiring a ...

engineering experience: schema design, storage formats, compression, I/O trade-offs, and pipelines processing hundreds of terabytes. Experience with columnar formats such as Parquet or Arrow, or comparable domain‐specific formats used for event logs, telemetry, or replays. Experience designing and operating services or platforms used by other ...

relational database knowledge, including data extraction and quality management Experience working with Data Warehouse and ETL processes, alongside formats such as CSV, JSON and Parquet Excellent stakeholder management skills with the ability to influence decision-making at all levels of the business Successful candidates must be able to obtain ...

Backend: Distributed, event-driven core Java (90% of the code-base), MySQL, Kafka Frontend: Javascript, Vue.js Deployment: Kubernetes, Nomad Data analytics: Python & Jupyter notebooks, Parquet, Docker Testing: JUnit, JMH, JCStress, Jenkins, Selenium, many in-house tools... OS: Linux (Fedora for development, Rocky in production) The LMAX ...

data contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate data from REST APIs and other source systems, working with Parquet and S3-compatible object storage. Implement data validation, assurance, metadata management and traceability to ensure data is accurate, complete and fit for purpose. Develop … routing, transformation and orchestration. Experience of data modelling and schema design, including defining data contracts or Interface Control Documents (ICDs). Experience working with Parquet and S3-compatible object storage. Experience integrating REST APIs and troubleshooting data exchanges between systems. Experience deploying or supporting data solutions within OpenShift ...

models, schemas, data contracts and Interface Control Documents (ICDs) to support reliable system integration. Integrate data from REST APIs and other source systems, including Parquet and S3-compatible object storage. Implement data validation, assurance, metadata management and data traceability. Develop tools to support data-driven insights and task automation. … with Apache NiFi for data ingestion, routing, transformation and orchestration. Data modelling and schema design, including data contracts or Interface Control Documents (ICDs). Parquet and S3-compatible object storage. REST API integration and troubleshooting data exchanges between systems. OpenShift or Kubernetes environments. GitLab CI/CD practices ...

Design data models, schemas and data contracts/Interface Control Documents (ICDs) . Integrate data from REST APIs and other source systems. Work with Parquet and S3-compatible object storage . Implement data validation, assurance, metadata management and data lineage. Develop automation and data-driven tools to support customer … project or production environments. Strong Python and SQL skills. Hands-on experience with Apache NiFi and data pipeline orchestration. Data modelling and schema design. Parquet and S3-compatible object storage . REST API integration. OpenShift or Kubernetes . GitLab CI/CD and automated build, test and deployment pipelines. ...

Design data models, schemas and data contracts/Interface Control Documents (ICDs) . Integrate data from REST APIs and other source systems. Work with Parquet and S3‐compatible object storage . Implement data validation, assurance, metadata management and data lineage. Develop automation and data‐driven tools to support customer … project or production environments. Strong Python and SQL skills. Hands‐on experience with Apache NiFi and data pipeline orchestration. Data modelling and schema design. Parquet and S3‐compatible object storage . REST API integration. OpenShift or Kubernetes . GitLab CI/CD and automated build, test and deployment pipelines. ...

Apache DataFusion, Apache Comet, and Velox for data processing and query execution Apache Iceberg for table management and catalog interoperability Apache Arrow and Apache Parquet for in-memory data processing and columnar storage Industry-standard build tooling, including Gradle, Cargo, and GitHub. Core Responsibilities Designing and implementing query planning ...

high-quality production code Strong foundation in operating systems and systems programming Proven track record in performance engineering Familiarity with tools like Apache Arrow, Parquet, DataFusion, Clickhouse, or DuckDB is a plus Understanding of cutting-edge ML infrastructure stack (e.g. PyTorch, CUDA) is also a plus Experience with Rust ...

Build and operate data and analytics services that power critical markets risk decisions at scale. In this senior, hands-on role, you will lead complex engineering initiatives across a modern cloud and big data stack ...

data contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate data from REST APIs and other source systems, working with Parquet and S3-compatible object storage. Implement data validation, assurance, metadata management and traceability to ensure data is accurate, complete and fit for purpose. Develop … Strong Python and SQL skills. Hands-on experience with Apache NiFi and data pipeline orchestration. Experience with data modelling and schema design. Experience with Parquet and S3-compatible object storage. Experience with REST API integration. Experience with OpenShift or Kubernetes. Experience with GitLab CI/CD practices and pipelines. ...

data contracts/Interface Control Documents (ICDs) to support reliable integration between systems. Integrate data from REST APIs and other source systems, working with Parquet and S3-compatible object storage. Implement data validation, assurance, metadata management and traceability to ensure data is accurate, complete and fit for purpose. Develop … Strong Python and SQL skills. Hands-on experience with Apache NiFi and data pipeline orchestration. Experience with data modelling and schema design. Experience with Parquet and S3-compatible object storage. Experience with REST API integration. Experience with OpenShift or Kubernetes. Experience with GitLab CI/CD practices and pipelines. ...

ensuring FDJ United remains a leader in the data-driven online gambling industry. Your work will involve shaping lakehouse and data-lake paradigms, leveraging Parquet and Iceberg for high-performance data storage, and adopting scalable Spark frameworks for large-scale processing. Ultimately, you will enable self-service analytics, personalised … compliance requirements. Technical Mastery & Hands‐On Skills: Advanced knowledge of Java/Spring, Python, Docker, Kubernetes, AWS and DevOps methodologies. Familiarity with Spark, Iceberg, Parquet, and other solutions for large‐scale data processing. AI/ML & Analytics Background: Competent in ML & analytics, with exposure to LLMOps and MLOps practices ...

At Movar, we understand that project delivery is getting increasingly complex. Since 2013, we’ve been helping companies of all sizes improve the way projects are delivered. Our mission is to be the number one ...

capabilities across large tables and diverse workloads. You will work with Java, Rust, Scala, or C++ and engage with Spark, DataFusion, Iceberg, Arrow, and Parquet in a high-performance environment that values #J-18808-Ljbffr ...

At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market. What ...

A tier-one global investment bank is scaling its strategic Post Trade Data Platform across Global Markets, with upcoming initiatives set to grow the platform to 10x current ingestion volumes while raising the bar on ...