26 to 50 of 54 Parquet Jobs in England

definition Kubernetes for data services and task orchestration Argo CD for application deployments Airflow purely for job scheduling and tracking CircleCI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Postgres/Aurora for our relational databases Spark for data processing dbt for data ...

these capabilities responsibly. Modern Data Platform Expertise You're familiar with contemporary data platforms and tools, including data lakes, open table formats such as Parquet and Iceberg, ETL and ELT pipelines, multiple query engines, and BI tools such as Power BI. You're comfortable working across cloud environments including ...

Role Description The Technical Analyst – Data Lineage will support a Data Governance, Controls, and Reporting program for a top-tier banking client. Responsible for establishing and validating end-to-end lineage across critical datasets used ...

Glue Amazon S3 AWS Lake Formation Amazon Athena Experience building Lakehouse architectures and modern data platforms. Experience working with data formats such as Parquet and Iceberg tables. Strong experience with Terraform for infrastructure automation. #J-18808-Ljbffr ...

Job Title Senior Data Engineer Job Description Summary Senior Data Engineer | Databricks | Agentic AI | EMEA & APAC We are the team leading the data transformation of our EMEA and APAC business, and we are hiring a ...

Python (3.11+), pandas and NumPy skills. Production-grade Streamlit dashboard development. Data integration using Snowflake, OpenSearch, REST APIs and SQL. AWS experience (boto3, S3, Parquet). Data visualisation with Plotly, Matplotlib or Seaborn. Experience with Docker, Kubernetes, CI/CD and pytest. Knowledge of statistical analysis, anomaly detection ...

experience Strong Python experience (PySpark, Pandas, Jupyter Notebooks etc.) Airflow/Algo for workflow management Git Any exposure to compressed file formats, such as Parquet or HDF5, is highly advantageous Linux/Bash skills are highly desirable Job title: Data Analyst Client: Elite FinTech Salary ...

Useful: Experience engineering systems for the cloud-based storage and processing of large datasets or using frameworks such as Spark and open standards like Parquet and Arrow. Experience working with other cloud and related technologies, such as Docker and Kubernetes. Experience working as a software developer in the quantitative ...

SSIS, Azure Data Factory and related cloud services. Support API-based integrations, with Workday integration experience considered good to have. Contribute to data snapshotting, Parquet-based storage and Fabric/lakehouse development where required. Apply good engineering practices, including source control, testing, peer review, monitoring and controlled deployments. Identify ...

Requisition ID 189316 -Posted 11/06/2026 Design, develop, test, deploy, and maintain scalable ETL/ELT pipelines for structured and unstructured data. Build batch and real-time processing solutions using BigQuery, Dataflow ...

Python and best practices. The role requires strong Python skills, experience with cloud platforms (Azure), Spark/Databricks, and data storage technologies such as Parquet/Delta Lake. #J-18808-Ljbffr ...

development (multi-page, session state, query-param nav)API/SQL data integration (Snowflake, OpenSearch, REST sources)Visualization: plotly, matplotlib, seabornAWS (boto3, S3/Parquet), Docker, Kubernetes, CI/CDSecrets/auth (JWT, cryptography, proxy handling); testing with pytestData Science/AnalyticsApplied statistics for anomaly detection (rolling median + ...

disaster recovery and workload separation, including within Standard edition licensing constraints You're familiar with modern data platforms and tooling, including Azure Data Lake, Parquet, Synapse, analytics services and managed ELT tools such as Fivetran You have experience of leading technical teams and translating expertise into standards, runbooks ...

what to do when performance drifts. Nice to have Experience working with scientific or scholarly text. Familiarity with AWS (S3, Batch, Lambda, SageMaker) and Parquet or Iceberg data lake patterns. Experience running LLMs under real cost and latency budgets in production. Some exposure to agentic AI applications: tool ...

that deliver value to real users. Nice to have Experience working with scientific or scholarly text. Familiarity with AWS (S3, Batch, Lambda, SageMaker) and Parquet or Iceberg data lake patterns. Experience running LLMs under real cost and latency budgets in production. Some exposure to agentic AI applications: tool ...

other genome browser Experience working in a multi‐person team delivering production services Experience with large‐scale biological datasets Experience working with the Apache Parquet file format Experience implementing AI/ML approaches for quality control and/or genome annotation Behaviours we value in our team You bring ...

Apache DataFusion, Apache Comet, and Velox for data processing and query execution Apache Iceberg for table management and catalog interoperability Apache Arrow and Apache Parquet for in-memory data processing and columnar storage Gradle and Cargo for builds, and GitHub for collaboration What We Value Curiosity about how data ...

Apache DataFusion, Apache Comet, and Velox for data processing and query execution Apache Iceberg for table management and catalog interoperability Apache Arrow and Apache Parquet for in-memory data processing and columnar storage Industry-standard build tooling, including Gradle, Cargo, and GitHub. Core Responsibilities Designing and implementing query planning ...

cloud-native infrastructure and data engineering Someone comfortable debugging complex production issues and making architectural decisions independently Experience with Kafka, Iceberg, Athena or Parquet would be a bonus. You'll be the go-to engineer for MLOps within a lean technical team, with genuine ownership over the platform rather ...

Backend: Distributed, event-driven core Java (90% of the code-base), MySQL, Kafka Frontend: Javascript, Vue.js Deployment: Kubernetes, Nomad Data analytics: Python & Jupyter notebooks, Parquet, Docker Testing: JUnit, JMH, JCStress, Jenkins, Selenium, many in-house tools... OS: Linux (Fedora for development, Rocky in production) The LMAX ...

Backend: Distributed, event-driven core Java (90% of the code-base), MySQL, Kafka •Frontend: Javascript, Vue.js •Deployment: Kubernetes, Nomad •Data analytics: Python & Jupyter notebooks, Parquet, Docker •Testing: JUnit, JMH, JCStress, Jenkins, Selenium, many in-house tools... •OS: Linux (Fedora for development, Rocky in production) The LMAX ...

At Movar, we understand that project delivery is getting increasingly complex. Since 2013, we’ve been helping companies of all sizes improve the way projects are delivered. Our mission is to be the number one ...

high-quality production code Strong foundation in operating systems and systems programming Proven track record in performance engineering Familiarity with tools like Apache Arrow, Parquet, DataFusion, Clickhouse, or DuckDB is a plus Understanding of cutting-edge ML infrastructure stack (e.g. PyTorch, CUDA) is also a plus Experience with Rust ...

Senior Data Engineer – Remote (Senior Data Engineer, Data Engineer, SQL, T-SQL, SQL Server, Azure SQL, Python, PySpark, Microsoft Fabric, Databricks, Synapse, Delta/Parquet, Power BI, Agentic AI, Infrastructure as code, IaC, CI/CD, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … modelling experience and strong Python (PySpark, notebooks). Exposure to Microsoft Fabric is required, or at least Databricks/Synapse and the Delta/Parquet ecosystem, as well as Power BI semantic modelling. You will also need an understanding of information security and data protection in an engineering context ...

Senior Data Engineer – Remote (Senior Data Engineer, Data Engineer, SQL, T-SQL, SQL Server, Azure SQL, Python, PySpark, Microsoft Fabric, Databricks, Synapse, Delta/Parquet, Power BI, Agentic AI, Infrastructure as code, IaC, CI/CD, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … modelling experience and strong Python (PySpark, notebooks). Exposure to Microsoft Fabric is required, or at least Databricks/Synapse and the Delta/Parquet ecosystem, as well as Power BI semantic modelling. You will also need an understanding of information security and data protection in an engineering context ...