26 to 50 of 69 Parquet Jobs in England

/SQL for data modelling and analytics Streamlit for data applications and visualisations Airflow for job scheduling and tracking CircleCI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Terraform for our infrastructure definition Kubernetes for data services and task orchestration Datadog/Grafana ...

experience with Apache Spark and Apache Flink. Strong understanding of Apache HTTP, Envoy, and REST API design. Experience working with Protobuf, Avro, and Parquet data formats. Knowledge of Iceberg, Databricks, and Hadoop ecosystems. Skills that will help Follows TDD, ATDD and Clean Coding practices and used to setting ...

ways of working, and presenting these to the community Here’s a snapshot of the technologies that we use: Scala Apache Spark Databricks Apache Parquet Azure Cloud Platform Azure DevOps (Test plans, Backlogs, Pipelines) GIT What we’re looking for We’d love to hear from ...

Learning – Understanding of AI/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications Advanced Data Management – Strong SQL design, query optimization ...

building lean processes Experience with distributed data processing Experience with monitoring, testing, and data quality Experience building robust pipelines from diverse sources e.g. parquet, SQL & no-SQL databases, API endpoints It would be helpful to have experience/expertise/knowledge in the following: Python AWS Spark & distributed computing ...

evolve the platform. Experience is helpful, but not essential:* **Languages:** Python, SQL, Terragrunt, JavaScript* **Cloud:** AWS (primary), some GCP* **Warehouse & Storage:** Snowflake, S3/Parquet* **Data & ETL:** dbt, Fivetran* **Platform & Infra:** Kubernetes, Kafka, RabbitMQ, Argo, GitHub Actions, HashiCorp Vault* **Observability:** Datadog, Grafana* **Dashboarding:** Preset* **Other**: Claude### **What ...

modern data stack, building data ingestion pipelines and working with ETL and orchestration tools (e.g., Airflow, Luigi, Argo, dbt), big data technologies (Spark, Kafka, Parquet), and web frameworks for model serving (e.g. Flask or FastAPI). Data Science: Familiarity or experience with classical NLP techniques (BERT, topic modelling, summarisation ...

these capabilities responsibly. Modern Data Platform Expertise You're familiar with contemporary data platforms and tools, including data lakes, open table formats such as Parquet and Iceberg, ETL and ELT pipelines, multiple query engines, and BI tools such as Power BI. You're comfortable working across cloud environments including ...

experience Strong Python experience (PySpark, Pandas, Jupyter Notebooks etc.) Airflow/Algo for workflow management Git Any exposure to compressed file formats, such as Parquet or HDF5, is highly advantageous Linux/Bash skills are highly desirable Job title: Data Analyst Client: Elite FinTech Salary ...

. Experience with SQL and noSQL environments, Azure SQL database and Storage Account - blob is must Familiarity with data formats such as GRIP, NETCDF, Parquet, and JSON is a plus. Knowledge of PowerShell, Git, ARM templates, Bicep, Terraform and deployment automation using Azure DevOps. Experience in using tooling such ...

. Experience with SQL and noSQL environments, Azure SQL database and Storage Account – blob is must Familiarity with data formats such as GRIP, NETCDF, Parquet, and JSON is a plus. Knowledge of PowerShell, Git, ARM templates, Bicep, Terraform and deployment automation using Azure DevOps. Experience in using tooling such ...

definition Kubernetes for data services and task orchestration Argo CD for application deployments Airflow purely for job scheduling and tracking CircleCI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Postgres/Aurora for our relational databases Spark for data processing dbt for data ...

Role Description The Business Analyst/Project Manager will support a transformation program for a top-tier banking client, aligned to an ECB Remediation approach. The Technical Analyst will support a Data Governance & Controls remediation ...

real downstream consumers. Work with economists and engineers to turn modelling decisions into reliable production data. Essential Strong production Python. Datasets in pandas and Parquet/Arrow, plus an analytical engine, e.g. DuckDB, or a warehouse such as Snowflake. Orchestrated batch pipelines you've operated, not just written: Dagster ...

matters, say so. Exchange APIs and real‐time/streaming systems (Kafka, Redpanda, NATS). Time‐series stores (ClickHouse, kdb+) and the Arrow/Parquet world. Infrastructure‐as‐code (Terraform) and CI/CD. How we work Small team, no layers, no theatre. You’ll own things ...

SOAP services, file transfers, batch ingestion, legacy adapters and bespoke interfaces. Experience with structured, semi-structured and unstructured data formats including CSV, XML, JSON, Parquet, Avro and proprietary formats. Experience designing solutions that operate across multiple security classifications and secure domains. Strong knowledge of data governance, lineage, metadata management ...

work effectively with remote teams"**Experience with the Following is Desirable:*** Go* Pinot or other time-series/OLAP-style database* Iceberg* Kubernetes* Jenkins* Parquet* Protocol Buffers/GRPC#LI-MZ1**Benefits of Working at CrowdStrike:*** Market leader in compensation and equity awards* Comprehensive physical and mental wellness programs* Competitive ...

Experience with tools such as Pandas, Polars, Dask or PySpark Experience building data platforms, ETL systems, data lakes, warehouses or lakehouse architectures Knowledge of Parquet, Arrow or similar columnar formats Experience with distributed systems technologies such as Kafka and Redis Strong understanding of performance optimisation and debugging Nice ...

Glue Amazon S3 AWS Lake Formation Amazon Athena Experience building Lakehouse architectures and modern data platforms. Experience working with data formats such as Parquet and Iceberg tables. Strong experience with Terraform for infrastructure automation. #J-18808-Ljbffr ...

SSIS, Azure Data Factory and related cloud services. Support API-based integrations, with Workday integration experience considered good to have. Contribute to data snapshotting, Parquet-based storage and Fabric/lakehouse development where required. Apply good engineering practices, including source control, testing, peer review, monitoring and controlled deployments. Identify ...

PostgreSQL, and cloud databases Proven track record with complex data migration projects (terabyte+ datasets, multiple legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing ...

PostgreSQL, and cloud databases Proven track record with complex data migration projects (terabyte+ datasets, multiple legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing ...

survivorship bias, and reconstructing what was knowable on a given date. Statistical modelling and optimisation (statsmodels, cvxpy; PyTorch useful). Datasets in pandas and Parquet/Arrow, plus an analytical engine such as DuckDB. Nice to have Quantitative research background, academic or industry. Index construction and classification taxonomies. Working ...

event-driven architectures or data pipelines. Also Welcome Kubernetes. Deploying, running or debugging workloads, including K3s, RKE2 or OpenShift. Data at scale. Spark, Trino, Parquet, Iceberg or similar columnar and distributed query tooling. GPU workloads and serving models on-premise. Open source contributions or a portfolio worth a look. ...

event-driven architectures or data pipelines. Also Welcome Kubernetes. Deploying, running or debugging workloads, including K3s, RKE2 or OpenShift. Data at scale. Spark, Trino, Parquet, Iceberg or similar columnar and distributed query tooling. GPU workloads and serving models on-premise. Open source contributions or a portfolio worth a look. ...