51 to 75 of 110 Parquet Jobs in the UK excluding London

ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience working within Agile delivery teams. Competitive base salary from £74,000 per annum Generous Pension Scheme We invest in your ...

ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience working within Agile delivery teams. Competitive base salary from £74,000 per annum Generous Pension Scheme We invest in your ...

ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience working within Agile delivery teams. Competitive base salary from £74,000 per annum Generous Pension Scheme We invest in your ...

ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience working within Agile delivery teams. Competitive base salary from £74,000 per annum Generous Pension Scheme We invest in your ...

ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience working within Agile delivery teams. Competitive base salary from £74,000 per annum Generous Pension Scheme We invest in your ...

including Kafka, Azure Functions or Azure Service Bus. Strong understanding of Spark processing and performance tuning. Experience working with file formats and partitioning, including Parquet, JSON, XML and CSV. Experience with Azure DevOps/GitHub and CI/CD. Strong programming experience in Python, with knowledge of other programming ...

Glue Database Technologies Data processing libraries & Schema Management tools like Pandas and Pydantic Storage Formats: Familiarity with data types such as JSON and Parquet DevOps and DataOps Experience of IaC tools, particularly Terraform Understanding of implementing logging, monitoring and alerting for enterprise level pipelines Understanding of access controls, policies ...

Glue Database Technologies Data processing libraries & Schema Management tools like Pandas and Pydantic Storage Formats: Familiarity with data types such as JSON and Parquet DevOps and DataOps Experience of IaC tools, particularly Terraform Understanding of implementing logging, monitoring and alerting for enterprise level pipelines Understanding of access controls, policies ...

Fabric, Medallion and Data Products. Hands on mindset : Fluent in the language of data, whether SQL, Python, PySpark, R or Scala. Open formats including Parquet, Iceberg and JSON. Agile Ways of Working Run and contribute to agile ceremonies, helping to shape and improve the agile process Work with ...

patterns (Debezium or equivalent) Stream processing (Apache Flink, Spark Structured Streaming, or equivalent) SQL and query optimisation at scale Data and table formats (Parquet, Avro, Apache Iceberg or Delta Lake) Experience designing SaaS data models, tenant isolation, shared schemas, access patterns, at scale. Ability to communicate architecture decisions ...

data orchestration across multiple sources and systems. Experience designing data models, schemas, data contracts and integration frameworks. Strong understanding of REST API integration, Parquet data formats and S3-compatible object storage. Experience deploying or supporting data platforms within OpenShift or Kubernetes environments. Knowledge of GitLab CI/ ...

manage environments Implementing logging, monitoring and alerting across production systems Working with technologies such as Pandas, Pydantic, Airflow, AWS Glue, Docker, JSON and Parquet Working alongside data scientists, engineers and multidisciplinary delivery teams Supporting and mentoring other engineers and sharing technical knowledge WHAT WE'RE LOOKING ...

manage environments Implementing logging, monitoring and alerting across production systems Working with technologies such as Pandas, Pydantic, Airflow, AWS Glue, Docker, JSON and Parquet Working alongside data scientists, engineers and multidisciplinary delivery teams Supporting and mentoring other engineers and sharing technical knowledge WHAT WE'RE LOOKING ...

manage environments Implementing logging, monitoring and alerting across production systems Working with technologies such as Pandas, Pydantic, Airflow, AWS Glue, Docker, JSON and Parquet Working alongside data scientists, engineers and multidisciplinary delivery teams Supporting and mentoring other engineers and sharing technical knowledge WHAT WE'RE LOOKING ...

manage environments Implementing logging, monitoring and alerting across production systems Working with technologies such as Pandas, Pydantic, Airflow, AWS Glue, Docker, JSON and Parquet Working alongside data scientists, engineers and multidisciplinary delivery teams Supporting and mentoring other engineers and sharing technical knowledge WHAT WE'RE LOOKING ...

Experience with Delta Lake and Lakehouse architectures Good grasp of data modelling, orchestration and workflow automation Comfortable working with structured and semi-structured data (Parquet, JSON, CSV) Solid understanding of CI/CD and Git-based workflows Experience with data quality checks, testing and monitoring Why Apply? Genuine input ...

building lean processes Experience with distributed data processing Experience with monitoring, testing, and data quality Experience building robust pipelines from diverse sources e.g. parquet, SQL & no-SQL databases, API endpoints It would be helpful to have experience/expertise/knowledge in the following: Python AWS Kubernetes Spark & distributed ...

standards such as metrics and use of test tools Here’s a snapshot of the technologies that we use: Scala Apache Spark Databricks Apache Parquet Azure Cloud Platform Azure DevOps (Test plans, Backlogs, Pipelines) GIT We’d love to hear from you if you have: Good experience in creating ...

production environments Develop ingestion and egress patterns to support reliable data access and integration Work with structured and semi-structured data (e.g. JSON, Parquet) Build and maintain data models across a cloud data platform Design and implement APIs to expose data for downstream consumers Contribute to cloud-based data ...

ways of working, and presenting these to the community Here’s a snapshot of the technologies that we use: Scala Apache Spark Databricks Apache Parquet Azure Cloud Platform Azure DevOps (Test plans, Backlogs, Pipelines) GIT What we’re looking for We’d love to hear from ...

modern data stack, building data ingestion pipelines and working with ETL and orchestration tools (e.g., Airflow, Luigi, Argo, dbt), big data technologies (Spark, Kafka, Parquet), and web frameworks for model serving (e.g. Flask or FastAPI). Data Science: Familiarity or experience with classical NLP techniques (BERT, topic modelling, summarisation ...

. Experience with SQL and noSQL environments, Azure SQL database and Storage Account – blob is must Familiarity with data formats such as GRIP, NETCDF, Parquet, and JSON is a plus. Knowledge of PowerShell, Git, ARM templates, Bicep, Terraform and deployment automation using Azure DevOps. Experience in using tooling such ...

real downstream consumers. Work with economists and engineers to turn modelling decisions into reliable production data. Essential Strong production Python. Datasets in pandas and Parquet/Arrow, plus an analytical engine, e.g. DuckDB, or a warehouse such as Snowflake. Orchestrated batch pipelines you've operated, not just written: Dagster ...

PostgreSQL, and cloud databases Proven track record with complex data migration projects (terabyte+ datasets, multiple legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing ...

PostgreSQL, and cloud databases Proven track record with complex data migration projects (terabyte+ datasets, multiple legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing ...