9 of 9 Parquet Jobs in the South East

ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience with containerisation and orchestration technologies, including Docker and Kubernetes. Experience using Git/GitHub and working within collaborative development environments. ...

manage environments Implementing logging, monitoring and alerting across production systems Working with technologies such as Pandas, Pydantic, Airflow, AWS Glue, Docker, JSON and Parquet Working alongside data scientists, engineers and multidisciplinary delivery teams Supporting and mentoring other engineers and sharing technical knowledge WHAT WE'RE LOOKING ...

standards such as metrics and use of test tools Here’s a snapshot of the technologies that we use: Scala Apache Spark Databricks Apache Parquet Azure Cloud Platform Azure DevOps (Test plans, Backlogs, Pipelines) GIT We’d love to hear from you if you have: Good experience in creating ...

ways of working, and presenting these to the community Here’s a snapshot of the technologies that we use: Scala Apache Spark Databricks Apache Parquet Azure Cloud Platform Azure DevOps (Test plans, Backlogs, Pipelines) GIT What we’re looking for We’d love to hear from ...

. Experience with SQL and noSQL environments, Azure SQL database and Storage Account – blob is must Familiarity with data formats such as GRIP, NETCDF, Parquet, and JSON is a plus. Knowledge of PowerShell, Git, ARM templates, Bicep, Terraform and deployment automation using Azure DevOps. Experience in using tooling such ...

event-driven architectures or data pipelines. Also Welcome Kubernetes. Deploying, running or debugging workloads, including K3s, RKE2 or OpenShift. Data at scale. Spark, Trino, Parquet, Iceberg or similar columnar and distributed query tooling. GPU workloads and serving models on-premise. Open source contributions or a portfolio worth a look. ...

Description We’re looking for a Data Engineer with a strong background in bioinformatics and genetics to help build the data pipelines supporting Our Future Health’s growing Clinical Research Recruitment Service. This is an ...

Description We’re looking for a Data Engineer with a strong background in bioinformatics and genetics to help build the data pipelines supporting Our Future Health’s growing Clinical Research Recruitment Service. This is an ...

Senior Data Engineer - Remote (Senior Data Engineer, Data Engineer, SQL, T-SQL, SQL Server, Azure SQL, Python, PySpark, Microsoft Fabric, Databricks, Synapse, Delta/Parquet, Power BI, Agentic AI, Infrastructure as code, IaC, CI/CD, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … modelling experience and strong Python (PySpark, notebooks). Exposure to Microsoft Fabric is required, or at least Databricks/Synapse and the Delta/Parquet ecosystem, as well as Power BI semantic modelling. You will also need an understanding of information security and data protection in an engineering context ...