analyze and troubleshoot infrastructure issues. Document configurations, procedures, and technical processes in a clear and concise manner. Required Skills and Experience: Advanced understanding of Linux operating systems (Ubuntu / CentOS / RHEL). Strong experience with infrastructure as code (IaC) principles. Expertise in configuration management tools: Puppet and … on experience with containerization platforms: Docker and Kubernetes. Virtualization experience with VMware 7.x environments. Working knowledge of cloud platforms, especially AWS. Proficiency in databases: PostgreSQL and / or MySQL. Experience with web / application servers such as Apache or NGINX, and WSGI. In-depth understanding of service health … Monitoring & Log Management: Elasticsearch, OpenSearch, Logstash, Filebeat, Graylog DCIM / IPAM: NetBox Automation & Orchestration: Ansible, Puppet, Terraform Virtualization & Cloud: VMware, AWS Operating Systems: Linux (Ubuntu, CentOS, RHEL) Databases: NoSQL, MySQL, PostgreSQLMore ❯
Processing & Optimization: Build efficient, high-performance systems by leveraging techniques like data denormalization , partitioning , caching , and parallel processing . Develop stream-processing applications using Apache Kafka and optimize performance for large-scale datasets . Enable data enrichment and correlation across primary, secondary, and tertiary sources. Cloud, Infrastructure, and Platform Engineering … Collaborate with platform teams to ensure scalability, resilience, and observability of data pipelines. Database Engineering: Write and optimize complex SQL queries on relational (Redshift, PostgreSQL) and NoSQL (MongoDB) databases. Work with ELK stack (Elasticsearch, Logstash, Kibana) for search, logging, and real-time analytics. Support Lakehouse architectures and hybrid data … technologies and automation strategies. Required Skills & Qualifications: 8+ years of experience in data engineering within a production environment. Advanced knowledge of Python and Linux shell scripting for data manipulation and automation. Strong expertise in SQL / NoSQL databases such as PostgreSQL and MongoDB. Experience building stream processing systems More ❯
chelmsford, east anglia, united kingdom Hybrid / WFH Options
EMBL-EBI
services, including microservice deployment Developing and maintaining data pipelines to process and manage large-scale structural biology data Working with workflow orchestration tools like Apache Airflow and Nextflow To liaise with the EMBL-EBI Technical Services Cluster To support the development and deployment of other scientific software The successful candidate … have MSc in computer science, IT or a related field, or in bioinformatics with a demonstrated IT expertise Expert in Python (3.x) Expert Linux scripting Proficiency in containerisation Proficiency in relational databases (Oracle, PostgreSQL) Experience in developing and maintaining data pipelines Hands-on experience with workflow orchestration tools (e.g. … Apache Airflow, Nextflow) Strong interpersonal and communication skills Proficiency in oral and written English You may also have PhD in computer science, IT or a related field, or in bioinformatics with a demonstrated IT expertise Experience in using Kubernetes Experience with web servers (Apache/ Nginx) Hands-on experience More ❯
saffron walden, east anglia, united kingdom Hybrid / WFH Options
EMBL-EBI
services, including microservice deployment Developing and maintaining data pipelines to process and manage large-scale structural biology data Working with workflow orchestration tools like Apache Airflow and Nextflow To liaise with the EMBL-EBI Technical Services Cluster To support the development and deployment of other scientific software The successful candidate … have MSc in computer science, IT or a related field, or in bioinformatics with a demonstrated IT expertise Expert in Python (3.x) Expert Linux scripting Proficiency in containerisation Proficiency in relational databases (Oracle, PostgreSQL) Experience in developing and maintaining data pipelines Hands-on experience with workflow orchestration tools (e.g. … Apache Airflow, Nextflow) Strong interpersonal and communication skills Proficiency in oral and written English You may also have PhD in computer science, IT or a related field, or in bioinformatics with a demonstrated IT expertise Experience in using Kubernetes Experience with web servers (Apache/ Nginx) Hands-on experience More ❯
Saffron Walden, Essex, South East, United Kingdom Hybrid / WFH Options
EMBL-EBI
services, including microservice deployment Developing and maintaining data pipelines to process and manage large-scale structural biology data Working with workflow orchestration tools like Apache Airflow and Nextflow To liaise with the EMBL-EBI Technical Services Cluster To support the development and deployment of other scientific software The successful candidate … have MSc in computer science, IT or a related field, or in bioinformatics with a demonstrated IT expertise Expert in Python (3.x) Expert Linux scripting Proficiency in containerisation Proficiency in relational databases (Oracle, PostgreSQL) Experience in developing and maintaining data pipelines Hands-on experience with workflow orchestration tools (e.g. … Apache Airflow, Nextflow) Strong interpersonal and communication skills Proficiency in oral and written English You may also have PhD in computer science, IT or a related field, or in bioinformatics with a demonstrated IT expertise Experience in using Kubernetes Experience with web servers (Apache/ Nginx) Hands-on experience More ❯