6 of 6 Remote/Hybrid Contract Apache Jobs

experience as a Data Engineer or Senior Data Engineer Expert-level Python development skills Extensive hands-on experience with Databricks in enterprise environments Strong Apache Spark and PySpark expertise Advanced SQL development and optimisation skills Experience designing and building large-scale ETL and data integration solutions Strong understanding ...

have skills: RabbitMQ Java/Microservices MongoDB/MySQL Kubernetes Grafana/Prometheus Gitlab Job Scheduling tooling (e.g. Berlin/JS7 Job Scheduler, TWS, Apache Airflow). Reporting and visualisation tooling (from Pentaho BA, Power BI, SAP Business Objects). Nice to have: Experience with databases/data platforms ...

kubernetes) Experience with Key value stores Experience in git and basic Unix Commands You might also have (Desirable) Experience with large data processing technologies (Apache Spark) Other helpful information Hybrid Working: At EMBL-EBI we are pleased to offer hybrid working options for all our employees. A dedicated desk ...

working within large and complex technical programmes. Understanding of ITIL/service management principles . Current SC or DV clearance. Desirable Experience with IIS, Apache, Tomcat or other middleware/application servers . PowerShell, Bash or other scripting/automation experience. Knowledge of CI/CD and DevOps practices ...

data exchange platform. This is a hands-on engineering and architecture role, combining the design of reusable, reliable data pipelines with practical development using Apache NiFi, RDF, SPARQL, Python and Java. The platform will use open-source, cloud-agnostic technologies to ingest, transform, validate and exchange data securely between … systems. Skills and Experience: Proven experience designing and delivering data integration or ETL solutions using Apache NiFi. Practical project experience with RDF triples, SPARQL and semantic data modelling. Hands-on development experience in both Python and Java. Experience designing reusable pipelines across APIs, databases, files and other data sources. ...

Scala programming to develop robust, scalable, and high-performance data processing applications. Build and optimise large-scale data processing and analytics pipelines using Apache Spark. Develop and maintain end-to-end data pipelines for both batch and real-time data processing. Apply solid understanding of data engineering concepts, including … business stakeholders. Skills & Experience: Proven experience as a Software Engineer with a strong focus on Scala development. Extensive hands-on experience with OpenShift and Apache Spark. In-depth understanding of data engineering principles and practises. Experience in developing and maintaining scalable data pipelines for batch and real-time processing. ...