of automation IT WOULD BE NICE FOR THE SENIOR SOFTWARE ENGINEER TO HAVE.... Cloud based experience Microservice architecture or server-less architecture Big Data/Messaging technologies such as Apache Nifi/MiNiFi/Kafka TO BE CONSIDERED.... Please either apply by clicking online or emailing me directly to For further information please call me on . I can More ❯
. Solid understanding of DevOps principles and agile delivery. Excellent problem-solving skills and a proactive, team-oriented approach. Confident client-facing communication skills. Desirable Skills & Experience Experience with Apache NiFi and Node.js . Familiarity with JSON, XML, XSD, and XSLT . Knowledge of Jenkins, Maven, BitBucket, and Jira . Exposure to AWS and cloud technologies. Experience working within More ❯
JUnit 5, Mockito, database integration. AI: LangChain, Retrieval-Augmented Generation (RAG), MCP servers (as consumer and developer), and prompt engineering for LLM optimization. Exposure to popular libraries and frameworks (Apache Commons, Guava, Swagger, TestContainers). Architecture & Platforms: Skilled in designing and deploying distributed systems on cloud hyperscalers (AWS, GCP). Familiarity with containerization (Docker), CI/CD pipelines, DevOps More ❯
JUnit 5, Mockito, database integration. AI: LangChain, Retrieval-Augmented Generation (RAG), MCP servers (as consumer and developer), and prompt engineering for LLM optimization. Exposure to popular libraries and frameworks (Apache Commons, Guava, Swagger, TestContainers). Architecture & Platforms:Skilled in designing and deploying distributed systems on cloud hyperscalers (AWS, GCP). Familiarity with containerization (Docker), CI/CD pipelines, DevOps More ❯
JUnit 5, Mockito, database integration. AI: LangChain, Retrieval-Augmented Generation (RAG), MCP servers (as consumer and developer), and prompt engineering for LLM optimization. Exposure to popular libraries and frameworks (Apache Commons, Guava, Swagger, TestContainers). Architecture & Platforms: Skilled in designing and deploying distributed systems on cloud hyperscalers (AWS, GCP). Familiarity with containerization (Docker), CI/CD pipelines, DevOps More ❯
Deep Learning or LLM Frameworks) Desirable Minimum 2 years experience in Data related field Minimum 2 years in a Business or Management Consulting field Experience of Docker, Hadoop, PySpark, Apache or MS Azure Minimum 2 years NHS/Healthcare experience Disclosure and Barring Service Check This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and More ❯
Saffron Walden, Essex, South East, United Kingdom Hybrid / WFH Options
EMBL-EBI
advantagioous Good communication skills Experience in Python and/or Java development Experience in git and basic Unix Commands You may also have Experience with large data processing technologies (Apache Spark) Other helpful information Hybrid Working: At EMBL-EBI we are pleased to offer hybrid working options for all our employees. Our team work at least two days on More ❯
to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply by clicking online or emailing me directly to For further information please call me on . I can make myself More ❯
start12 month contract Essential Been to school in the UK Data Ingestion of APIs GCP based (Google Cloud Platform) Snowflake BigQuery DBT Semantic layer (Cube/Looker) Desirable Airflow (Apache Airflow More ❯
ensure data integrity and reliability. Optimise data workflows for performance, cost-efficiency, and maintainability using tools such as Azure Data Factory, AWS Data Pipeline for Data Orchestration, Databricks, or Apache Spark. Support the integration of data into visualisation platforms (e.g. Power BI, ServiceNow) and other analytical environments. Ensure compliance with data governance, security, and privacy policies. Document data architecture More ❯
a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data ingestion, transformation, and delivery. … business needs and compliance requirements. • Maintain documentation of data flows and processes, ensuring knowledge sharing and operational transparency. Skills & Experience: You will have the following skills or proven experience: Apache NiFi Expertise: • Deep understanding of core NiFi concepts: FlowFiles, Processors, Controller Services, Schedulers, Web UI. • Experience designing and optimizing data flows for batch, real-time streaming, and event-driven More ❯
a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data ingestion, transformation, and delivery. … business needs and compliance requirements. • Maintain documentation of data flows and processes, ensuring knowledge sharing and operational transparency. Skills & Experience: You will have the following skills or proven experience: Apache NiFi Expertise: • Deep understanding of core NiFi concepts: FlowFiles, Processors, Controller Services, Schedulers, Web UI. • Experience designing and optimizing data flows for batch, real-time streaming, and event-driven More ❯
