microservices Integrate with and optimize data persistence layers using MongoDB (preferably MongoDB Atlas) , Redis , or DynamoDB Implement distributed caching strategies with Redis, Hazelcast, or Apache Ignite Work closely with DevOps to containerize applications using Docker Must-Have Qualifications 5+ years of hands-on experience in backend development with Java … Production experience with NoSQL databases (MongoDB preferred; DynamoDB, Redis, or similar are a plus) Experience with distributed caching systems such as Redis, Hazelcast, or Apache Ignite Proficiency with Docker and containerized deployments Experience with cloud-based environments (AWS, GCP, or Azure; MongoDB Atlas a strong plus More ❯
City, Edinburgh, United Kingdom Hybrid / WFH Options
ENGINEERINGUK
You will need to login before you can apply for a job. View more categories View less categories Sector Banking and Financial Services Role Professional Contract Type Permanent Hours Full Time About this role About Us The App Hosting team More ❯
years of hands-on experience with big data tools and frameworks. Technical Skills: Proficiency in SQL, Python, and data pipeline tools such as Apache Kafka, Apache Spark, or AWS Glue. Problem-Solving: Strong analytical skills with the ability to troubleshoot and resolve data issues. Communication: Excellent communication skills More ❯
chelmsford, east anglia, united kingdom Hybrid / WFH Options
EMBL-EBI
services, including microservice deployment Developing and maintaining data pipelines to process and manage large-scale structural biology data Working with workflow orchestration tools like Apache Airflow and Nextflow To liaise with the EMBL-EBI Technical Services Cluster To support the development and deployment of other scientific software The successful … Proficiency in containerisation Proficiency in relational databases (Oracle, PostgreSQL) Experience in developing and maintaining data pipelines Hands-on experience with workflow orchestration tools (e.g., Apache Airflow, Nextflow) Strong interpersonal and communication skills Proficiency in oral and written English You may also have PhD in computer science, IT or a … related field, or in bioinformatics with a demonstrated IT expertise Experience in using Kubernetes Experience with web servers (Apache/Nginx) Hands-on experience with CI/CD (GitLab CI/GitHub Actions) Familiarity with networking Familiarity with Java Knowledge of, or affinity with, structural biology and bioinformatics Experience More ❯
saffron walden, east anglia, united kingdom Hybrid / WFH Options
EMBL-EBI
services, including microservice deployment Developing and maintaining data pipelines to process and manage large-scale structural biology data Working with workflow orchestration tools like Apache Airflow and Nextflow To liaise with the EMBL-EBI Technical Services Cluster To support the development and deployment of other scientific software The successful … Proficiency in containerisation Proficiency in relational databases (Oracle, PostgreSQL) Experience in developing and maintaining data pipelines Hands-on experience with workflow orchestration tools (e.g., Apache Airflow, Nextflow) Strong interpersonal and communication skills Proficiency in oral and written English You may also have PhD in computer science, IT or a … related field, or in bioinformatics with a demonstrated IT expertise Experience in using Kubernetes Experience with web servers (Apache/Nginx) Hands-on experience with CI/CD (GitLab CI/GitHub Actions) Familiarity with networking Familiarity with Java Knowledge of, or affinity with, structural biology and bioinformatics Experience More ❯
Saffron Walden, Essex, South East, United Kingdom Hybrid / WFH Options
EMBL-EBI
services, including microservice deployment Developing and maintaining data pipelines to process and manage large-scale structural biology data Working with workflow orchestration tools like Apache Airflow and Nextflow To liaise with the EMBL-EBI Technical Services Cluster To support the development and deployment of other scientific software The successful … Proficiency in containerisation Proficiency in relational databases (Oracle, PostgreSQL) Experience in developing and maintaining data pipelines Hands-on experience with workflow orchestration tools (e.g., Apache Airflow, Nextflow) Strong interpersonal and communication skills Proficiency in oral and written English You may also have PhD in computer science, IT or a … related field, or in bioinformatics with a demonstrated IT expertise Experience in using Kubernetes Experience with web servers (Apache/Nginx) Hands-on experience with CI/CD (GitLab CI/GitHub Actions) Familiarity with networking Familiarity with Java Knowledge of, or affinity with, structural biology and bioinformatics Experience More ❯
Ansible , PowerShell , and Python . Build, configure, and maintain Kubernetes clusters , ensuring high availability, scalability, and security. Deploy and support key applications such as Apache NiFi , Elastic ECK , and JFrog Artifactory . Develop and manage Helm Charts to standardise application deployment. Integrate with and manage HashiCorp Vault for secure … configuration, and operations in production environments. Experience managing applications with Helm Charts and supporting microservices-based architecture. Applications & Services: Direct experience deploying and supporting Apache NiFi , Elastic ECK (ElasticSearch on Kubernetes) , and Artifactory . Familiarity with container image management and application lifecycle support. Security & Infrastructure: Use of HashiCorp Vault More ❯
actively contribute throughout the Agile development lifecycle , participating in planning, refinement, and review ceremonies. Key Responsibilities: Develop and maintain ETL pipelines in Databricks , leveraging Apache Spark and Delta Lake . Design, implement, and optimize data transformations and treatments for structured and unstructured data. Work with Hive Metastore and Unity … technical impact assessments and rationales. Work within GitLab repository structures and adhere to project-specific processes. Required Skills and Experience: Strong expertise in Databricks , Apache Spark , and Delta Lake . Experience with Hive Metastore and Unity Catalog for data governance. Proficiency in Python, SQL, Scala , or other relevant languages. More ❯
consistency and security. Perform data quality assurance , including completeness, accuracy, and transformation validation. Develop and execute unit, integration, and end-to-end tests for Apache Spark processing . Test stateful processing mechanisms and structured streaming pipelines for scalability. Automate pipeline monitoring, failure detection, and alerting mechanisms . Validate pause … . Collaborate with developers, product owners, and business analysts to understand user stories and define test criteria. Required Skills and Experience: Experience in Databricks, Apache Spark, and Delta Lake testing strategies. Strong knowledge of Python, SQL, and Scala for QA automation . Familiarity with Hive Metastore, Unity Catalog , and More ❯
on a contract basis. You will help design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi These roles are supporting our clients team in Worcester (fully onsite), and requires active UK DV clearance. Key Responsibilities: Design, develop, and maintain … secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi Implement data ingestion, transformation, and integration processes, ensuring data quality and security Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards Manage and monitor large-scale … Engineer in secure or regulated environments. Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with Apache NiFi for building and managing complex data flows and integration processes. Knowledge of security practices for handling sensitive data, including encryption, anonymization, and access More ❯
Bournemouth, Dorset, South West, United Kingdom Hybrid / WFH Options
GMA Consulting
async · An expert working with databases and database architecture, SQL and Stored Procedures · Proven experience with Data integration technologies such as Azure Data Factory, Apache airflow, Databricks AutoLoader · Ability to build CI/CD pipelines and infrastructure as code · Experience with event driven data flows and message aggregators (Event … Hub, Apache Kafka) · Good understanding of current and emerging technologies and their potential to deliver business benefits · Hands on experience working with data matching processes would be highly desirable · Ability to translate business strategy into technical solutions and business requirements into technical design As a precondition of employment for More ❯
Bradford, West Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
GMA Consulting
async · An expert working with databases and database architecture, SQL and Stored Procedures · Proven experience with Data integration technologies such as Azure Data Factory, Apache airflow, Databricks AutoLoader · Ability to build CI/CD pipelines and infrastructure as code · Experience with event driven data flows and message aggregators (Event … Hub, Apache Kafka) · Good understanding of current and emerging technologies and their potential to deliver business benefits · Hands on experience working with data matching processes would be highly desirable · Ability to translate business strategy into technical solutions and business requirements into technical design As a precondition of employment for More ❯
Leeds, Yorkshire, United Kingdom Hybrid / WFH Options
Oliver James Associates Ltd
sync/async methods. Expertise in databases, database architecture, SQL, and stored procedures. Strong background in data integration technologies such as Azure Data Factory, Apache Airflow, and Databricks AutoLoader. Proficiency in building CI/CD pipelines and implementing infrastructure as code. Experience with event-driven data flows and message … aggregation technologies (Event Hub, Apache Kafka). A solid understanding of current and emerging technologies and how they can deliver business value. Desirable experience with data matching processes. Strong ability to translate business strategies into technical solutions and business requirements into technical designs. If you're passionate about driving More ❯
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
TalentHawk
early and providing strategic guidance. Support the ongoing development of integration strategies involving Managed File Transfer solutions (e.g., GoAnywhere) and data orchestration platforms (e.g., Apache Airflow). Provide hands-on support and detailed guidance on particularly complex integration designs where necessary. Maintain current knowledge of industry trends, technology advancements … and migrations. Familiarity with IBM Maximo asset management platform. Knowledge and experience with Managed File Transfer solutions (e.g., GoAnywhere). Understanding and experience with Apache Airflow orchestration platform. Strong grasp of integration best practices, security considerations, and data flow management. Ability to work collaboratively across distributed teams and multiple More ❯
Leeds, Yorkshire, United Kingdom Hybrid / WFH Options
Sportserve
Sportserve forms part of a remarkable group of B2C sports betting and B2B sportsbook technology companies, focused on delivering first class sports betting experiences and casino products for our users worldwide. Along with Sportion, TechSpirit, Standard Focus and Sportelligent, we More ❯
Bristol, Gloucestershire, United Kingdom Hybrid / WFH Options
Apacheix
disciplinary teams that may be from multiple organisations Working with your clients to help them deliver their goals successfully, whilst demonstrating and upholding the Apache values Continuously seeking to develop your cyber security skills, learning from a range of sources, including formal training, learning from experience, and coaching and … mentoring Coaching and mentoring more junior colleagues to help transfer your knowledge and skills, either with Apache or with our clients Building and maintaining excellent client relationships Contributing to business development activities and the winning of new client contracts Experience you'll need Experience in delivering Defence Cyber, Enterprise … working Work from home or our Bristol offices The latest secure tech Investment in personal development Vibrant social scene Relocation bonus for Graduates Why Apache iX? Our growing team brings a wealth of experience from across the defence and security sector, and we pride ourselves in delivering the highest More ❯
Linux Systems Administrator - Devops/AWS - £40-50k Ubuntu/Redhat/Centos/Fedora/Debian/Unix - MySQL/Apache2/Amazon Web Services/EC2/DNS Desirable - Puppet/Chef/IDE/PHP/ More ❯
Linux Systems Administrator - Devops/AWS - £40-50k Technologies: Ubuntu/Redhat/Centos/Fedora/Debian/Unix - MySQL/Apache2/Amazon Web Services/EC2/DNS Desirable: Puppet/Chef/IDE/PHP More ❯
Luton, Bedfordshire, United Kingdom Hybrid / WFH Options
Leonardo UK Ltd
Job Description: Have you delivered software products as a Systems Engineer? If so, this may be the role for you! We are seeking dedicated Systems Engineers, who will bridge the gap between systems engineering and software development. Our software products More ❯
Install and configure enterprise tools, including Endpoint Detection and Response (EDR) agents, Tanium, and other monitoring solutions. Deploy and configure application components such as Apache, MariaDB, SSL, and related services. Collaborate with application owners to port and test applications on the new infrastructure. Identify and resolve issues related to … Red Hat, CentOS, and SUSE distributions. Hands-on experience with server virtualisation and virtual machine management. Proficient in deploying and managing services such as Apache, MariaDB, and SSL certificates. Strong background in implementing and configuring enterprise-grade tools like EDR and Tanium. Demonstrated success in application migration, issue resolution More ❯
day - Outside IR35 JOB DESCRIPTION This role requires strong expertise in building and managing data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. The successful candidate will design, implement, and maintain scalable, secure data solutions, ensuring compliance with strict security standards and regulations. This is a … of compressed hours. The role will include: Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with More ❯
Manchester, North West, United Kingdom Hybrid / WFH Options
INFUSED SOLUTIONS LIMITED
culture. Key Responsibilities Design, build, and maintain scalable data solutions to support business objectives. Work with Microsoft Fabric to develop robust data pipelines. Utilise Apache Spark and the Spark API to handle large-scale data processing. Contribute to data strategy, governance, and architecture best practices. Identify and resolve data … approaches. Collaborate with cross-functional teams to deliver projects on time . Key Requirements ? Hands-on experience with Microsoft Fabric . ? Strong expertise in Apache Spark and Spark API . ? Knowledge of data architecture, engineering best practices, and governance . ? DP-600 & DP-700 certifications are highly desirable . More ❯
Luton, Bedfordshire, United Kingdom Hybrid / WFH Options
leonardo company
Software Systems Engineers page is loaded Software Systems Engineers Apply locations GB - Luton - Cap. Green 300 GB - Bristol - Coldharbour Lane time type Full time posted on Posted 29 Days Ago job requisition id R Job Description: Our software products support More ❯