integration architecture and design skills Good communication skills Desirable Skills: JavaScript - with React/Vue being even better. Docker/Kubernetes Linux - Basic sysadmin (Apache, Nginx) SQL/Oracle/PostgreSQL/MongoDB/DynamoDB Message Queues - RabbitMQ or similar AWS or GCP This an office based position DCS more »
Manchester, North West, United Kingdom Hybrid / WFH Options
N Brown Group
and practices and tools like Jira and Confluence. What technical skills you will have Experience with general Cloud products (Cloyd SQL, BigQuery, RedShift, Snowflake, Apache Beam, Spark) or similar products. Experience with open-source data-stack tools such as Airflow, Airbyte, DBT, Kafka etc. Awareness of data visualisation tools more »
Manchester Area, United Kingdom Hybrid / WFH Options
hackajob
practices, and tools like Jira and Confluence. What Software and Technology experience will you have? Experience with Cloud products (Cloud SQL, BigQuery, RedShift, Snowflake, Apache Beam, Spark) or similar technologies. Proficiency in open-source data-stack tools such as Airflow, Airbyte, DBT, Kafka, etc. Familiarity with data visualization tools more »
of the company's largest revenue generating databases. Your main role will be ensuring smooth data integration across various systems, focusing on Elasticsearch using Apache Kafka and Apache Flink. Other responsibilities include, but are not limited to: Develop Java applications to efficiently handle data integration into Elasticsearch. Collaborate … with the team to understand data requirements and design effective integration processes. Build reliable data pipelines using Apache Kafka and Apache Flink. Optimize Elasticsearch configurations for improved performance and search capabilities. Work closely with the DevOps team to deploy and monitor data pipelines in production. Troubleshoot and resolve … updated on industry trends and best practices in data integration and Elasticsearch. Must Haves: Proven experience in Java development. Experience working with Elasticsearch or Apache Solr Proficiency with index creation, querying, and optimization. Familiarity with Apache Kafka Understanding of NoSQL databases. Experience with Agile methodologies and collaboration tools. more »
to tick every box. 2+ years of experience in software or data engineering. Data Engineering patterns & practices both established and emerging. Data ETL pipelines, (Apache Airflow) Python, JSON Redshift, RDS, MySQL/Postgress AWS Lambda, CloudWatch/Terraform/CDK, Athena, S3, Kinesis, MongoDB Any Experience of setting up more »
Manchester, England, United Kingdom Hybrid / WFH Options
iO Associates - UK/EU
standard Javascript programmes then this will benefit your application. Tech stack wise this exciting start-up are currently using: -Java, Kafka, Microservices, AWS, Springboot, Apache, REST, JSON, Docker, Kubernetes. The role itself is Fully Remote, as long as you are within the UK and have Full Rights to work more »
Manchester Area, United Kingdom Hybrid / WFH Options
Maxwell Bond®
The successful Lead Data Engineer will have: Experience of; Software & Data Architecture Patterns, Data Warehousing, Data Modelling. Vast knowledge on tech such as; MongoDB, Apache Airflow, DBT, Tableau, BigQuery. Extensive knowledge and experience with GCP, AWS and/or Azure. This position does not offer Visa Sponsorship , please refrain more »
of interesting projects, have great traing and Career development please apply today Essential skills and knowledge: Strong C++ Experience of modern libraries including STL, Apache libraries (NiFi etc) Good grasp of networking fundamentals. Ability and desire to learn new programming languages and technologies quickly. Proven problem-solving and fault more »
Manchester, North West, United Kingdom Hybrid / WFH Options
Searchability NS&D Ltd
existing architectural components including Data Ingest, Data Stores and REST APIs. THE DEVOPS ENGINEER SHOULD HAVE…. You must have an active eDV Clearance. Apache Nifi Flink Java Ansible Docker Kubernetes ELK stack Linux Sys Admin for deployed Clusters (10's of servers) Jenkins Pipeline development Integration/debugging … DEVOPS ENGINEERS - MANCHESTER KEY SKILLS: SOFTWARE DEVELOPER/SOFTWARE ENGINEER/SENIOR SOFTWARE DEVELOPER/SENIOR SOFTWARE ENGINEER/DEVOPS ENGINEER/DEVOPS/APACHE NIFI/FLINK/JAVA/ANSIBLE/DOCKER/KUBERNETES/ELK STACK/TERRAFORM/LINUX/GIT more »
performance, reliability, and security. - Implement event-driven architectures using Kafka for real-time data processing and communication between microservices. - Utilize Big Data technologies (e.g., Apache Spark, Hadoop) to process and analyze large volumes of data, extracting valuable insights to drive decision-making. - Design and optimize data pipelines for ingesting … principles and best practices. - Experience with Kafka for building event-driven architectures and real-time data processing. - Familiarity with Big Data technologies such as Apache Spark, Hadoop, or similar frameworks. - Proven track record of delivering scalable and reliable software solutions in a fast-paced environment. - Excellent communication skills and more »
will implement a strategy to help define a robust and forward-thinking integration platform. You will be leveraging technologies like true AI, Azure RabbitMQ, Apache Kafka, Apache Flink, Docker, and Kubernetes. Key responsibilities: Architectural Planning: Devise and implement a cutting-edge real-time data processing and event-driven more »