16 of 16 Kafka Jobs in Newcastle upon Tyne

testing and version control.* **Data Engineering Stack** Experience building pipelines using streaming frameworks, distributed processing engines and relational or analytical storage technologies. Examples include Kafka, Spark, PostgreSQL.* **Orchestration** Experience defining and running data workflows using modern orchestration frameworks. Examples include Airflow, Dagster or Prefect.* **Data Quality and Lineage** Familiarity ...

power intelligent decision‐making. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark. Develop and support real‐time streaming pipelines and event‐driven integrations. Integrate data from multiple sources (streaming, batch, APIs) using AWS managed … junior engineers where needed. Qualification Core Data Engineering Strong programming proficiency in Java (preferred) or Python. Hands‐on experience with at least one of: Kafka, Flink, Spark (Flink/Kafka preferred for streaming). Solid understanding of stream processing concepts (e.g., event time, state, backpressure). Understanding ...

Strong commercial experience with Java development. Experience with Spring Boot and microservices-based architectures. Knowledge of AWS cloud technologies. Experience working with Apache Kafka and event-driven systems. Understanding of payment processing and ISO 20022 standards. Experience working within complex financial services environments. Strong stakeholder management and communication skills ...

CloudWatch X-Ray ECS/Fargate ECR EKS Infrastructure & DevOps Terraform Docker Kubernetes Kong Enterprise Gateway Databases MongoDB Amazon DocumentDB Messaging & Monitoring Kafka Confluent Schema Registry Dynatrace Other Serverless architectures Monorepo development Nunjucks What We're Looking For We're interested in developers who: Enjoy solving complex technical problems ...

CloudWatch X-Ray ECS/Fargate ECR EKS Infrastructure & DevOps Terraform Docker Kubernetes Kong Enterprise Gateway Databases MongoDB Amazon DocumentDB Messaging & Monitoring Kafka Confluent Schema Registry Dynatrace Other Serverless architectures Monorepo development Nunjucks What We're Looking For We're interested in developers who: Enjoy solving complex technical problems ...

Lambda API Gateway SQS S3 KMS CloudWatch X-Ray ECS/Fargate ECR EKS Infrastructure & DevOps Terraform Docker Databases MongoDB Amazon DocumentDB Messaging & Monitoring Kafka Confluent Schema Registry Dynatrace Other Serverless architectures What We're Looking For Enjoy solving complex technical problems Write clean, maintainable code Have a collaborative ...

independently and as part of a team. Good communication and collaboration skills. Nice to Have Experience with Databricks. Experience with Apache Kafka. Experience with Kafka Connect. Knowledge of event-driven data architectures and Real Time data processing. Key Technologies Azure | Azure Data Factory | Azure Synapse Analytics | Azure Data Lake … Terraform | GitLab | Databricks | Kafka | Kafka Connect Diversity & Inclusion At Scrumconnect Consulting, we believe that diversity drives innovation and better outcomes. We are committed to fostering an inclusive environment where every individual is valued, respected, and supported. We welcome applications from candidates of all backgrounds and actively encourage individuals ...

Java 11+) and Spring BootProven ability to design and lead backend architecture for complex platformsStrong experience with AWSExperience with Kubernetes and containerised environmentsKnowledge of Kafka and event-driven architecturesExperience designing RESTful APIs and microservice architecturesStrong understanding of SQL and NoSQL databasesExperience building and maintaining CI/CD pipelinesComfortable working ...

Databricks; understanding of ML Ops is highly beneficial Ability to quickly adapt to new tools and independently deliver scalable solutionsFamiliarity with data pipelines involving Kafka, Debezium, S3, Lambda, and Delta Lake is a plusApply now to find out more! Location: Newcastle upon Tyne Tyne and Wear Newcastle upon Tyne ...

that power analytics and AI-driven decision making. What youll be doing Building and optimising scalable data pipelines using Java (primary) and technologies like Kafka, Flink, or Spark Developing real-time streaming solutions and event-driven architectures using AWS services (Kinesis, MSK, Lambda, Glue) Contributing to data architecture, modelling … Strong experience in data engineering or large-scale data platforms (3+ years) Proficiency in Java or Python Hands-on experience with streaming technologies (Kafka/Flink preferred) Good understanding of distributed systems and cloud platforms (AWS ideally) Experience with CI/CD, Docker, Kubernetes, and modern DevOps practices ...

that power analytics and AI-driven decision making. What youll be doing Building and optimising scalable data pipelines using Java (primary) and technologies like Kafka, Flink, or Spark Developing real-time streaming solutions and event-driven architectures using AWS services (Kinesis, MSK, Lambda, Glue) Contributing to data architecture, modelling … Strong experience in data engineering or large-scale data platforms (3+ years) Proficiency in Java or Python Hands-on experience with streaming technologies (Kafka/Flink preferred) Good understanding of distributed systems and cloud platforms (AWS ideally) Experience with CI/CD, Docker, Kubernetes, and modern DevOps practices ...

Agile delivery team. Key Responsibilities Design, develop, and maintain robust applications using Java and Spring Boot . Develop and integrate event-driven solutions using Kafka . Work with MongoDB for data storage and management. Write clean, maintainable, and testable code following Test-Driven Development (TDD) and unit testing practices. … stakeholders. Follow Scrum/Kanban and other Agile delivery practices. Essential Skills and Experience Hands-on experience with Spring Boot . Experience working with Kafka . Experience with MongoDB . Good understanding of Docker images and containers . Experience with unit testing and TDD . Experience with CI/ ...

We're looking for a Lead Backend Engineer to take ownership of backend engineering and help shape the technical future of a fast-scaling SaaS business. You'll set the vision, guide architecture, and raise ...

will work across application development, cloud services, CI/CD, and containerised environments within an Agile delivery team. The role emphasizes Spring Boot, Kafka, MongoDB, Docker, and AWS, with a focus on code quality through TDD and BDD tests. #J-18808-Ljbffr ...

work independently and as part of a team. Good communication and collaboration skills. Nice to Have Experience with Databricks . Experience with Apache Kafka . Experience with Kafka Connect . Knowledge of event-driven data architectures and real-time data processing. Key Technologies Diversity & Inclusion At Scrumconnect Consulting ...

payment services using Java 11 and Spring Boot . Develop and support cloud-based solutions within AWS environments. Implement asynchronous messaging solutions using Apache Kafka . Work with ISO 20022 payment standards , including payment types and schemes. Support the delivery of complex payment transformation programmes. Collaborate with technical … microservices . Extensive hands-on experience with ICON IPF essential . Strong experience working with AWS cloud environments . Solid experience with Apache Kafka and asynchronous messaging . Strong understanding of ISO 20022 payments , including payment types and schemes. Experience delivering technology solutions within banking or financial services . ...