7 of 7 Permanent Kafka Jobs in Lancashire

NoSQL databases. Secure development practices. Git-based source control. Knowledge of CI automation systems such as Jenkins Bonus points for: Event streaming (e.g. Kafka, Kinesis) and change data capture (CDC). Messaging (e.g. RabbitMQ, SQS). Docker and Kubernetes. Solution and architecture design. Test-driven development (TDD). ...

operate real-time IoT data ingestion pipelines handling telemetry, logs, and events from thousands of devices. Implement processing workflows using Kinesis, Lambda, SQS, Kafka, Step Functions , or similar. Ensure data quality, schema governance, and reliability across ingestion and downstream data consumers. API Development Build and maintain RESTful and GraphQL ...

evidence your clearance) Required Skills & Experience Strong experience designing modern cloud-based data platforms. Hands-on architectural experience with: AWS (essential): S3, EMR, Glue Kafka/event streaming architectures Python & PySpark-based data processing Experience designing data ingestion pipelines (batch and real-time). Proficiency in Infrastructure as Code ...

Data Engineer up to £90,000 + Benefits Manchester (Hybrid) This is a great opportunity to join a high-growth adtech scale-up where you can take ownership of large-scale data infrastructure that directly ...

driving engineering direction across a large-scale distributed system. What you’ll do Design and build Java (Spring Boot) microservices Architect event-driven systems (Kafka/messaging) Apply AI/ML to real-world business problems Work with modern development tooling, including AI-assisted environments Influence technical direction … Principal/Staff/Architect level Strong Java and distributed systems background Hands-on AI/ML experience (Python or similar) Experience with Kafka or MQ, SQL/Oracle, cloud and containerisation Nice to have Financial services experience (post-trade, custody, corporate actions, trading ...

ingestion, processing, and access layers Design scalable, resilient data platforms (hub-and-spoke, lake/lakehouse) Lead implementation of batch and real-time pipelines (Kafka, APIs, SFTP) Architect solutions using: AWS (S3, EMR, Glue) PySpark/Python Support cloud migrations and platform modernisation Ensure best practices in CI/… Required Experience Active SC Clearance (essential) Strong experience with AWS data platforms (S3, EMR, Glue) Expertise in data lake/lakehouse architectures Experience with Kafka/event-driven architectures Strong Python & PySpark skills Experience with Terraform and CI/CD pipelines Proven track record designing large-scale data solutions ...

Senior Data Engineer - Manchester (Hybrid) - £80,000 + bonus The Company Our client is undergoing a significant digital transformation, modernising their data platform to better support high-volume, real-time products and analytics. This is ...