26 to 32 of 32 Kafka Jobs in the South East

tools (e.g., Apache Airflow, ADF). Experience with cloud platforms (Azure preferred) and related data services. Knowledge of big data technologies (e.g., Hadoop, Spark, Kafka). Experience of Waterfall and Agile delivery methodologies Contact: Please apply via the link or contact (url removed) for more information. Modis International ...

ArcSight, Microsoft Sentinel, Splunk, QRadar, Elastic). Strong understanding of log formats (JSON, syslog, XML, CEF, etc.) and ingestion technologies (Syslog, API, Event Hubs, Kafka, Agents). Practical knowledge of detection engineering, threat modelling, and attacker behaviour analysis. Experience building and tuning correlation rules, searches, and dashboards. Familiarity with ...

maintain Java based microservices, applying test driven development and following established engineering standards. You'll work with technologies including Java, Spring Boot, Postgres, Kafka, Docker, React and AWS. You'll contribute to CI/CD pipelines, ensure non-functional requirements are met and collaborate with colleagues across engineering, analysis … driven development (JUnit, Mockito or similar) Docker and containerisation CI/CD pipelines (Jenkins or similar) Working in agile, multi-disciplinary teams Desirable experience Kafka Liquibase or similar migration tooling Swagger/OpenAPI Gradle React TypeScript Reasonable Adjustments: Respect and equality are core values to us. We are proud ...

will help unlock smarter, faster decision-making. Key Actions Work with Data Engineering team to implement robust and trustworthy data to support high-performance Kafka streams and predictive models Deploy and maintain machine learning models as APIs for use in our live environments Employ a variety of languages ...

ingestion, processing, and access layers Design scalable, resilient data platforms (hub-and-spoke, lake/lakehouse) Lead implementation of batch and real-time pipelines (Kafka, APIs, SFTP) Architect solutions using: AWS (S3, EMR, Glue) PySpark/Python Support cloud migrations and platform modernisation Ensure best practices in CI/… Required Experience Active SC Clearance (essential) Strong experience with AWS data platforms (S3, EMR, Glue) Expertise in data lake/lakehouse architectures Experience with Kafka/event-driven architectures Strong Python & PySpark skills Experience with Terraform and CI/CD pipelines Proven track record designing large-scale data solutions ...

real-time). Ensure alignment with organisational architectural standards and governance frameworks. Contribute to target architecture roadmaps. Provide architectural guidance across: Data ingestion (Kafka, APIs, SFTP) Data processing (PySpark, EMR, Glue) Storage (S3 and data lake patterns) Collaborate with DevOps, Data Engineers, and Testers to ensure cohesive delivery. Promote … capability uplift. Required Skills & Experience Strong experience designing modern cloud-based data platforms. Hands-on architectural experience with: AWS (essential): S3, EMR, Glue Kafka/event streaming architectures Python & PySpark-based data processing Experience designing data ingestion pipelines (batch and real-time). Proficiency in Infrastructure as Code (Terraform ...

data pipelines using Azure-based services Develop and optimize data workflows within Databricks Implement and manage data ingestion processes, including real-time streaming with Kafka Structure and maintain data across bronze, silver, and gold layers within a lakehouse architecture Write efficient, scalable SQL for data transformation and analysis Collaborate … Azure data platform (e.g., Data Factory, Data Lake, Synapse) Hands-on expertise with Databricks (PySpark or Spark) Solid SQL development skills Experience working with Kafka for streaming data pipelines Good understanding of lakehouse architecture, including bronze/silver/gold layering concepts Experience in financial services or regulated environments ...