126 to 150 of 497 Kafka Jobs in England

including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations Preferred qualifications Experience with streaming (Structured Streaming, Kafka/Event Hubs/Kinesis). Experience implementing data quality frameworks (Great Expectations, DQ) and data testing in CI. Exposure to Unity Catalog ...

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such ...

Osterley, West London. Required Skills: Strong experience in Java and Spring, with hands-on expertise in technologies such as AWS, PostgreSQL, Docker, Kubernetes, Kafka, Prometheus, Grafana, Kibana, and Jenkins. Broad understanding of complementary technologies, with the ability to design scalable and effective software solutions. Proven ability to collaborate effectively ...

/ELT processes and data pipeline development Experience working with cloud platforms such as AWS, Azure or GCP Knowledge of technologies such as Spark, Kafka, Airflow or similar Experience with databases, data modelling and data warehouse solutions Understanding of CI/CD, software engineering best practices and secure development ...

architectures (Azure, AWS, GCP). • Strong knowledge of performance testing methodologies and tools (such as JMeter, LoadRunner). Desirable Criteria • Knowledge of middleware systems (Kafka, IBM MQ). • Experience with ELK stack and reporting tools (e.g., Tableau). • Exposure to CI/CD tools (Github Actions, Jenkins) and version ...

multi-region deployments. Exposure to SRE concepts. Experience with GitHub Actions, Jenkins, GitLab CI/CD or Bamboo. Knowledge of MLOps, Databricks, Snowflake, Kafka/Event Streaming, Ansible or Chef. Knowledge of FinOps and Azure cost optimisation. Experience working within BFSI environments with security and compliance requirements. Familiarity with ...

engineers and senior non-technical leadership. Core Tech Stack & Concepts Cloud & Infrastructure: AWS Backend: Java, Spring Boot, REST APIs Frontend: Node.js, Express.js Data & Messaging: Kafka, MongoDB/NoSQL Architecture: Microservices, Event-Driven Architecture, DDD Desirable Experience Direct experience taking digital services from Beta through to large-scale production rollout. ...

Experience in data engineering, ETL development or data platform delivery. Strong programming skills in Java or Python. Exposure to modern data technologies such as Kafka, Spark or Flink. Experience working within cloud environments, ideally AWS. Understanding of software engineering principles, version control and CI/CD practices. Familiarity with ...

restricted-network deployments, and multi-cluster or geographically distributed architectures. Kubernetes networking and policy tooling such as Cilium and eBPF, and event streaming infrastructure, Kafka, ideally via Strimzi. Secrets management, PKI and identity using Vault or Keycloak; scripting in Python, Bash or Go; and a defence, government or regulated ...

technology leaders with strong experience in:Application architecture: API design (REST, GraphQL), microservices, event-driven and distributed systems Data streaming and processing: platforms like Kafka for real-time data pipelines and integration Enterprise architecture: domain-driven design, architecture governance, reusable components and patterns AI for software engineering: leveraging ...

OTelDesirable Skills:Experience with cloud-native and distributed SQL database, such as Aurora, YugabyteDB or TiDBKnowledge of data streaming and integration tools, including Kafka, Debezium and CDC pipelinesExperience with security and compliance in database environments, for example covering encryption, auditing and RBACFamiliarity with DataOps practices and collaboration with Data ...

open-source Flyte orchestration framework and are deployed to AWS. Pipeline code is written in Python. We use SQS and Kafka to automate data connections and leverage BigQuery and ElasticSearch for data storage. We believe strongly in automation and testing to ensure delivery of robust and correct systems. ...

distributed system design, including data modeling, consistency, and time-series or event-driven architectures.Hands-on experience with streaming and messaging systems, such as Kafka, and building scalable data pipelines with derived data generation and persistence.Familiarity with containerized environments, such as Kubernetes, and modern data and storage technologies.Solid grasp ...

high cost of failure, i.e. focus on reliability and availability Experience with some amount of ‘Big Data’ technologies such as: ElasticSearch, NoSQL Stores, Kafka, Columnar Databases, DataFlow or Pipeline Systems, Graph DataStores Experience with leveraging common infrastructure services like Enterprise Message Bus platforms, configuration services, Toggle management systems ...

containerized application developmentFamiliarity with relational databases (e.g., Postgres) and AWS services such as S3, EKS, SageMaker, and BedrockPractical experience with Kubernetes, EKS, Docker, Kafka, MLOps and Large Language Model Operations (LLMOps)Experience working on AIML systems and/or prior experience collaborating with data scientistsJ.P. Morgan is a global ...

implementing solutions to stop them from reoccurring.Deployments: Writing and running deployment automation tools using Helm, Ansible or othersPlatform Integration: With technologies such as Kafka and KubernetesSome of the technologies that you will be interacting with include:Containerisation and virtualisation: Docker, Podman, Kubernetes, VMWareOperating Systems: Linux or iOSContinuous Integration/ ...

current stack includes, but is not limited to: C#/.NET, SPython FastAPI/Django, TypeScript, Angular, Vue.js, PostgreSQL, MongoDB, Redis/Valkey, RabbitMQ, Kafka, Azure, S3-compatible storage, Talend, NiFi, Docker, Podman, Kubernetes, Power Platform, and Office document automation tools such as Aspose. ð Join Assystem and play ...

building highly scalable and distributed applications using Microservices, APIs, and Container technologies such as Docker, Kubernetes, OpenShift, etc.Strong expertise in messaging technologies such as Kafka, JMS, gRPC etcProficient in latency measurement and performance optimization of Java based platforms with focus on JVM tuningExperience with observability stacks like ELK, Prometheus ...

seamless experiences across product boundaries and a cohesive user experienceTechnologies We UseDifferent backend languages, including Java, Rust, Python and GoDistributed systems technologies such as Kafka, Cassandra, Elasticsearch and SparkDocker and Kubernetes for containerisation and orchestrationIndustry-standard build tooling, including Gradle and GitHubWhat We ValueA deep understanding of server-side ...

ability to build relationships across disciplines and communicate technical trade-offs to non-technical partners.We’d love to see experience with NoSQL databases, GraphQL, Kafka, or containerization (Docker/Kubernetes). Experience building tools or abstractions that provide leverage to an entire engineering team is also a significant plus. ...

Bundles * Terraform or Bicep * dbt or similar transformation frameworks * Retail or CPG data exposure such as POS, inventory, supply chain * Streaming technologies such as Kafka or Event Hubs Education * Degree in computer science, data engineering or related field, or equivalent practical experience ...

/CD tools and infrastructure-as-code practices.Expertise with distributed data processing frameworks (e.g., Apache Spark, Hadoop) and real-time data streaming technologies (e.g., Kafka, Kinesis, Spark).Experience collaborating with cross-functional teams to deliver impactful data solutions.Ability to evaluate, select, and integrate emerging data technologies and tools ...

infrastructure-as-code practices Hands-on expertise with distributed data processing frameworks (e.g., Apache Spark, Hadoop) and real-time data streaming technologies (e.g., Kafka, Kinesis, Spark) Track record of collaborating with cross-functional teams (engineering, analytics, business stakeholders) to deliver impactful data solutions Experience evaluating, selecting, and integrating emerging ...

layers to progressively refine raw event logs (Bronze) into verified subledgers (Silver) and structured Gold metrics.Stream Processing: Work closely with high-throughput messaging queues (Kafka) and real-time computation models to maintain our data freshness SLAs.Data Quality & Assurance: Embed rigorous, automated reconciliation checks within the data pipelines (e.g., balance ...

background in Java/Scala and a scripting language like Python.Experience building large scale data pipelinesStrong familiarity with the Apache Hadoop ecosystem including : Spark, Kafka, Flink, Iceberg/Delta Lake/Hive, Apache Presto/Trino, etc.Experience with relational SQL and NoSQL databases, including Postgres/MySQL, Cassandra, DynamoDBFamiliarity ...