526 to 550 of 676 Kafka Jobs

production, not just notebooks. The Full ML Lifecycle: Expertise in end-to‐end system design: from feature stores and real‐time data pipelines (Kafka/Beam) to A/B testing infrastructure and model monitoring. You understand the nuances of online vs. offline evaluation and have experience solving ...

achieve more with the AWS cloud. Basic qualifications- Experience as technical specialist in design and architecture- Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis)- Experience in consulting, design and implementation of serverless distributed solutions- Experience in cloud based solution (AWS or equivalent), system, network and operating system ...

Senior Data Engineer | Kafka | AWS Aurora | SQL | Kubernetes | Hybrid | Inside IR35 Location: UK (Hybrid) Contract: Initial 3–4 Months (Likely Extension) IR35: Inside IR35 Senior Data Engineer We're recruiting for an experienced Senior Data Engineer to join a leading organisation on an exciting data transformation programme. This … maintain high-quality technical documentation aligned with DDaT standards. Essential Skills Expert SQL development and performance tuning Strong hands-on experience with Apache Kafka AWS Aurora (Postgres) Enterprise Data Warehousing Dimensional and Transactional Data Modelling Docker Kubernetes REST API Integration JSON and Schema Validation API resilience including retries, timeouts ...

design, and implementation of complex, scalable, and secure technology solutions. This requires emphasis on advanced Agentic AI systems, expertise in message-based technologies (e.g., Kafka, AMPS), strong management skills to coordinate across global regions and multiple applications. Deep proficiency across multiple technologies including Java and Python, along with ability … Demonstrated experience with Agentic AI systems, autonomous agents, and advanced machine learning frameworks. Extensive hands-on experience with message-based technologies such as Apache Kafka and AMPS, including design, deployment, and optimization. Advanced proficiency in Java and Python, including architectural design, development, and code review in both languages. Strong ...

design, and implementation of complex, scalable, and secure technology solutions. This requires emphasis on advanced Agentic AI systems, expertise in message-based technologies (e.g., Kafka, AMPS), strong management skills to coordinate across global regions and multiple applications. Deep proficiency across multiple technologies including Java and Python, along with ability … development methodologies.Demonstrated experience with Agentic AI systems, autonomous agents, and advanced machine learning frameworks.Extensive hands-on experience with message-based technologies such as Apache Kafka and AMPS, including design, deployment, and optimization.Advanced proficiency in Java and Python, including architectural design, development, and code review in both languages.Strong experience with ...

prem (BYOC/self‐hosted), or a platform like Nuon, Replicated, or Omnistrate. Multi‐cloud (GCP or Azure) IaC, and exposure to Temporal, Kafka/MSK, ClickHouse, or OpenSearch. Our stack Cloud & infra: AWS (ECS Fargate, Aurora Postgres, ElastiCache, MSK, OpenSearch, Lambda, S3, KMS, CloudFront, WAF), Cloudflare (Workers … today, migrating to Terraform Data & messaging: Postgres, Redis, Kafka, OpenSearch, ClickHouse CI/CD: GitHub Actions Observability & analytics: Datadog, Sentry, Metabase Languages: TypeScript (Node.js), Python Benefits Meaningful share options (EMI) 25 days holiday + 1 additional day per year of tenure Private health insurance, including dental & optical £15/ ...

Senior Data Platform Engineer/Data Architect Python | AWS | Terraform | Kafka | Event-Driven Architecture We are looking for a Senior Data Platform Engineer to join a team building a modern, cloud-native data platform on AWS. This is a highly hands-on engineering role focused on designing, building, deploying … Build, deploy, and maintain cloud-native platform components on AWS Develop infrastructure using Terraform (Infrastructure as Code) Design and implement event-driven architectures using Kafka Develop automation, platform tooling, and services using Python Deploy code through multiple environments and support platform delivery Build scalable, resilient, secure, and observable platform ...

pipeline development, architecture and deployment. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java, plus exposure to Python, Flink, Kafka, or Spark. Develop and support real-time streaming pipelines and event-driven integrations. Integrate data from multiple sources using AWS managed services Data Architecture … cloud environments. Work with container technologies Core Data Engineering Strong programming proficiency in Java or Python. Hands-on experience with at least one of: Kafka, Flink, Spark Solid understanding of stream processing concepts Understanding of software engineering best practices: testing, design patterns, CI/CD, Git. Experience building ...

pipeline development, architecture and deployment. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java, plus exposure to Python, Flink, Kafka, or Spark. Develop and support real-time streaming pipelines and event-driven integrations. Integrate data from multiple sources using AWS managed services Data Architecture … cloud environments. Work with container technologies Core Data Engineering Strong programming proficiency in Java or Python. Hands-on experience with at least one of: Kafka, Flink, Spark Solid understanding of stream processing concepts Understanding of software engineering best practices: testing, design patterns, CI/CD, Git. Experience building ...

needs. We use ADRs as part of our decision-making process, and our architecture is microservices running on Kubernetes with heavy use of Kafka and event-driven design — a natural fit for streaming real-time market data and trade events. Partner with Compliance, Risk, and Operations to ensure integrations … achieve new goals, both serverless and managed in the cloud. Hands-on experience designing and implementing event-driven architectures with different message brokers, including Kafka — ideally applied to high-throughput, low-latency data such as market or trade feeds. Experience integrating with third-party financial or trading APIs (REST ...

needs. We use ADRs as part of our decision-making process, and our architecture is microservices running on Kubernetes with heavy use of Kafka and event-driven design - a natural fit for streaming real-time market data and trade events. Partner with Compliance, Risk, and Operations to ensure integrations … achieve new goals, both serverless and managed in the cloud. Hands‐on experience designing and implementing event‐driven architectures with different message brokers, including Kafka - ideally applied to high‐throughput, low‐latency data such as market or trade feeds. Experience integrating with third‐party financial or trading APIs (REST ...

Join a rapidly growing team to help BCB build and scale our products and deliver them to clients. Use your software engineering skills to develop, test, release, support and maintain complex financial platforms. Our backend ...

J.P. Morgan Asset & Wealth Management is looking for a Software Engineer in Glasgow to design, build, and evolve trading platforms that manage orders and execute trades across asset classes. You will work closely with Traders ...

A technology firm specializing in betting solutions is seeking a Senior Software Engineer to join their London-based team. The role involves leading the design of scalable systems and requires strong expertise in Scala and ...

Senior Java Engineer (Kafka, Kubernetes, SpringBoot) - Banking - London/Hybrid Daily rate: €600 - €700 (inside IR35) Duration: 12 months Start: ASAP My client is looking for a Senior Java Engineer to join on a contract basis. They need someone with strong core Java expertise as the role primarily involves … containerised services using Docker and Kubernetes. Hands‐on SpringBoot skills. Experience developing and deploying on Unix or Linux. Hands‐on experience of using the Kafka ecosystem. Experience of profiling and performance tuning. Experience of Behaviour‐Driven and Test‐Driven development principles and skills. Experience of Public Cloud development. Soft ...

seeking a Senior Software Engineer to advance the Realtime Context Engine and Confluent Kafka components. You will develop query execution, ensure high availability, and scale multi-tenant infrastructure powering Lightning tables and the context engine. You will collaborate with product, design and other engineering teams to integrate storage features ...

collaborate with Traders to automate the order-management lifecycle and push for technical excellence and rapid delivery. This role emphasizes scalable systems, messaging with Kafka, microservices, and GenAI integration. #J-18808-Ljbffr ...

trading. You will lead design, development, testing, and operations, applying GenAI and AI‐first approaches, with a focus on low‐latency, real‐time systems, Kafka pipelines, and secure, resilient software across #J-18808-Ljbffr ...

Python Software Development role Significant part of childhood spent hacking away in 8-bit assembly language Python 3.10+, JavaScript, TypeScript, and Go RabbitMQ, Kafka, PostgreSQL, Redis, Linux servers, OpenTelemetry, Prometheus, Grafana, and Zabbix Nice to have: Interest in functional programming and its application in the real world Условия: Extremely ...

high-volume transactional systems Experience modelling event-based data (e.g. transactions, sessions, gameplay flows) Familiarity with modern data stack tools (e.g. Snowflake, BigQuery, dbt, Kafka) Experience with real-time or streaming data architectures Exposure to regulatory or compliance-driven data environments Experience supporting AI/ML data readiness Success ...

processing jobs using PySpark on AWS EMR with deployment of these jobs on Data warehouse platforms like Amazon Redshift & ClickHouse Work with Amazon MSK (Kafka) for real‐time data ingestion and streaming. Automate pipeline orchestration with AWS Step Functions. Ensure schemas are aligned with vendor (OEM) specifications and business ...

schema registries and contracts (Avro/Protobuf, evolution, breaking-change handling across producers and consumers) — not just dimensional modellingFluent in Parquet, Trino, streaming (Kafka/Flink), and lakehouse platforms (Snowflake/Databricks), and the throughput and cost engineering that comes with scaleProduct and governance instincts: multi-tenancy, row-level ...

bonus) Job Description We are seeking a highly motivated and technically strong Platform Lead to lead a modern Data & Integration Platform comprising Snowflake, Confluent Kafka, Azure Cloud, Kubernetes, Fivetran, and CI/CD ecosystem. The ideal candidate will combine deep technical expertise with strong delivery and people leadership capabilities … technical blockers. Drive compliance, security, audit readiness, and cost optimization. Implement effective monitoring, observability, and service management processes. Hands‐on experience with Snowflake, Kafka, Cloud, DevOps, and Platform engineering. Mentor and guide Snowflake, Kafka, Cloud, DevOps, and Platform engineers. Provide architectural oversight and technical governance across the platform ...

data platforms using Snowflake for analytics and reporting, ensuring seamless integration with broader enterprise data ecosystemsBuild and maintain real-time event streaming architectures (e.g., Kafka, Azure Event Hubs) to power high-throughput, low-latency financial data flowsDeliver robust full-stack solutions utilising .NET/C# and SQL where appropriate … data pipelinesProficiency with Snowflake for data warehousing, analytics, and building scalable data platformsExperience designing and building event streaming architectures using technologies such as Apache Kafka and Azure Event HubsStrong working knowledge of Azure and/or AWS cloud services, including compute, storage, serverless, and container orchestration (e.g. ...

driving the architecture, scalability, and reliability of the infrastructure that enables banks to connect seamlessly to Wise.With deep expertise in Java, Spring Boot, Kafka, and PostgreSQL, you’ll lead the design of highly available services and event-driven systems that power partner integrations and financial flows at scale. … Boot in production environments\* Has strong experience designing and operating large-scale distributed systems and microservices architectures\* Is comfortable designing event-driven systems using Kafka or similar technologies\* Has strong experience modelling and building systems with PostgreSQL or other relational databases\* Applies domain-driven design principles to build scalable ...