76 to 100 of 101 Flink Jobs

DIHOC, AWS Glue, DBT, Snowflake, Databricks).o Apply architectural patterns for data lakes, streaming, and batch processing.o Exposure to cloud technologies – Snowflake, Redshift, Apache Flink and Apache Kafka.**Technical POCs**o Technical assessment of Cloud data technologies to leverage considering Fraud Business and technical requirementso Design, execute and lead ...

DIHOC, AWS Glue, DBT, Snowflake, Databricks).o Apply architectural patterns for data lakes, streaming, and batch processing.o Exposure to cloud technologies – Snowflake, Redshift, Apache Flink and Apache Kafka.**Technical POCs**o Technical assessment of Cloud data technologies to leverage considering Fraud Business and technical requirementso Design, execute and lead ...

join a high-performing data enablement team. You will design and implement architecture that scales with the payment platform, working with technologies like StarRocks, Flink, and DBT. The ideal candidate has over 5 years of experience, strong Python and SQL skills, and a proactive approach to data engineering. Yuno ...

libraries (scikit‐learn, XGBoost), including modeldeployment. Design and develop highly scalable, Real time systemsusing Hadoop ecosystem components(Iceberg, Spark, Ozone, Trino, Hive,Ranger, Kafka, Flink and Nifi) Build robust data ingestion and transformationframeworks using Java, Spark, Python, and shell scripting for ingestingmulti model data(image, audio, video, unstructured documents ...

Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink) RPA tooling (UiPath, Power Automate) dbt for data transformation Claude Code, Claude Cowork, or Claude Skills Experience with vector databases, real-time streaming (Kafka … Flink), or RPA tooling (UiPath, Power Automate). Qualifications Bachelor's degree in Computer Science, Engineering, or equivalent practical experience Experience 3–5 years in software or data engineering with strong exposure to system integrations, data pipelines, and production infrastructure. Strong Python and SQL skills; experienced building robust, production ...

collect, store and analyse data at scale. You will mentor engineers, drive architectural decisions, and deliver end-to-end streaming solutions using Kafka, Flink, and AWS on a hybrid London-based team. This is a high-impact role in a fast-growing fintech environment. #J-18808-Ljbffr ...

quality, lineage, and cost-aware infrastructure. Three to five years in data engineering with large event data, strong SQL, and experience with Spark or Flink will be essential. Ad-tech/bidstream experience is a plus in this role. #J-18808-Ljbffr ...

data transformation logic using modern tooling (e.g. dbt, Spark, SQL‐based frameworks), ensuring consistency and testability. Build and optimise streaming data pipelines (Kafka/Flink or equivalent) to enable near real‐time data availability. Ensure data quality and reliability through validation frameworks, observability, and robust handling of late‐arriving … . Experience with cloud‐based data platforms, ideally AWS. Understanding of medallion architecture or similar data layering approaches. Experience working with streaming technologies (Kafka, Flink, or similar). Strong understanding of data quality, testing, and observability practices. Experience designing schemas and handling data consistency challenges in distributed systems. Ability ...

applications for a Lead Data Engineer based in Glasgow. You will design and develop real-time data streaming solutions using Kafka Streams and Apache Flink, building scalable, low-latency data platforms to support critical business processes. You will influence architecture, standards, and collaboration with data scientists for model deployment. ...

technology/infrastructure which will serve hundreds of teams and petabyte-level volumes of data. Key Responsibilities Work with stream processing technologies (Kafka and Flink) to build a continuously available large-scale event streaming platform Leverage subject matter and technical expertise to provide leadership, mentoring, and strategic influence across … implementing and owning event streaming platforms Hands‐on experience working with stream technologies, ideally Kafka Experience designing and implementing stream processing applications with Flink Experience working with cloud‐based technologies such as AWS (MSK, S3, Lambda, ECS, SNS) Experience with Kubernetes (either self‐hosted or on the cloud) Experience ...

FDJ UNITED in London is seeking a Senior Software Engineer to help build and evolve our real-time liability and risk platform for sports betting. You will work on our Core Liability engine — a modular ...

financial workflows and frees finance and accounting teams from manual, administrative work. Founded in Berlin and used by more than 10,000 businesses including Flink, Schufa, n8n and Auto1, Moss has raised €220+ million to date and operates in Germany, the Netherlands, the UK and further EU markets. ...

logiciel et expérience avérée de leur application en développement de données Maîtrise des technologies de diffusion de données en continu, telles que Kafka et Flink Capacité à travailler de manière autonome et efficace dans un contexte d'équipe Expérience auprès de parties prenantes non spécialisées; savoir traduire leurs besoins ...

objectives and timelines. Hands-on Kubernetes experience Hands-on AWS experience Databases and middleware — Postgres, Kafka, Redis Big data stack — data warehousing, MPP, Spark, Flink Micro-service architecture and service mesh UI development experience What You Will Bring 3+ years of software development experience Strong command of at least … CodeDeploy Preferred Hands-on Kubernetes experience Hands-on AWS experience Databases and middleware — Postgres, Kafka, Redis Big data stack — data warehousing, MPP, Spark, Flink Micro-service architecture and service mesh UI development experience Benefits Full time benefits for FT #J-18808-Ljbffr ...

resources across the rest of the Finance & Treasury tribe. Our stack is polyglot and modern: Java 21 + Spring Boot 4.x, Python 3.12, Apache Flink (streaming), Kafka, gRPC + Protobuf, and Bloomberg/Reuters real-time feeds. This isn't typical CRUD — it's real-time financial infrastructure where … execution platform, from exposure decomposition through model-driven hedge proposals to programmatic trade execution on external partners Building real-time streaming pipelines with Apache Flink for portfolio-split exposure computation, tenor interpolation, and hedge lifecycle event processing Evolving our rate infrastructure for 10x throughput with FX Forwards, new corridors ...

isolation, row- and column-level security, and PII handling. Define the streaming and batch ingestion architecture, building on our investments in NATS JetStream, Apache Flink, and Debezium CDC patterns, and direct the engineering team on execution. Specify the catalog, lineage, and data-quality foundation and own the operational practice … data services (S3, Glue, Athena, Lake Formation, or equivalent) NATS/Apache Kafka or similar, and CDC patterns (Debezium or equivalent) Stream processing (Apache Flink, Spark Structured Streaming, or equivalent) SQL and query optimisation at scale Data and table formats (Parquet, Avro, Apache Iceberg or Delta Lake) Experience designing ...

architecture that scales with the product and the company. Your Contribution Will Be The stack is modern: StarRocks as our primary analytical layer, Flink for processing, DBT for transformation, Airflow for orchestration and various tooling for surfacing insights. The hard work of making it genuinely reliable is still … evolving data engineering standards, architectural guidelines and governance, ideally within a regulated environment. Strong Python and SQL skills. Hands‐on experience with Spark or Flink in production. DBT for data transformation. StarRocks or a comparable analytical database. Experience building and operating data pipelines in AWS and/or GCP. ...

will transform the financial engineering impact by pioneering our real-time Liquidity Attribution Model (LAM)! You will architect high-throughput Kafka and Flink streaming pipelines that continuously process global bank transactions, dynamically balancing demand against supply intraday. This is an opportunity to architect low-latency streaming pipelines that deliver … Processing & Event-Driven Architecture: Proven track record building, deploying, and operating production‐grade, low-latency stream processing pipelines using Apache Kafka (or Kafka Streams, Flink, Spark Streaming). Idempotency & Event Reliability: Deep hands‐on experience handling duplicate events, out‐of‐order log processing, late‐arriving data, and exactly‐once ...

Job Description Job Title: Senior Engineer Corporate Title: Director Location: Bromley Company Overview At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every ...

will transform the financial engineering impact by pioneering our real-time Liquidity Attribution Model (LAM)! You will architect high-throughput Kafka and Flink streaming pipelines that continuously process global bank transactions, dynamically balancing demand against supply intraday. This is an opportunity to architect low-latency streaming pipelines that deliver … Processing & Event-Driven Architecture: Proven track record building, deploying, and operating production-grade, low-latency stream processing pipelines using Apache Kafka (or Kafka Streams, Flink, Spark Streaming). Idempotency & Event Reliability: Deep hands-on experience handling duplicate events, out-of-order log processing, late-arriving data, and exactly-once ...

data models, ETL pipelines, metadata frameworks, and modern data warehousing solutions. Design and optimise large-scale streaming data platforms using technologies such as Apache Flink and other real-time processing frameworks. Ensure all solutions comply with industry best practices, governance frameworks, and regulatory requirements, maintaining the highest standards … Lambda, Redshift , and related data services. Proven experience designing secure architectures within sensitive or highly regulated environments. Hands-on experience with Apache Flink and real-time data processing architectures. Strong understanding of data modelling methodologies, architectural patterns, and industry standards. Expertise across ETL processes, data integration, data warehousing, distributed ...

major step forward in scalability, resilience, and streaming architecture across our technology estate. Responsibilities Design and build distributed, real‐time streaming components within a Flink‐based architecture. Develop and maintain services that process the full bet lifecycle, from acceptance through settlement, cancellation, and cashout. Implement complex financial calculations, including … downstream systems, including trader‐facing tools. Experience 5+ years software engineering experience in building distributed systems. Excellent Java skills. Experience with streaming technologies (Apache Flink preferred; Kafka Streams, Spark Streaming, etc.). Solid understanding of event‐driven architecture and asynchronous processing patterns. Experience handling data consistency challenges such ...

Observability portfolios. Your Impact As a Software Engineer you will: Design, build, test, and operate near real time data streaming-based (Spark/Flink) solutions for some of the largest Networking customers in the world. Develop agentic workflows, reusable skills, tool integrations, and orchestration capabilities. Integrate AI tools with … continuous integration and delivery workflow. Preferred Qualifications Deep knowledge and interest in real-time data processing with technologies such as Kafka Streams, ClickHouse, Flink, and similar. Familiarity with relational, document-based, or vector datastores. Familiarity with AI-assisted development tools such as Kosmos, Codex, or Claude. Understanding of containers ...

best practices in data architecture, security, and cloud computing Proficiency in data modelling, ETL processes, data warehousing, distributed systems and metadata systems Utilise Apache Flink and other streaming technologies to build real-time data processing systems that handle large-scale, high-throughput data Ensure all data solutions comply with … Lambda, and Redshift. Experience with other cloud providers (e.g., Azure, GCP) is a plus In-depth knowledge and hands-on experience with Apache Flink for real-time data processing Proven experience in mentoring and managing teams, with a focus on developing talent and fostering a collaborative work environment Strong ...

contributing to architecture while remaining close to the codebase. You will contribute to the development of streaming solutions using technologies such as Kafka and Flink, supporting innovation and data-informed outcomes across Barclays. You will also help us shape engineering standards and ways of working, contributing … scalable systems together. Key Experience Experience working with real-time streaming applications using Kafka Streams, including KStream and KTable concepts. Experience working with Apache Flink solutions, including stateful processing, checkpointing, and fault-tolerant approaches. Experience working with high-throughput, low-latency data pipelines that process and transform large volumes ...