17 of 17 Spark Streaming Jobs

researchers, product teams, and engineering teams to translate business requirements into scalable technical solutionsDefine architectural standards and technology roadmaps for data warehousing, Lakehouse, streaming, and AI/ML workloadsDrive adoption of modern Agile, DevOps, CI/CD, Infrastructure-as-Code, and DataOps practicesDevelop a strong understanding of Transaction … Streaming, and Lakehouse architectureStrong hands-on experience with Snowflake, including data modelling, performance optimisation, Snowpark, data sharing, and governance capabilitiesExpertise in Apache Spark, Python, SQL, and modern ELT/ETL frameworksProven ability to rapidly evaluate, prototype, and compare emerging technologies and architectural patternsExperience designing large-scale ...

adoption and understanding of modern tooling, architectures, and platforms. Deliver seamless and intuitive data solutions that enhance the user experience, from real-time streaming data services to interactive dashboards. Play a key role in cultivating a data-driven culture within the organisation, mentoring team members, and contributing … Understanding of Data Lakehouse Architecture: You have a strong grasp of the principles and implementation of Data Lakehouse architecture. Hands-On Experience with Spark-Based Solutions: You possess experience with Spark-based platforms like Azure Synapse, Databricks, Microsoft Fabric, or even on-premise Spark ...

team. What We’re Looking For Proficient in one of Python, Scala or Java with strong experience in Big Data technologies such as: Spark, Hadoop etc. Practical knowledge of building real-time event streaming pipelines (e.g., Kafka, Spark Streaming, Kinesis). Proficiency … Points For Expertise in Data Modelling, schema design, and handling both structured and semi-structured data. Familiarity with distributed systems such as Hadoop, Spark, HDFS, Hive, Databricks. Exposure to AWS Lake Formation and automation of ingestion and transformation layers. Background in delivering solutions for highly regulated industries. Passion ...

collaboration and delivery. What We're Looking ForStrong proficiency in Python, Scala, or Java with hands-on experience in Big Data technologies including Spark, Hadoop, or similar distributed processing frameworks. Practical experience building real-time event streaming pipelines using technologies such as Kafka, Spark Streaming, or Amazon Kinesis within AWS environments. Proven expertise designing modern Data Lakehouse and Data Warehousing architectures, alongside a solid understanding of CI/CD, DevOps practices, and GDPR-compliant data governance. Experience delivering scalable cloud-based data solutions and using AI-enabled tools responsibly ...

record of building and managing real-time data pipelines across a track record of multiple initiatives. Expertise in developing data backbones using distributed streaming platforms (Kafka, Spark Streaming, Flink, etc.). Experience working with cloud platforms such as AWS, GCP, or Azure for real ...

collaboration and delivery. What We're Looking ForStrong proficiency in Python, Scala, or Java, with hands-on experience of Big Data technologies including Spark, Hadoop, or similar distributed processing frameworks. Experience building real-time event streaming solutions using technologies such as Kafka, Spark Streaming … solutions. Bonus Points ForExpertise in data modelling, schema design, and working with structured and semi-structured datasets. Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation. Knowledge of automating ingestion and transformation frameworks within cloud-native data platforms. Experience delivering solutions within highly ...

PowerShell, Prometheus, Grafana, Elasticsearch) xp with Infrastructure-as-Code and Automation tools such as Terraform, Chef, Ansible, CloudFormation/Azure Resource Manager (ARM) Streaming platforms such as Azure Event Hubs or Kafka, and stream processing services such as Spark streaming xp with Security Information ...

Drive – the operating manual for how we behave. Join us as a Senior Kafka Platform Engineer, to help develop and enhance the enterprise streaming platforms that enable secure, reliable and real-time data movement across Barclays. In this role, you will contribute to scalable, resilient and secure platform … solutions that support services used across the organisation. Working with cloud-native technologies, distributed systems and event-driven architectures, you will help improve streaming capabilities used by a wide range of teams and business areas. This is an opportunity for you to apply your technical skills at scale ...

Drive – the operating manual for how we behave. Join us as a Senior Kafka Platform Engineer, to help develop and enhance the enterprise streaming platforms that enable secure, reliable and real-time data movement across Barclays. In this role, you will contribute to scalable, resilient and secure platform … solutions that support services used across the organisation. Working with cloud-native technologies, distributed systems and event-driven architectures, you will help improve streaming capabilities used by a wide range of teams and business areas. This is an opportunity for you to apply your technical skills at scale ...

solutions that support services used across the organisation. Working with cloud‐native technologies, distributed systems and event‐driven architectures, you will help improve streaming capabilities used by a wide range of teams and business areas. This is an opportunity for you to apply your technical skills at scale … event‐driven architecture practices and Confluent Platform technologies, including Kafka Connect, Schema Registry, Cluster Linking and ksqlDB, to deliver reliable, scalable and efficient streaming solutions. Developing secure and automated platform capabilities using Infrastructure as Code, Kubernetes and CI/CD tooling, alongside performance optimisation, capacity planning and Kafka ...

time insight into live positions and risk. This platform underpins critical trading decisions and represents a major step forward in scalability, resilience, and streaming architecture across our technology estate. Responsibilities Design and build distributed, real‐time streaming components within a Flink‐based architecture. Develop and maintain … detects and publishes meaningful changes in liability. Ensure correctness in a high‐throughput environment through robust handling of ordering, duplication, and idempotency. Optimise streaming jobs for latency, throughput, and resource efficiency. Collaborate closely with trading and product teams to translate domain requirements into scalable, reliable systems. Contribute ...

related field is preferred. Preferred Skills Familiarity with cloud services like AWS, Google Cloud, or Azure. Experience with big data tools: Hadoop, Spark, Kafka, etc. Knowledge of data integration tools like Informatica, Talend, etc. Understanding of machine learning algorithms and statistics. Experience with data visualization tools like Tableau … etc. Knowledge of data warehousing solutions and ETL tools. Familiarity with data architecture and data modeling techniques. Experience with stream-processing systems: Storm, Spark-Streaming, etc. Knowledge of software development methodologies like Agile/Scrum. Understanding of data privacy and governance. #J-18808-Ljbffr ...

that are measurable and tied to business outcomesBuild — Design and validate solutions on both the customer side and the Treasure AI product sideDesign streaming architectures that handle real-world complexity: late-arriving events, schema drift, backpressure, partial failures, and sub-second SLA requirementsDrive technical decisions with clear rationale … software or data engineering experience, with at least 2 years in a customer-facing, embedded, or solutions engineering capacityStrong hands-on experience with streaming and event-driven architectures — Kafka, Flink, Kinesis, Spark Streaming, or equivalent (DynamoDB and MemoryDB/Redis)AWS Cloud Fluency - understand ...

senior authority for low-latency market data, ticker plants, market microstructure analytics, L1/L2/L3 data, time-series platforms, streaming architectures, and real-time data consumption across Front Office, Quantitative Analytics, Risk, Commercial Operations, and Trading Technology. The role holder will work closely with trading desks … Quants, execution teams, and risk stakeholders to improve insight into liquidity dynamics, market behaviour, execution quality, and trading performance. 4. Time-Series Platforms, Streaming Architecture & Engineering Act as the technical authority for enterprise time-series platforms, tick-data analytics, streaming architectures, ticker plants, and low-latency ...

surfaces (website, mobile app, and customer communications), and drive GenAI, Analytical, and DSML initiatives at petabyte scale. Our team builds and maintains: Streaming and batch data platforms that unlock data across Tripadvisor ETL pipelines and data models serving terabytes and growing datasets in Snowflake, BigQuery, and Hive, Orchestration … Python code across our evolving platform stack — from data ingestion and event processing to REST services and internal tooling. Build and maintain streaming and batch processing systems (Flink, Spark, Kafka) that power real‐time and analytical workloads. Take responsibility for all aspects of software engineering: design ...

Networks training.**Nice-to-Have Qualifications*** Experience with telecom digital twin platforms.* Experience with vector databases, embeddings, semantic search, or RAG.* Experience with streaming data platforms such as Kafka, Pub/Sub, Flink, or Spark Streaming.* Experience supporting closed-loop automation, predictive assurance, or self-healing ...

Drive – the operating manual for how we behave. Join us as a Kafka Platform Engineer To help develop and enhance the enterprise streaming platforms that enable secure, reliable and real-time data movement across Barclays. This role supports the delivery of scalable, resilient and secure platform solutions that … enterprise scale, helping to improve platform reliability, security and automation. This is an opportunity to help shape the future direction of strategic streaming capabilities while contributing to solutions that deliver meaningful business impact. Essential skills Designing, implementing and operating enterprise-scale Confluent Kafka platforms supporting business-critical workloads. ...