1,626 to 1,650 of 1,889 Kafka Jobs

and Researchers to develop tools & frameworks that facilitate the day-to-day operation of trading pipelines. They use Amazon S3 for data storage, Python libraries (Pandas) for data manipulation, Kafka for event-based data transformations, which are deployed using Octopus Deploy. Familiarity with some or all of these will be beneficial but not essential. This role offers a great More ❯

Python for scripting and analytics Airflow (or equivalent workflow orchestration tools) Power BI , and optionally Plotly/Dash for data visualisation Strong experience with AWS or equivalent Spark or Kafka (experience with one or the other expected) Proficiency in data modelling techniques such as Star or Snowflake schema Experience designing and deploying transformation pipelines in production Passion for data More ❯

with 3rd party applications integration (API, FTP, Message queue, etc.). Prior experience developing in PYTHON Technologies Cloud (AWS). Rapid Development (RAD). Messaging/Data Streaming solution (Kafka, RabbitMQ, etc.). Database Admin. Linux exposure. REST API. This role offers a competitive base salary and a 50-100% bonus potential Don't miss out on this opportunity More ❯

coding standards, Test Driven Development, Continuous Integration, and Continuous Testing. Help the integration of application development across various full stack technologies, including Power Platform, Messaging services, Rabbit MQ, API, Kafka live streaming or similar. Manage the integration of application with high availability analytics and business intelligent products, ALM tooling's, application monitoring systems. Implement standards and best practices, mentor More ❯

with 3rd party applications integration (API, FTP, Message queue, etc.). Prior experience developing in PYTHON Technologies Cloud (AWS). Rapid Development (RAD). Messaging/Data Streaming solution (Kafka, RabbitMQ, etc.). Database Admin. Linux exposure. REST API. This role offers a competitive base salary and a 50-100% bonus potentialDon't miss out on this opportunity to More ❯

Cloud services (Azure, GCP, or AWS). Experience using cloud services for data engineering and analytics. Knowledge of distributed systems, serverless data pipelines, and big data technologies (e.g., Spark, Kafka). Ability to define and enforce data governance standards. Experience providing architectural guidance, mentorship, and leading cross-functional discussions to align architectural decisions. Interview Process Recruiter Call Hiring Manager More ❯

facing viewpoint, understanding where your team and products fit into the bigger picture. Essential: * Modern software engineering for digital products (ideally Java, microservice architectures, Hexagonal software architecture, Mongo and Kafka) * Significant demonstrable experience of leading engineering teams providing technical leadership and guidance, and coaching and mentoring to support team member development opportunities * Significant demonstrable experience of collaboration & sharing of More ❯

implementation • 5+ years of experience with data exploration, data cleaning, data analysis, data visualization, or data mining • Experience with production-level systems, data lake environments, and streaming data, including Kafka • Experience implementing end-to-end ML workflows from data prep to deployment and evaluation • Ability to quickly learn infrastructure or systems concepts, including how pipelines interface with data lakes More ❯

align technology with business objectives and cost efficiency. Security & Compliance Knowledge: GDPR, API authentication, and observability best practices. Big data processing: Understanding data lakes, warehouses, and tools like Spark, Kafka, and Airflow. ETL Pipelines: Ability to evaluate data ingestion, transformation, and cleaning processes. DevOps & CI/CD: Hands-on knowledge of Jenkins, GitHub Actions, Terraform, and CloudFormation. What's More ❯

Studies (PDS) through workshops and documentation. What You Bring Technical Expertise Solid understanding of enterprise payment systems and preferably FIS EPC solutions. Experience or familiarity with Kubernetes, Oracle, PostgreSQL, Kafka, REST APIs, OIDC, major cloud platforms (AWS, Azure, GCP, Oracle Cloud), MQ technologies, and SIEM tools like Splunk. Proven track record in a technical pre-sales or solution consulting More ❯

Researchers to develop tools & frameworks that facilitate the day-to-day operation of trading pipelines. They use Amazon S3 for data storage, Python libraries (e.g. Pandas) for data manipulation, Kafka for event-based data transformations, which are deployed using Octopus Deploy. Familiarity with some or all of these will be beneficial but not essential. This role offers a great More ❯

document classification, extraction, and search, while collaborating with MLOps and infrastructure teams. Ideal candidates will have 5+ years of data science experience, proficiency in Python and streaming data (e.g., Kafka), and familiarity with data lake environments. Onsite Required (Ft. Belvoir & Reston, VA). Security Clearance: TS/SCI required (must be active in DISS). Minimum Requirements: • 5+ years More ❯

Caffe2, TensorFlow, Theano, CNTK, Keras) and ML tools (SparkML, AML). 7+ years in IT platform implementation, consulting, and distributed solutions design. Experience with databases (SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis), cloud solutions (AWS or equivalent), systems, networks, and operating systems. If you need accommodations during the application process, please visit this link . More ❯

data management (privacy, consent, encryption) Experience working with customer data platforms such as Salesforce or similar Excellent communication and stakeholder engagement skills Exposure to big data tools (Hadoop, Spark, Kafka) Knowledge of integrating ML models and AI into data platforms Industry certifications (e.g. CDMP, AWS, Azure) Experience with data visualisation tools (Power BI, Tableau, Looker) This role offers: A More ❯

customer experiences. To be successful as a BATS Rates Java Developer – AVP, you should have experience with: •Java development in investment banking domain •Relational database management systems •Messaging brokers (Kafka, Solace, MQ, etc.) Some other highly valued skills may include: •Low latency programming experience •Proficiency in Scripting • Efficient communication skills You may be assessed on the key critical skills More ❯

to be successful Demonstrated experience as a Data engineer in a high volume, low latency environment; video games experience is a plus Experience with Big Data technologies such as Kafka, Spark Expert in Python for API integration, data manipulation and enrichment Advanced SQL: Aggregate and window functions, joins and CTEs Strong understanding of database design for optimal performance; experience More ❯

applications in the cloud Participate in R&D activities: evaluating new tools, improving system performance, and ensuring scalability What We're Looking For Knowledge of AWS data services: MSK (Kafka: message broker), EMR (Spark/Flink), Glue, Kinesis, MWAA (Airflow) Basic understanding of cloud environments (preferably AWS) Basic experience with infrastructure-as-code tools (e.g., Terraform, AWS CDK, or More ❯

and/or data pipelines. Experience with modern technologies and frameworks including FastAPI, PydanticAI, Haystack AI, OpenTelemetry, Procrastinate, databases like Postgres and Snowflake, queue systems such as SQS/Kafka, and Airflow. Hands-on experience with Kubernetes, including orchestration and lifecycle maintenance; you are not an SRE but you know how things run and what is required to ship More ❯

pager project proposal to be shared across the team for technical feedback. In this job, you will bring these skills Skills/Experience - Required: Streaming data systems - using Kafka, Spark, Map/Reduce or similar to process large data sets Experience with building and operating distributed systems and services at a high scale ( billions of transactions each day) Working More ❯

align technology with business objectives and cost efficiency. Security & Compliance Knowledge: GDPR, API authentication, and observability best practices. Big data processing: Understanding data lakes, warehouses, and tools like Spark, Kafka, and Airflow. ETL Pipelines: Ability to evaluate data ingestion, transformation, and cleaning processes. DevOps & CI/CD: Hands-on knowledge of Jenkins, GitHub Actions, Terraform, and CloudFormation. What's More ❯

Join to apply for the Data Architect role at Supermercados Guanabara 4 days ago Be among the first 25 applicants Join to apply for the Data Architect role at Supermercados Guanabara Get AI-powered advice on this job and more More ❯

regulatory reporting (MI-FID, PRIIPs, Consumer Duty) via policy-as-code pipelines. Platform Modernisation : Drive shift from batch ETL to event-driven streaming; partner with cloud-engineering on Snowflake, Kafka, K8s. Vendor & Tooling Strategy : Rationalise BI, MDM, and metadata tooling; negotiate enterprise licences. Leadership & Change : Build and mentor a 20-30 FTE cross-location data-architecture guild; embed OKRs More ❯

of these areas. Pride in readable, well-designed, well-tested solutions Ability to take a lead on the direction for a technical area in the platform space (eg. Containers, Kafka, Networking) Extensive experience with infrastructure tooling, ideally Terraform A strong background in software engineering, preferably with Go Proven leadership skills, including coaching, team-building and generally supporting peers and More ❯

customer experiences. To be successful as a BATS Rates Java Developer – AVP, you should have experience with: Java development in investment banking domain Relational database management systems Messaging brokers (Kafka, Solace, MQ, etc.) Some Other Highly Valued Skills May Include Low latency programming experience Proficiency in Scripting Efficient communication skills You may be assessed on the key critical skills More ❯

effectively to a non-technical audience Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience What Gives You an Edge: Prior experience with Kafka or similar streaming data technologies Deep understanding of cloud ecosystems and experience with public cloud platforms (AWS, Azure, GCP) Active participation in open-source communities or previous experience working More ❯