351 to 375 of 1,226 Kafka Jobs

Excellent communication and stakeholder engagement skills. Desirable Experience Databricks certification. Unity Catalog and Databricks Asset Bundles. Terraform or Bicep. dbt or similar transformation frameworks. Kafka, Event Hubs, or other streaming technologies. Retail, supply chain, or consumer goods industry experience. Apply Now This is a fantastic opportunity to join ...

communicate complex technical ideas clearly, collaborate effectively with stakeholders and champion better ways of working. Nice to Have Experience with Docker, Java/Scala, Kafka, Pulsar, Azure Event Hub, Collibra, Apache Iceberg, Apache Arrow, PySpark or AI engineering technologies such as Snowflake AI, LangChain, LlamaIndex or Pinecone would ...

communicate complex technical ideas clearly, collaborate effectively with stakeholders and champion better ways of working. Nice to Have Experience with Docker, Java/Scala, Kafka, Pulsar, Azure Event Hub, Collibra, Apache Iceberg, Apache Arrow, PySpark or AI engineering technologies such as Snowflake AI, LangChain, LlamaIndex or Pinecone would ...

Bundles * Terraform or Bicep * dbt or similar transformation frameworks * Retail or CPG data exposure such as POS, inventory, supply chain * Streaming technologies such as Kafka or Event Hubs Education * Degree in computer science, data engineering or related field, or equivalent practical experience ...

Strong commercial experience with Java development. Expertise in Spring Boot and microservices-based architectures. Experience working within AWS cloud environments. Knowledge of Apache Kafka and asynchronous messaging solutions. Strong understanding of ISO 20022 payments standards. Hands-on experience with the ICON IPF framework. Experience working with major banking ...

Strong commercial experience with Java development. Expertise in Spring Boot and microservices-based architectures. Experience working within AWS cloud environments. Knowledge of Apache Kafka and asynchronous messaging solutions. Strong understanding of ISO 20022 payments standards. Hands-on experience with the ICON IPF framework. Experience working with major banking ...

relevant experience and the ability to work across comparable technologies. Examples Of Technologies In Scope Include Data processing and logic: ANSI SQL, Apache Spark, Kafka Data formats: JSON, Avro, Parquet Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling ...

Databricks Microsoft Fabric Azure Synapse Analytics BigQuery Redshift Programming Python SQL PySpark Scala (preferred) Data Integration Azure Data Factory Apache Airflow dbt Informatica Talend Kafka Databases SQL Server Oracle PostgreSQL MongoDB Cosmos DB Data Governance Microsoft Purview Collibra Alation Unity Catalog DevOps Git Azure DevOps GitHub Actions CI/ ...

implement database schemas and optimise SQL queries against PostgreSQL databases handling high-volume transactional data; Build and maintain event-driven architectures using Apache Kafka for asynchronous processing of financial events across distributed services; Develop and maintain a payment orchestration system routing payments across Payment Service Providers to optimise cost ...

infrastructure-as-code practices Hands-on expertise with distributed data processing frameworks (e.g., Apache Spark, Hadoop) and real-time data streaming technologies (e.g., Kafka, Kinesis, Spark) Track record of collaborating with cross-functional teams (engineering, analytics, business stakeholders) to deliver impactful data solutions Experience evaluating, selecting, and integrating emerging ...

relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised or Kubernetes-based deployment ...

minimal supervision Desirable/Nice to Have: CI/CD pipeline setup and configuration Document-based/NoSQL databases, the ELK stack, or Apache Kafka Spring Security and OAuth2, React, React Native, Keycloak, Camunda, OpenAPI/Swagger, or Nginx setup and configuration Why Apply? £30k - £40k Hybrid working from ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost‐control systems (such as Karpenter, Infracost, OpenCost ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost‐control systems (such as Karpenter, Infracost, OpenCost ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost‐control systems (such as Karpenter, Infracost, OpenCost ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost‐control systems (such as Karpenter, Infracost, OpenCost ...

JavaScript Experience in developing and deploying microservices architectures using Spring Boot, Spring Batch, Spring Data, or similar frameworks Knowledge of JIRA, Junit, and Apache Kafka are preferred Hands-on experience with NoSQL DB (CosmosDB, MongoDB) In-depth knowledge of REST API principles, HTTP protocol Familiarity with containerization tools ...

Release and configuration management. Production support and incident troubleshooting. Python or another scripting language. AWS certification. Terraform. Apache Airflow/MWAA. Databricks or Spark. Kafka/Kinesis. dbt. Experience working in Agile/Scrum environments. Experience 4+ years of experience in Data Engineering, DevOps, DataOps, or a closely related ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real-time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost-control systems (such as Karpenter, Infracost, OpenCost ...

building and managing real-time data pipelines across a track record of multiple initiatives. Expertise in developing data backbones using distributed streaming platforms (Kafka, Spark Streaming, Flink, etc.). Experience working with cloud platforms such as AWS, GCP, or Azure for real-time data ingestion and storage. Programming skills ...

Kubernetes containerisation and orchestration Elasticsearch/Kibana Cloud services (AWS or Azure) Helm charts MongoDB Experience building enterprise level web applications or services Apache Kafka Benefits: £:Competitive salary Contributory Pension Scheme (up to 10.5% company contribution) 6 times salary Life Assurance with pension 25 days holiday (increasing with service ...

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Reporting tools (e.g. Tableau, PowerBI ...

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such ...

Tornado or Django, DockerExperience working with ETL pipelines is desirable e.g. Luigi, Airflow or ArgoExperience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data qualityPreparing data for predictive and prescriptive modellingHands on coding experience, such as PythonReporting ...

with considerable depth in one or more disciplines (e.g., cloud, AI/ML, data engineering)Experience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, observability tools (Dynatrace, Splunk, Grafana), and orchestration frameworks (Airflow, Temporal)Advanced working knowledge of relational and NoSQL databases, vector stores, data lake ...