101 to 125 of 381 Permanent Kafka Jobs

with minimal supervision Desirable Requirements: Experience with: CI/CD pipelines setup and config Document-based/No-SQL databases The ELK stack Apache Kafka Spring Security and OAuth2 flows React React Native Keycloak Camunda OpenAPI/Swagger Nginx setup and config The company offers fantastic benefits including Hybrid more »

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such more »

warehousing (e.g Oracle, DB2, SQL Server, Sybase, Snowflake) Document databases (e.g. Mongo, ArangoDB, Couchbase, Solr) Big Data (e.g. Hadoop ecosystem, Bigtable) Data streaming (e.g. Kafka, Flink, Pulsar, Beam, Spark) Cloud databases (e.g. Snowflake, CockroachDB) Other database genres (e.g. Graph, Columnar, time series) In return, we ll give you A more »

.NET Developer - Energy Trading - £75k base (£100k package) - Hybrid working Our client is seeking an experienced .NET Developer to join their team, working on complex projects with cutting-edge technologies. This hybrid role requires you to be in the office more »

London office Experience Required: - Commodities industry experience Weather forecasting Airflow (or equivalent data orchestration platforms) Data Modeling (Star Schema) Data Warehousing Data Pipeline Orchestration (Kafka) On-Prem SQL more »

code and conducting code reviews Willingness to learn new coding languages Nice to Have: Experience with frameworks libraries like FastAPI, Experience with Docker, Kubernetes, Kafka, RabbitMQ, PostgreSQL, MongoDB Experience working within a start-up have worked in a fin-tech or another highly regulated industry We CANNOT offer visa more »

e.g. DBT, Spark, SQL, Athena/Trino, Redshift, Snowflake, RDBMSs (PostgreSQL/MySQL). Knowledge of event-driven architectures and streaming technologies: e.g. Apache Kafka, Kafka Streams, Apache Flink. Experience with public cloud environments: e.g. AWS, GCP, Azure, Terraform. Strong knowledge of software engineering practices: e.g. testing, CI more »

integrity, data governance, data processing, data warehousing, and business intelligence. Expertise in modern data techniques using cloud technologies Experience with technologies such as Python, Kafka, ML/DL, AI, and Snowflake. Experience with transformation and change programs across large technology organizations. If this sounds like the role for you more »

Databricks Data Warehousing Data Engineering Very strong with the Microsoft Stack ESSENTIAL knowledge of PySpark clusters Python & C# Scripting experience Experience of message queues (Kafka) Experience of containerization (Docker) FINANCIAL SERVICES EXPERIENCE (Energy/commodities trading) If you have the above, please do apply right away. archie.odonovanharringtonstarr.com more »

Scientists and Service Engineering teams Experience with design, development and operations that leverages deep knowledge in the use of services like Amazon Kinesis, Apache Kafka, Apache Spark, Amazon Sagemaker, Amazon EMR, NoSQL technologies and other 3rd parties Develop and define key business questions and to build data sets that … Mathematics or a related field Experience of Data platform implementation, including 3 years of hands-on experience in implementation and performance tuning Kinesis/Kafka/Spark/Storm implementations Experience with analytic solutions applied to the Marketing or Risk needs of enterprises Basic understanding of machine learning fundamentals … models and implement them as part of data pipeline IT platform implementation experience Experience with one or more relevant tools ( Flink, Spark, Sqoop, Flume, Kafka, Amazon Kinesis) Experience developing software code in one or more programming languages (Java, JavaScript, Python, etc) Current hands-on implementation experience required Preferred Qualifications more »

with minimal supervision Desirable Requirements: Experience with: CI/CD pipelines setup and config Document-based/No-SQL databases The ELK stack Apache Kafka Spring Security and OAuth2 flows React React Native Keycloak Camunda OpenAPI/Swagger Nginx setup and config If this role would be of interest more »

Kubernetes. Experience with Azure Kubernetes Service (AKS), VMware Tanzu Kubernetes Grid, and ArgoCD Desirable: Knowledge and experience configuring and using MS SQL, PostgreSQL, Redis, Kafka and ElasticSearch. Proven knowledge and experience with networking concepts, namely load balancers, firewalls, NAT, reverse proxies, subnetting, VPC, VPN, and SDN. Soft skills: Excellent more »

and quality of data. Key Requirements: Strong experience designing data pipelines/warehouses using AWS and Snowflake. Exposure to big data technologies such as Kafka, Spark, or Hadoop. Solid experience with Snowflake, including performance optimisation and cost management. Strong experience with SQL and Data modelling. Excellent understanding of AWS more »

INFOData Engineer - Tech LeadFintechLondon110,000As a Tech Lead, you will be leading and managing a greenfield implementation for a disruptive Fintech. The data platform will be used to facilitate the launch of a new product.THE COMPANY:This company has gone more »

for you. They're seeking a skilled Java Developer to help create meaningful solutions using modern Java related technologies such as Spring Boot, Microservices, Kafka, Kubernetes, all while harnessing the power of AWS. Key Responsibilities : Develop and maintain Java applications with Spring Boot and microservices. Collaborate with cross-functional more »

get involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable more »

Location: London, SE1 9SG Salary: £70,000 - £100,000 Industry: Fintech Tech Stack: Go, Kubernetes, Kafka, GCP Great opportunity for a talented Developer (Go, Kubernetes, Kafka, GCP) to join a fintech startup that combines traditional and digital currencies into one seamless neobank platform. The Company Fast-growing fintech more »

require the highest data throughput in Java. We implement most of our long running services and analytics in C#.We use Airflow for workflow management, Kafka for data pipelines, Bitbucket for source control, Jenkins for continuous integration, ELK for logs, Grafana, Prometheus & InfluxDb for metrics, Docker and Kubernetes for containerisation more »

clouds. The successful Lead Data Engineer will have: Experience leading a Data Engineering team. Extensive working experience with GCP, SQL and DBT. Proficient in: Kafka, Dataform, Airflow, Tableau, PowerBI, Redshift, Snowflake, Terraform and BigQuery. What's in it for the successful Lead Data Engineer: Hybrid working for a better more »

systematic strategies in production, build tools to monitor strategies, build research infrastructure - with a heavy focus on data engineering. Tech stack: Python, Pandas, AWS, Kafka Requirements: Bachelors or Masters in an engineering or quantitative subject Strong Python production coding skills (deployed to AWS) Strong data engineering skills (e.g. ETL more »

their data and processes effectively. Required Skills and Experience Technologies: Backend (Node.js, Typescript), Frontend (React.js, Typescript), Database (MySQL), and familiarity with ECS, K8s, Airflow, Kafka, Serverless, AWS. Experience: Minimum 5 years in engineering leadership roles. Expertise in handling data-heavy products and presenting actionable insights. Background in cybersecurity products more »

Any of the following experience is considered a plus: GCP, AWS, BitBucket, VMWare Websphere, Linux, Bash, OpenStack/Kubernetes, Grafana, Prometheus, Loki, ELK stack, Kafka, MongoDB, MSSQL and SQL. -The ability to communicate abstract concepts to both technical and non-technical audiences. -Knowledge of supply chain and logistical industry more »

etc.) NoSQL databases (e.g. MongoDB, Neo4j, Redis, etc) Spark or other distributed big data systems (e.g. Hadoop, Pig, Hive, etc.) Stream-processing frameworks (e.g. Kafka) Data pipeline orchestration tools (e.g. Airflow, Prefect, Dagster, etc.) Job Requirements: Bachelor's/Master's in Computer Science, a related field, or equivalent more »

Role: Staff Engineer Salary/Package: £115k-£130k + 10% Bonus + RSUs (Total comp £175k+) Company Sector: SaaS Tech: TypeScript, Node, React, Golang, Kafka, AWS, and Kubernetes (No prior experience welcomed) Location: Central London WFH/Hybrid: 3 days a week on site (non negotiable) Bounce to continue … Mentoring: Mentor, sharing best practices, and encouraging a collaborative and innovative engineering culture. Core Technologies: Currently, the tech stack includes TypeScript, Node, React, Golang, Kafka, AWS, and Kubernetes. While familiarity with these technologies is a plus, the ideal candidate should have strong engineering foundations and problem-solving skills applicable more »

Senior Software Engineer Salary/Package: £100k-£115k + 10% Bonus + RSUs (Total comp £150k+) Company Sector: SaaS Tech: TypeScript, Node, React, Golang, Kafka, AWS, and Kubernetes (No prior experience welcomed) Location: Central London WFH/Hybrid: 3 days a week on site (non negotiable) Bounce to continue … and business requirements. Collaboration: Work with cross-functional teams to align technical efforts with product goals. Core Technologies: Currently using TypeScript, Node, React, Golang, Kafka, AWS, and Kubernetes. Qualifications: Experience: Proven track record in software engineering with expertise in designing scalable systems. Language Flexibility: Open to engineers from any more »