18 of 18 Flink Jobs

workflow and knowledge of when and how to use dedicated hardware. Significant experience with Apache Spark or any other distributed data programming frameworks (e.g. Flink, Hadoop, Beam) Familiarity with Databricks as a data and AI platform or the Lakehouse Architecture. Experience with data quality and/or and data ...

/CD, path to production Worked with AWS as a cloud platform Extensive hands-on experience with modern data technologies, ETL tools (e.g. Kafka, Flink, DBT etc.) , data storage (e.g. Snowflake, Redshift, etc.) and also IaC ( e.g. Terraform, CloudFormation ) Software development experience with one or more languages (e.g. Python ...

Terraform), Glue/Spark, Lambda, CI/CD (Jenkins/Gitlab) Nice to have skills: - QuickSight/Tableau; Redshift tuning; ksqlDB/Flink; Aurora Postgres. - Edge/API constraints (Apigee/API-GW), webhook patterns. ...

Looking For Strong experience with Scala (or JVM languages with a desire to specialise in Scala) Solid understanding of distributed data processing (Spark, Flink, or similar) Experience working with large datasets and complex data models Knowledge of data engineering fundamentals: data modelling, pipelines, ETL/ELT, testing Familiarity with ...

distributed systems, performance and failure modes, and experience with observability tooling. Comfortable with several languages (e.g. Python, Java, Kotlin, TypeScript) and technologies like Kafka, Flink, Redis and clustered Postgres. Familiarity with networking concepts (routing, load balancing, service‐to‐service communication); bonus points for leading teams and managing Kubernetes‐based ...

been siloed in a big firm then don’t worry. Additional exposure to the following is desired : - Tech Stack you will learn Hadoop and Flink RUST, Javascript, React, Redux, Flow Linux, Jenkins Kafka, Avro, Kubernetes, Puppet Involvement in the Java community My client is based London. Home work ...

genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists ...

genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists ...

genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists ...

genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists ...

genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists ...

genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists ...

genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists ...

experience, preferably in front office systems (e.g., trading platforms, pricing engines, market data systems). Proven expertise in reactive programming (Kafka Streams, Akka, Vert.x, Flink). Solid understanding of multithreading and Executor Services in Java. Strong background in functional programming and Java 8+ features. Adherence to robust engineering practices ...

role: SQL Server MS SSIS T-SQL Azure Data Factory Visual Studio Strong written & verbal communication Desirables: Python Azure Synapse/Databricks Flink/Kafka The role will be on a hybrid working basis with 3 days per week in the Liverpool office. The role is commutable from ...

Kafka, JD: Design, develop, and maintain scalable microservices using Java and Spring Boot. Build and optimize real-time data pipelines leveraging Apache Kafka, Flink, and Spark/Databricks. Develop robust data distribution and streaming solutions for high-throughput systems. Deploy, manage, and monitor services in containerized environments (Docker/… with Kafka and distributed streaming systems. Solid understanding of SQL and data modeling. Experience with containerization (Docker) and orchestration (Kubernetes). Working knowledge of Flink, Spark, or Databricks for data processing. Familiarity with AWS services (ECS, EKS, S3, Lambda, etc.). Basic scripting in Python for automation or data ...

/B testing, experiment tracking, and automated evaluation of recommendation models. Optimize ML workflows for cost-efficiency and scalability across distributed systems (e.g., Spark, Flink, TensorFlow Serving, TorchServe). Collaborate with product managers, engineers, and data scientists to translate research innovations into business-impacting production solutions. Ensure best practices … Java is a plus. Experience with ML frameworks and libraries (PyTorch, TensorFlow, XGBoost, LightGBM, etc.). Solid knowledge of distributed data processing systems (Spark, Flink, Hadoop) and query languages (SQL/HiveQL). Hands-on experience with ML pipeline orchestration tools (e.g., Airflow, Kubeflow, MLflow). Experience with containerization ...

Engineers top access to interesting jobs. For a renowned IT company, we are looking for someone for a PERMANENT POSITION Data Engineer - Focus Apache Flink Aufgaben Analyze and prepare data from the pre-systems Model and map scalable ELT/ETL flows (batch and streaming) Interface between Data Analysts … Experience in data modeling (relational databases and Apache Hadoop) Know-how of core technologies such as SQL (MS SQL Server), Apache Hadoop (Kafka, NiFi, Flink, Scala and/or Java, Python) and Linux Showing interest in working with high-frequency data processing in a near-realtime environment Wir bieten ...