databases, including PostgreSQL, ClickHouse, Cassandra, and Redis. In-depth knowledge of ETL/ELT pipelines, data transformation, and storage optimization. Skilled in working with big data frameworks like Spark, Flink, and Druid. Hands-on experience with both bare metal and AWS environments. Strong programming skills in Python, Java, and other relevant languages. Proficiency in containerization technologies (Docker, Kubernetes) and More ❯
databases, including PostgreSQL, ClickHouse, Cassandra, and Redis. In-depth knowledge of ETL/ELT pipelines, data transformation, and storage optimization. Skilled in working with big data frameworks like Spark, Flink, and Druid. Hands-on experience with both bare metal and AWS environments. Strong programming skills in Python, Java, and other relevant languages. Proficiency in containerization technologies (Docker, Kubernetes) and More ❯
programming skills (Python, Java, C++) and experience with DevOps practices (CI/CD). Familiarity with containerization (Docker, Kubernetes), RESTful APIs, microservices architecture, and big data technologies (Hadoop, Spark, Flink). Knowledge of NoSQL databases (MongoDB, Cassandra, DynamoDB), message queueing systems (Kafka, RabbitMQ), and version control systems (Git). Preferred Skills: Experience with natural language processing libraries such as More ❯
using open-source tools like ELK, Grafana, Prometheus, Nagios, Telegraf, and others. Hands-on experience with middleware technologies (Kafka, API gateways, etc.) and Data Engineering frameworks (Apache Spark, Airflow, Flink, Hadoop ecosystems). Understanding of network fundamentals, Data Structures, scalable system design, and the ability to translate information into structured solutions for product and engineering teams. Some other highly More ❯
generation (SSG) in Next.js Experience with testing frameworks like Jest, Cypress, or React Testing Library. Experience with authentication strategies using OAuth, JWT, or Cognito Familiarity with Apache Spark/Flink for real-time data processing is an advantage. Hands-on experience with CI/CD tools Commercial awareness and knowledge of public sector. Excellent communicator, able to interact with More ❯
continuous improvement across the team 🧰 What You’ll Need Strong experience leading data engineering teams in high-growth environments Deep expertise with real-time data processing tools (e.g. Kafka, Flink, Spark Streaming) Solid hands-on knowledge of cloud platforms (AWS, GCP or Azure) Strong proficiency in languages like Python, Java or Scala Familiarity with orchestration tools such as Airflow More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Atarus
continuous improvement across the team 🧰 What You’ll Need Strong experience leading data engineering teams in high-growth environments Deep expertise with real-time data processing tools (e.g. Kafka, Flink, Spark Streaming) Solid hands-on knowledge of cloud platforms (AWS, GCP or Azure) Strong proficiency in languages like Python, Java or Scala Familiarity with orchestration tools such as Airflow More ❯
South East London, England, United Kingdom Hybrid / WFH Options
Atarus
continuous improvement across the team What You’ll Need Strong experience leading data engineering teams in high-growth environments Deep expertise with real-time data processing tools (e.g. Kafka, Flink, Spark Streaming) Solid hands-on knowledge of cloud platforms (AWS, GCP or Azure) Strong proficiency in languages like Python, Java or Scala Familiarity with orchestration tools such as Airflow More ❯
Python, SQL, Javascript) Experience of Azure, AWS or GCP cloud platforms and Data Lake/Warehousing Platforms such as Snowflake, Iceberg etc Experience of various ETL and Streaming Tools (Flink, Spark) Experience of a variety of data mining techniques (APIs, GraphQL, Website Scraping) Ability to translate Data into meaningful insights Excellent verbal and written communication skills Understanding of modern More ❯
Python, SQL, Javascript) Experience of Azure, AWS or GCP cloud platforms and Data Lake/Warehousing Platforms such as Snowflake, Iceberg etc Experience of various ETL and Streaming Tools (Flink, Spark) Experience of a variety of data mining techniques (APIs, GraphQL, Website Scraping) Ability to translate Data into meaningful insights Excellent verbal and written communication skills Understanding of modern More ❯
Hands-on experience with SQL, Data Pipelines, Data Orchestration and Integration Tools Experience in data platforms on premises/cloud using technologies such as: Hadoop, Kafka, Apache Spark, ApacheFlink, object, relational and NoSQL data stores. Hands-on experience with big data application development and cloud data warehousing (e.g. Hadoop, Spark, Redshift, Snowflake, GCP BigQuery) Expertise in building data More ❯
become reusable foundations for others Technical Capabilities 6+ years experience in data engineering or distributed systems Deep proficiency in Python and SQL Fluent in tools like Apache Spark , Beam , Flink , or Kafka Experience with cloud data warehouses (BigQuery, Snowflake) and orchestration tools (Airflow, Prefect, Dagster) Understanding of data lakehouse patterns (Iceberg, Delta Lake), vector stores , and graph databases Proven More ❯
SQL, Javascript) Experience of Azure, AWS or GCP cloud platforms and Data Lake/Warehousing Platforms such as Snowflake, Iceberg etc Experience of various ETL and Streaming Tools (fiveTran, Flink, Spark) Experience of a variety of data mining techniques (APIs, GraphQL, Website Scraping) Ability to translate Data into meaningful insights Excellent verbal and written communication skills Understanding of modern More ❯
Mountain View, California, United States Hybrid / WFH Options
LinkedIn
work in a fast-paced, dynamic environment. Hands-on involvement with large-scale distributed systems and client-server architectures. Familiarity with Data Infrastructure tech stacks: Kafka/PubSub systems, Flink, Airflow. In-depth knowledge of AI/machine learning and data analytics. Skilled at leading and influencing within large, matrixed organizations. Track record of leading high-impact, cross-organization More ❯
to cross-functional teams, ensuring best practices in data architecture, security and cloud computing Proficiency in data modelling, ETL processes, data warehousing, distributed systems and metadata systems Utilise ApacheFlink and other streaming technologies to build real-time data processing systems that handle large-scale, high-throughput data Ensure all data solutions comply with industry standards and government regulations … not limited to EC2, S3, RDS, Lambda and Redshift. Experience with other cloud providers (e.g., Azure, GCP) is a plus In-depth knowledge and hands-on experience with ApacheFlink for real-time data processing Proven experience in mentoring and managing teams, with a focus on developing talent and fostering a collaborative work environment Strong ability to engage with More ❯
the biggest names in the insurance industry. We are developing a modern real-time ML platform using technologies like Python, PyTorch, Ray, k8s (helm + flux), Terraform, Postgres and Flink on AWS. We are very big fans of Infrastructure-as-Code and enjoy Agile practices. As a team, we're driven by a relentless focus on delivering real value … Knowledge of building and maintaining CI/CD pipelines for efficient software delivery. Nice to have: Coding skills in Python Knowledge of other areas of our tech stack (GitLab, Flink, Helm, FluxCD etc.) Knowledge of enterprise security best practices Proven experience in leading successful technical projects with an infrastructure/platform focus. Ability to effectively communicate technical concepts to More ❯
VCS (git), and Linux Proven experience in cross-functional teams and able to communicate effectively about technical and operational challenges. Preferred Qualifications: Proficiency with scalable data frameworks (Spark, Kafka, Flink) Proven Expertise with Infrastructure as Code and Cloud best practices Proficiency with monitoring and logging tools (e.g., Prometheus, Grafana) Working at Lila Sciences, you would have access to advanced More ❯
to support real-time decision-making in the FX market. Building such systems is highly challenging and provides opportunities to work with modern technologies like NoSQL databases, Kafka, ApacheFlink, and more. It offers significant opportunities for growth, leadership, and innovation, as well as direct interaction with clients and business teams to deliver impactful solutions in the FX market. More ❯
Hands on experience with Snowflake or other cloud data warehouses. Expertise with Infrastructure as Code (Terraform, Serverless Framework, AWS CDK). Exposure to real time data processing (Kinesis, Kafka, Flink, or Spark Streaming). Familiarity with TypeScript/Node.js serverless patterns and event driven architectures. Observability tooling (Datadog, Prometheus, OpenTelemetry) and performance tuning Job Description: Insight Global is seeking More ❯
with analytical databases. Familiarity with both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team and provide technical direction. Experience ensuring More ❯
and give production support. Build, validate, and optimize large-scale, Back-Middle-Front end solutions in heterogeneous environments. Develop and manage processes in batch (Java Springboot) and streaming (ApacheFlink). Working in agile continuous integration/DevOps paradigm and tool set (Git, Jenkins, Sonar, Nexus, Jira, and Splunk). What UST expects from you? 10-15 years experience … in software development, most of the time using these technologies: The ideal candidate must be proficient in Java, Flink, Hazelcast, Springboot, Kafka, Angular and the entire Web Applications - Real Time ecosystem. Additionally, they should have good management abilities to lead a small team, resolve urgent production issues, and execute end-to-end deliveries. Technical Expertise: Deep knowledge of cloud More ❯
