Manchester, Lancashire, United Kingdom Hybrid / WFH Options
Smart DCC
real-time data processing pipelines using platforms like Apache Kafka or cloud-native tools. Optimize batch processing workflows with tools like Apache Spark and Flink for scalable performance. Infrastructure Automation: Implement Infrastructure as Code (IaC) using tools like Terraform and Ansible. Leverage cloud-native services (AWS, Azure) to streamline More ❯
managing real-time data pipelines across a track record of multiple initiatives. Expertise in developing data backbones using distributed streaming platforms (Kafka, Spark Streaming, Flink, etc.). Experience working with cloud platforms such as AWS, GCP, or Azure for real-time data ingestion and storage. Programming skills in Python More ❯
managing real-time data pipelines across a track record of multiple initiatives. Expertise in developing data backbones using distributed streaming platforms (Kafka, Spark Streaming, Flink, etc.). Experience working with cloud platforms such as AWS, GCP, or Azure for real-time data ingestion and storage. Ability to optimise and More ❯
in working with data visualization tools Experience in GCP tools – Cloud Function, Dataflow, Dataproc and Bigquery Experience in data processing framework – Beam, Spark, Hive, Flink GCP data engineering certification is a merit Have hands on experience in Analytical tools such as powerBI or similar visualization tools Exhibit understanding in More ❯
engineering experience - Experience with data modeling, warehousing, and building ETL pipelines - Bachelor's degree - Knowledge of batch and streaming data architectures like Kafka, Kinesis, Flink, Storm, Beam - Knowledge of distributed systems as it pertains to data storage and computing - Experience programming with at least one modern language such as More ❯
advanced analytics infrastructure. Familiarity with infrastructure-as-code (IaC) tools such as Terraform or CloudFormation. Experience with modern data engineering technologies (e.g., Kafka, Spark, Flink, etc.). Why join YouLend? Award-Winning Workplace: YouLend has been recognised as one of the "Best Places to Work 2024" by the Sunday More ❯
models for real-time analytics. Proven experience in managing real-time data pipelines across multiple initiatives. Expertise in distributed streaming platforms (Kafka, Spark Streaming, Flink). Experience with GCP (preferred), AWS, or Azure for real-time data ingestion and storage. Strong programming skills in Python, Java, or Scala . More ❯
models for real-time analytics. Proven experience in managing real-time data pipelines across multiple initiatives. Expertise in distributed streaming platforms (Kafka, Spark Streaming, Flink). Experience with GCP (preferred), AWS, or Azure for real-time data ingestion and storage. Strong programming skills in Python, Java, or Scala . More ❯
development experience using SQL. Hands-on experience with MPP databases such as Redshift, BigQuery, or Snowflake, and modern transformation/query engines like Spark, Flink, Trino. Familiarity with workflow management tools (e.g., Airflow) and/or dbt for transformations. Comprehensive understanding of modern data platforms, including data governance and More ❯
and Redis. In-depth knowledge of ETL/ELT pipelines, data transformation, and storage optimization. Skilled in working with big data frameworks like Spark, Flink, and Druid. Hands-on experience with both bare metal and AWS environments. Strong programming skills in Python, Java, and other relevant languages. Proficiency in More ❯
/Nice to have Experience with a messaging middleware platform like Solace, Kafka or RabbitMQ. Experience with Snowflake and distributed processing technologies (e.g., Hadoop, Flink, Spark More ❯
oriented programming (OOP) principles & concepts Familiarity with advanced SQL techniques Familiarity with data visualization tools such as Tableau or Power BI Familiarity with ApacheFlink or Apache Storm Understanding of DevOps practices and tools for (CI/CD) pipelines. Awareness of data security best practices and compliance requirements (e.g. More ❯
Birmingham, Staffordshire, United Kingdom Hybrid / WFH Options
Yelp USA
solutions. Exposure to some of the following technologies: Python, AWS Redshift, AWS Athena/Apache Presto, Big Data technologies (e.g S3, Hadoop, Hive, Spark, Flink, Kafka etc), NoSQL systems like Cassandra, DBT is nice to have. What you'll get: Full responsibility for projects from day one, a collaborative More ❯
and experience with DevOps practices (CI/CD). Familiarity with containerization (Docker, Kubernetes), RESTful APIs, microservices architecture, and big data technologies (Hadoop, Spark, Flink). Knowledge of NoSQL databases (MongoDB, Cassandra, DynamoDB), message queueing systems (Kafka, RabbitMQ), and version control systems (Git). Preferred Skills: Experience with natural More ❯
london (isleworth), south east england, united kingdom
eTeam
OAuth, JWT, and data encryption. Fluent in English with strong communication and collaboration skills. Preferred Qualifications Experience with big data processing frameworks like ApacheFlink or Spark. Familiarity with machine learning models and AI-driven analytics. Understanding of front-end and mobile app interactions with backend services. Expertise in More ❯
OAuth, JWT, and data encryption. • Fluent in English with strong communication and collaboration skills. Preferred Qualifications: • Experience with big data processing frameworks like ApacheFlink or Spark. • Familiarity with machine learning models and AI-driven analytics. • Understanding of front-end and mobile app interactions with backend services. • Expertise in More ❯
OAuth, JWT, and data encryption. Fluent in English with strong communication and collaboration skills. Preferred Qualifications Experience with big data processing frameworks like ApacheFlink or Spark. Familiarity with machine learning models and AI-driven analytics. Understanding of front-end and mobile app interactions with backend services. Expertise in More ❯
london (hounslow), south east england, united kingdom
eTeam
OAuth, JWT, and data encryption. • Fluent in English with strong communication and collaboration skills. Preferred Qualifications: • Experience with big data processing frameworks like ApacheFlink or Spark. • Familiarity with machine learning models and AI-driven analytics. • Understanding of front-end and mobile app interactions with backend services. • Expertise in More ❯
or related fields. Proficient in multiple programming languages such as Python, C++. Java. Extensive experience with data processing tools and platforms such as Kafka, Flink, Databricks. Skilled in managing distributed computing management systems, like SLURM, LSF. Knowledgeable in both relational and non-relational databases (e.g., SQL, MongoDB). Familiarity More ❯
or related fields. Proficient in multiple programming languages such as Python, C++. Java. Extensive experience with data processing tools and platforms such as Kafka, Flink, Databricks. Skilled in managing distributed computing management systems, like SLURM, LSF. Knowledgeable in both relational and non-relational databases (e.g., SQL, MongoDB). Familiarity More ❯
or related fields. Proficient in multiple programming languages such as Python, C++. Java. Extensive experience with data processing tools and platforms such as Kafka, Flink, Databricks. Skilled in managing distributed computing management systems, like SLURM, LSF. Knowledgeable in both relational and non-relational databases (e.g., SQL, MongoDB). Familiarity More ❯
or related fields. Proficient in multiple programming languages such as Python, C++. Java. Extensive experience with data processing tools and platforms such as Kafka, Flink, Databricks. Skilled in managing distributed computing management systems, like SLURM, LSF. Knowledgeable in both relational and non-relational databases (e.g., SQL, MongoDB). Familiarity More ❯
or related fields. Proficient in multiple programming languages such as Python, C++. Java. Extensive experience with data processing tools and platforms such as Kafka, Flink, Databricks. Skilled in managing distributed computing management systems, like SLURM, LSF. Knowledgeable in both relational and non-relational databases (e.g., SQL, MongoDB). Familiarity More ❯
or related fields. Proficient in multiple programming languages such as Python, C++. Java. Extensive experience with data processing tools and platforms such as Kafka, Flink, Databricks. Skilled in managing distributed computing management systems, like SLURM, LSF. Knowledgeable in both relational and non-relational databases (e.g., SQL, MongoDB). Familiarity More ❯
or related fields. Proficient in multiple programming languages such as Python, C++. Java. Extensive experience with data processing tools and platforms such as Kafka, Flink, Databricks. Skilled in managing distributed computing management systems, like SLURM, LSF. Knowledgeable in both relational and non-relational databases (e.g., SQL, MongoDB). Familiarity More ❯