or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience more »
modern data engineering technology stack. AWS or GCP is a must Experience with data ingestion methods and tools. Experience with distributed computing frameworks (e.g., Hadoop, Spark, Hive, Presto). Experience with data orchestration tools. Experience with cloud data warehousing and core data modelling concepts. Proficiency in version control systems more »
London, England, United Kingdom Hybrid / WFH Options
James Adams
Deep familiarity with a cloud-native, modern data engineering technology stack. Experience with data ingestion methods and tools. Experience with distributed computing frameworks (e.g., Hadoop, Spark, Hive, Presto). Experience with data orchestration tools. Experience with cloud data warehousing and core data modelling concepts. Proficiency in version control systems more »
South East London, England, United Kingdom Hybrid / WFH Options
McGregor Boyall
implement data models, ETL processes, and data warehousing solutions.Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines.Distributed Processing: Work with Hadoop, Spark, and other platforms for large-scale data processing.Real-Time Data Streaming: Develop and manage pipelines using CDC, Kafka, and Apache Spark.Database Management: Handle more »
London, England, United Kingdom Hybrid / WFH Options
McGregor Boyall
models, ETL processes, and data warehousing solutions. Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines. Distributed Processing: Work with Hadoop, Spark, and other platforms for large-scale data processing. Real-Time Data Streaming: Develop and manage pipelines using CDC, Kafka, and Apache Spark. Database more »
Sheffield, England, United Kingdom Hybrid / WFH Options
Undisclosed
of security principles and best practices for cloud-based solutions. Preferred Skills: Certification in cloud platforms. Experience with big data technologies such as ApacheHadoop, Spark, or Kafka. Knowledge of data governance and compliance frameworks. Familiarity with DevOps practices and tools (e.g., Git, Jenkins, Terraform). HSBC experience is more »
Chicago, Illinois, United States Hybrid / WFH Options
Request Technology - Robyn Honquest
CLI and IAM etc. (required) Experience with distributed message brokers using Kafka (required) Experience with high speed distributed computing frameworks such as AWS EMR, Hadoop, HDFS, S3, MapReduce, Apache Spark, Apache Hive, Kafka Streams, Apache Flink etc. (required) Experience working with various types of databases like Relational, NoSQL, Object more »
Sheffield, South Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Experis
of security principles and best practices for cloud-based solutions. Preferred Skills : Certification in cloud platforms. Experience with big data technologies such as ApacheHadoop, Spark, or Kafka. Knowledge of data governance and compliance frameworks. Familiarity with DevOps practices and tools (e.g., Git, Jenkins, Terraform). All profiles will more »
Manchester, England, United Kingdom Hybrid / WFH Options
Made Tech
how one could deploy infrastructure into different environments. Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes) Ability to create data pipelines on a more »
Bristol, England, United Kingdom Hybrid / WFH Options
Made Tech
how one could deploy infrastructure into different environments. Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes) Ability to create data pipelines on a more »
solving skills and creativity. Google Cloud Professional Cloud Architect or Professional Cloud Developer certification Very Disrable to have hands-on experience with ETL tools, Hadoop-based technologies (e.g., Spark), and batch/streaming data pipelines (e.g., Beam, Flink etc) Proven expertise in designing and constructing data lakes and data more »
Northampton, Northamptonshire, East Midlands, United Kingdom Hybrid / WFH Options
Dupen Ltd
Linux, APIs, infrastructure design load balancing, VMs, PostgreSQL, vector dbs. Senior ML Learning Engineer desirable skills: Version control (Git), computer vision libraries, Big Data (Hadoop, Spark), Cloud AWS, Google Cloud, Azure, and a knowledge of secure coding techniques PCI-DSS, PA-DSS, ISO27001. This is a fantastic opportunity to more »
London, England, United Kingdom Hybrid / WFH Options
Global Relay
JMeter or similar tools Web services technology such as REST, JSON or Thrift Testing web applications with Selenium WebDriver Big data technology such as Hadoop, MongoDB, Kafka or SQL Network principles and protocols such as HTTP, TLS and TCP Continuous integration systems such as Jenkins or Bamboo Continuous delivery more »
Months Location - Hybrid ( 2 days a week) JD : Experience of working with Streaming & Batch technology stack – Confluent Kafka, Mongdb , Streamsets, IBM CDC, Hive, Hadoop, API, Informatica, Airflow, and other similar technologies SME level skills and experience of designing/architecting test automation solutions, ability to creatively problem solve is more »
South East London, England, United Kingdom Hybrid / WFH Options
Oliver Bernard
essential:-Proven experience as an Architect and excellent knowledge of Big Data-Great understanding of Cloud e.g. Azure and or AWS-Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc-Excellent experience of ETL, data warehousing and handling a variety of data types-Very more »
Greater London, England, United Kingdom Hybrid / WFH Options
Anson McCade
and NoSQL databases Programming languages such as Spark or Python Amazon Web Services, Microsoft Azure or Google Cloud and distributed processing technologies such as Hadoop Benefits: Base Salary: £45,000 - £75,000 (DoE) Discretionary Bonus DV Bonus Flex Fund: £5000 Health: Private Medical Insurance Annual Leave: 25 Days plus more »
East London, London, United Kingdom Hybrid / WFH Options
Be Technology
scalable systems. Deep knowledge of distributed and scalable systems, including proficiency with PostgreSQL, Ray, RabbitMQ, and Cassandra. Familiarity with big data technologies such as Hadoop, Spark, or Kafka . Experience with CI/CD Strong problem-solving skills and the ability to troubleshoot complex issues in distributed systems. Excellent more »
Lewisville, Texas, United States Hybrid / WFH Options
Epsilon
Organizational, motivational, and interpersonal skills Additional, But Not Required Skills Spark libraries Scala programming Python programming SQL queries Experience with distributed computing Experience with Hadoop and cloud databases Additional Information About Epsilon Epsilon is a global advertising and marketing technology company positioned at the center of Publicis Groupe. Epsilon more »
Mesquite, Texas, United States Hybrid / WFH Options
Epsilon
Organizational, motivational, and interpersonal skills Additional, But Not Required Skills Spark libraries Scala programming Python programming SQL queries Experience with distributed computing Experience with Hadoop and cloud databases Additional Information About Epsilon Epsilon is a global advertising and marketing technology company positioned at the center of Publicis Groupe. Epsilon more »
Organizational, motivational, and interpersonal skills Additional, But Not Required Skills Spark libraries Scala programming Python programming SQL queries Experience with distributed computing Experience with Hadoop and cloud databases Additional Information About Epsilon Epsilon is a global advertising and marketing technology company positioned at the center of Publicis Groupe. Epsilon more »
Addison, Texas, United States Hybrid / WFH Options
Epsilon
Organizational, motivational, and interpersonal skills Additional, But Not Required Skills Spark libraries Scala programming Python programming SQL queries Experience with distributed computing Experience with Hadoop and cloud databases Additional Information About Epsilon Epsilon is a global advertising and marketing technology company positioned at the center of Publicis Groupe. Epsilon more »
Organizational, motivational, and interpersonal skills Additional, But Not Required Skills Spark libraries Scala programming Python programming SQL queries Experience with distributed computing Experience with Hadoop and cloud databases Additional Information About Epsilon Epsilon is a global advertising and marketing technology company positioned at the center of Publicis Groupe. Epsilon more »
Southlake, Texas, United States Hybrid / WFH Options
Epsilon
Organizational, motivational, and interpersonal skills Additional, But Not Required Skills Spark libraries Scala programming Python programming SQL queries Experience with distributed computing Experience with Hadoop and cloud databases Additional Information About Epsilon Epsilon is a global advertising and marketing technology company positioned at the center of Publicis Groupe. Epsilon more »
Carrollton, Texas, United States Hybrid / WFH Options
Epsilon
Organizational, motivational, and interpersonal skills Additional, But Not Required Skills Spark libraries Scala programming Python programming SQL queries Experience with distributed computing Experience with Hadoop and cloud databases Additional Information About Epsilon Epsilon is a global advertising and marketing technology company positioned at the center of Publicis Groupe. Epsilon more »
Grapevine, Texas, United States Hybrid / WFH Options
Epsilon
Organizational, motivational, and interpersonal skills Additional, But Not Required Skills Spark libraries Scala programming Python programming SQL queries Experience with distributed computing Experience with Hadoop and cloud databases Additional Information About Epsilon Epsilon is a global advertising and marketing technology company positioned at the center of Publicis Groupe. Epsilon more »