large scale DW/BI systems for B2B SAAS companies · Experience with open-source tools like Apache Flink and AWS tools like S3, Redshift, EMR and RDS. · Experience with AI/Machine Learning and Predictive Analytics · Experience in developing global products will be a big plus. · Understanding of budgets more »
have an understanding of Data modelling Principles & best practices and also needs prior experience leading a data engineering team. Key Tech: - AWS (S3, Glue, EMR, Athena, Lambda) - Snowflake, Redshift - DBT (Data Build Tool) - Programming: Python, Scala, Spark, PySpark or Ab Initio - Data pipeline orchestration (Apache Airflow) - Knowledge of SQL more »
Chicago, Illinois, United States Hybrid / WFH Options
Request Technology - Robyn Honquest
AWS CLI and IAM etc. (required) Experience with distributed message brokers using Kafka (required) Experience with high speed distributed computing frameworks such as AWS EMR, Hadoop, HDFS, S3, MapReduce, Apache Spark, Apache Hive, Kafka Streams, Apache Flink etc. (required) Experience working with various types of databases like Relational, NoSQL more »
Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience more »
Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience more »
Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience more »
Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience more »
Greater London, England, United Kingdom Hybrid / WFH Options
CommuniTech Recruitment Group
Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience more »
london, south east england, United Kingdom Hybrid / WFH Options
CommuniTech Recruitment Group
Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience more »
Appomattox, Virginia, United States Hybrid / WFH Options
Maxar Technologies
and the Joint Enterprise Modeling and Analytics (JEMA) framework or Apache NiFi. Experience in AWS services including but not limited to EC2, Sagemaker, S3, EMR, and IAM. Our salary ranges are market-driven and set to allow for flexibility. Individual pay will be competitive based on a candidate's more »
AWS CLI and IAM etc. (required) Experience with distributed message brokers using Kafka (required) Experience with high speed distributed computing frameworks such as AWS EMR, Hadoop, HDFS, S3, MapReduce, Apache Spark, Apache Hive, Kafka Streams, Apache Flink etc. (required) Working knowledge of DevOps tools. Eg Terraform, Ansible, Jenkins, Kubernetes more »
AWS CLI and IAM etc. (required) Experience with distributed message brokers using Kafka (required) Experience with high speed distributed computing frameworks such as AWS EMR, Hadoop, HDFS, S3, MapReduce, Apache Spark, Apache Hive, Kafka Streams, Apache Flink etc. (required) Working knowledge of DevOps tools. Eg Terraform, Ansible, Jenkins, Kubernetes more »
Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience more »
Job Description: We are seeking a highly skilled and motivated Data Engineer with expertise in designing and implementing robust data pipelines on the Amazon Web Services (AWS) platform. As a Data Engineer at Luupli, you will play a critical role in developing and maintaining a scalable and efficient … startup or fast-paced environment. Strong expertise in designing and implementing data pipelines on AWS, including services such as Amazon S3, Glue, EMR, Athena, Redshift, and Lambda. Proficiency in programming languages commonly used in data engineering, such as Python or Scala. Experience with data modelling and schema more »
a good grasp of frameworks like DropWizard. Lakehouse Architectures: Familiarity with modern data technologies such as Dremio, Snowflake, Iceberg, (Py)Spark/Glue/EMR, dbt, and Airflow/Dagster. AWS Services: Hands-on experience with AWS, especially S3, ECS, and EC2/Fargate. Collaborative Approach: Proven ability to more »
london, south east england, United Kingdom Hybrid / WFH Options
Durlston Partners
a good grasp of frameworks like DropWizard. Lakehouse Architectures: Familiarity with modern data technologies such as Dremio, Snowflake, Iceberg, (Py)Spark/Glue/EMR, dbt, and Airflow/Dagster. AWS Services: Hands-on experience with AWS, especially S3, ECS, and EC2/Fargate. Collaborative Approach: Proven ability to more »
of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration more »
of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration more »
of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration more »
of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration more »
of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration more »
of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration more »
of Epsilon's most prominent Database Marketing clients. What you'll do: Design, configure, and manage Data Warehouse Database Systems on Cloud (AWS Redshift, EMR HBase and Snowflake). Monitor and report on performance metrics, system health, and logging compliance on database services or database appliances. Perform database administration more »
