AWS ecosystems like Lambdas, step functions and ECS services. Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as more »
AWS ecosystems like Lambdas, step functions and ECS services. Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as more »
AWS ecosystems like Lambdas, step functions and ECS services. Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as more »
AWS ecosystems like Lambdas, step functions and ECS services. Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as more »
of AWS ecosystems like Lambdas, step functions and ECS services.Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT.Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen more »
Greater London, England, United Kingdom Hybrid / WFH Options
CommuniTech Recruitment Group
services. Experience of Dremio is a nice to have Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as more »
services. Experience of Dremio is a nice to have Experience with data stack technologies, such as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as more »
preferred) Solid understanding of libraries like Pandas and NumPy Experience in data warehousing tools like Snowflake, Databricks, BigQuery Familiar with AWS Step Functions, Airflow, Dagster, or other workflow orchestration tools Commercial experience with performant database programming in SQL Capability to solve complex technical issues, comprehending risks prior to the more »
leading orchestration tools. In this role, you'll lead the development of robust, fully tested data pipelines in Python using cutting-edge platforms like Dagster/Airflow and apply your expertise in real-time data streaming solutions using Kafka. You'll play a key role in expanding their on more »
/Java Software Engineering skills Excellent AWS knowledge, ideally with exposure to Airflow, Glue, Iceberg and Snowflake Previous experience with Dremio, dbt, EMR or Dagster Good Computer Science fundamentals knowledge with strong knowledge of software and data architecture. If you would like more information on the above, please apply more »
and ingestion pipelines. Requirements: Proven experience working with Python or Java or C# Experience working with ELT/ELT technologies such as Airflow, Argo, Dagster, Spark, Hive Strong technical expertise, especially in data processing and exploration, with a willingness to learn new technologies. A passion for automation and driving more »
The core skillset: Object Oriented Python for building software & APIs (they also use Trino & Kong) Experience with Airflow or other orchestration tools (Hadoop, CloudComposer, Dagster etc) Demonstrable cloud experience developing in AWS (preferable), GCP, or Azure Experience of developing real-time streaming workloads – Kafka, Kinesis, PubSub, Flink, Spark Beyond more »
Abingdon-On-Thames, England, United Kingdom Hybrid / WFH Options
Mirus Talent
in Python for scripting, automation, and data manipulation tasks. Beneficial Experience: While not mandatory, familiarity with the following technologies and tools would be advantageous: Dagster (or similar Orchestration Tools) : Experience with Dagster or other orchestration tools like Airflow for managing complex data workflows and pipelines. Qlik Sense Cloud more »
At Bazaarvoice, we create smart shopping experiences. Through our expansive global network, product-passionate community & enterprise technology, we connect thousands of brands and retailers with billions of consumers. Our solutions enable brands to connect with consumers and collect valuable user more »
Data Platform Engineer @ IMU Biosciences Our immune system plays a vital role in maintaining our health and wellbeing. Understanding how it works has led to the development of some of the most innovative and exciting therapies currently revolutionizing medicine. Our more »
South East London, England, United Kingdom Hybrid / WFH Options
Durlston Partners
Job Description𝐃𝐚𝐭𝐚 𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫 - 𝐓𝐞𝐜𝐡 𝐃𝐫𝐢𝐯𝐞𝐧 𝐈𝐧𝐯𝐞𝐬𝐭𝐦𝐞𝐧𝐭 𝐅𝐢𝐫𝐦 - 𝐋𝐨𝐧𝐝𝐨𝐧 - 𝐔𝐩 𝐭𝐨 £𝟏𝟔𝟎𝐤 + 𝐁𝐨𝐧𝐮𝐬WFH: 2 days in the officeSalary: Up to £160k + BonusA tech-driven investment firm in the city is looking to add a number of Data Engineers to more »
ID (previously AAD) for IAM, Identity Governance and Privileged Identity Management. Driving the work to secure their Data Platform, including their use of Databricks, Dagster and Snowflake along with in-house developed applications and CI/CD pipeline. Collaborate with wider tech and security teams on the implementation and … on experience with Microsoft Sentinel. Ideally experience of securing Github and Github actions (or similar). Ideally experience in securing data platforms (e.g. Databricks, Dagster, Snowflake). Experience in Threat Modelling. Exposure to Agile working and DevSecOps. Knowledge of ISO 27001. Relevant certifications, such as: Microsoft certifications (MS … within The Conduct of Employment Agencies & Employment Businesses Regulations 2003. Key Words – KQL, Terraform, Python, Azure, Key Vault, Security, Microsoft, Sentinel, Microsoft Defender, Powershell, Dagster, Security Engineer, Security Consultant, Security Analyst, Cloud Security, Cyber Security, Engineer more »
