data- and software engineering, and how to combine those to build data products. * Experience with DevOps methods. * Experience with Middleware, ETL/ELT, SQL, Apache Kafka, Streamsets, DBT, ApacheAirflow, Snowflake or similar tooling stack. * Experience with building cloud solutions (AWS/Azure, Serverless, cost engineering etc. more »
Preferred Qualifications * Designing and implementing real-time pipelines. * Designing and implementing data pipelines for CV/ML systems. * Experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M). * Experience with data quality and validation. * Experience querying more »
City of London, London, United Kingdom Hybrid / WFH Options
ECS Resource Group
role in shaping the technological landscape of our projects. Key Responsibilities: Architect end-to-end solutions, leveraging your expertise in Python, Java, Spark, Trino, Airflow, and Hadoop. Maintain a hands-on approach, ensuring that your architectural vision translates seamlessly into implementation. Collaborate with cross-functional teams to design and more »
