and data lakes using AWS and Azure cloud technologies. Utilize AWS and Azure data and analytics services (or their open-source equivalents) such as EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks. Design and deploy production data pipelines using languages like Java, Python, Scala, Spark, and SQL. Integrate … Ideally Have: A minimum of 2 years’ experience with AWS and Azure cloud technologies. Proficiency in AWS and Azure data and analytics services, including EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks. A solid foundation in data engineering, data science, and product development, with experience in both stream more »
years of professional experience. A good understanding of modern lakehouse architectures and corresponding technologies, such as Dremio, Snowflake, Iceberg, (Py)Spark/Glue/EMR, dbt and Airflow/Dagster. Experience with Cloud providers. Familiarity with AWS S3, ECS and EC2/Fargate would be considered particularly beneficial. Extensive more »
Greater London, England, United Kingdom Hybrid / WFH Options
Anson McCade
a Senior Data Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and more »
a Principal Data Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and more »
a good grasp of frameworks like DropWizard. Lakehouse Architectures: Familiarity with modern data technologies such as Dremio, Snowflake, Iceberg, (Py)Spark/Glue/EMR, dbt, and Airflow/Dagster. AWS Services: Hands-on experience with AWS, especially S3, ECS, and EC2/Fargate. Collaborative Approach: Proven ability to more »
delivering projects using relevant Data Architectural paradigms such as Kimball, Data Vault, Data Mesh, Lakehouse Demonstrable knowledge of key AWS services such as S3, EMR, Redshift, Athena, Lambda Excellent stakeholder management skills To be successfully appointed to this role, it is a requirement to obtain Security Check (SC) clearance. more »
South East London, London, United Kingdom Hybrid / WFH Options
Stepstone UK
English Bachelor's degree in Computer Science or a related field (Master's degree preferred) Nice to have: experience with LLMs, Vector Databases, AWS EMR, Spark, and Python Our commitment: Equal opportunities are important to us. We believe that diversity and inclusion at The Stepstone Group are critical to more »