Management or mentorship experience, with a knack for guiding teams through early-stage projects.Familiarity with DBT, Redshift, and broader AWS platform tools such as Athena, Glue, and DataLake architecture.Expertise in data migration and implementing new data modeling stacks, particularly within gaming or entertainment sectors.Gaming industry experience is highly desirable more »
cloud hosting provider (AWS (preferred), Google Cloud, Azure or similar). Experience using modern build tools such as Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL more »
Kafka or equivalent distributed event store and stream-processing platform. Experience working with Redis or equivalent in-memory storage. Experience working with AWS S3, Athena, ECS, Cloud Formation, Lambdas & Cloudwatch. Experience with concurrent development source control (GIT). Systems integration experience with networking, data migrations, API integration and design. more »
Greater London, England, United Kingdom Hybrid / WFH Options
CommuniTech Recruitment Group
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
as Flask). Familiarity with SQL Server and/or PostgreSQL database technologies. Linux experience. Cloud development experience (e.g. AWS). Familiarity with SecDB, Athena or Quartz. Team Player with Excellent Communication Skills. more »
Architecture & Design Enterprise Architecture and good knowledge of object-oriented programming and design patterns AWS services: API gateway, Lambda, SNS, SQS, DynamoDB, Kinesis, EC2, Athena, Elastic Beanstalk REST API Design and specification using Swagger/OpenAPI Programming Experience of both functional programming and object-orientated programming Excellent programming skills more »
Greater London, England, United Kingdom Hybrid / WFH Options
BJSS
variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient data applications more »
ensuring it operates at peak performance, scalability, and reliability. Technical Skills required: RedShift Glue (inc. Glue Studio, Glue Data Quality, Glue DataBrew) Step Functions Athena Lambda Kinesis Python, Spark, Pyspark, SQL Your contributions as a Data Engineer will directly impact the organization's operations and revenue. In addition to more »
is a plus). Familiarity with ETL principles in contemporary data applications (Dagster, Airflow, Perfect). Familiarity with AWS services such as Glue, Redshift, Athena, and S3. Proficiency with Terraform, Kubernetes, and ArgoCD (expertise not required; cloud team support available). Thorough understanding of software engineering techniques, including version more »
development (e.g. usage of Express on EKS/ECS), as well as common cloud data engineering solutions and databases (e.g. AWS Lambda functions, AWS Athena, AWS Glue, AWS Step Functions etc.). Software engineering best practices, including DevOps, CI/CD, Agile, and infrastructure-as-code (particularly Terraform). more »
Streams, Kinesis, Akka and KSQL AWS, S3, Iceberg, Parquet, Glue and Spark/EMR for our Data Lake Elasticsearch, Dynamodb and Redis Starburst and Athena Airflow and ML Flow Additional InformationWhy should you jump on board? We pay special attention to learning and development and organise quarterly company learning more »
a majority of the following:Extensive experience in Python/PySpark coding and development, as well as SQL Expertise in AWS - Redshift, S3, Glue, Athena, Lambda etc Previous commercial experience in cloud migration projectsYou have led teams of Data Engineers before - making design decisions, interacting with stakeholders and being more »
SQL, Python, and Spark. Strong experience in big data technologies, AI, ML, and data modeling. Familiarity with AWS tools like S3, Iceberg, Glue Jobs, Athena, etc., is highly desirable.Experience: At least 5 years in data science, with a proven track record of impactful project delivery. Minimum 3 years of more »
AWS Data Architect (Must have current SC) Amber Labs was born out of the recognition that many organisations require support on their data maturity journey. Our team is passionate and experienced in delivering cutting-edge data capability. Amber Labs was more »
of data from multiple data sourcesExperience of CI/CD best practicesAnd would love you to know or learn:Experience of ETL technologiesAWS exposure (Athena, Glue, EMR, Step functions)Experience of relational database technologies (MS SQL Server, Redshift, Aurora)Experience with data solution BAU processes (ETL, table refresh etcAbout more »
description, key responsibilities, and job description: Hands on Senior Engineer with experience of working within high performance development teams Significant AWS Engineering experience implementing Amazon well architected frameworks, serverless solutions and improving existing platforms using AWS technologies with Agile delivery methods Demonstrable experience of Python 3, Python data management … or equivalent IT related experience. Skills Deep experience of AWS solutions incl. Step Functions, Glue, Lambda, RDS, (e.g. DynamoDB, Aurora Postgres), SQS, API Gateway, Athena Experience of Python Experience of the delivery and optimization of high-performance data pipelines from ingestion to storage to distribution Comfortable with data analysis more »
