Greater London, England, United Kingdom Hybrid / WFH Options
CommuniTech Recruitment Group
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
as Flask). Familiarity with SQL Server and/or PostgreSQL database technologies. Linux experience. Cloud development experience (e.g. AWS). Familiarity with SecDB, Athena or Quartz. Team Player with Excellent Communication Skills. more »
is a plus). Familiarity with ETL principles in contemporary data applications (Dagster, Airflow, Perfect). Familiarity with AWS services such as Glue, Redshift, Athena, and S3. Proficiency with Terraform, Kubernetes, and ArgoCD (expertise not required; cloud team support available). Thorough understanding of software engineering techniques, including version more »
development (e.g. usage of Express on EKS/ECS), as well as common cloud data engineering solutions and databases (e.g. AWS Lambda functions, AWS Athena, AWS Glue, AWS Step Functions etc.). Software engineering best practices, including DevOps, CI/CD, Agile, and infrastructure-as-code (particularly Terraform). more »
Streams, Kinesis, Akka and KSQL AWS, S3, Iceberg, Parquet, Glue and Spark/EMR for our Data Lake Elasticsearch, Dynamodb and Redis Starburst and Athena Airflow and ML Flow Additional InformationWhy should you jump on board? We pay special attention to learning and development and organise quarterly company learning more »
Greater London, England, United Kingdom Hybrid / WFH Options
BJSS
variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient data applications more »
Architecture & Design Enterprise Architecture and good knowledge of object-oriented programming and design patterns AWS services: API gateway, Lambda, SNS, SQS, DynamoDB, Kinesis, EC2, Athena, Elastic Beanstalk REST API Design and specification using Swagger/OpenAPI Programming Experience of both functional programming and object-orientated programming Excellent programming skills more »
Management or mentorship experience, with a knack for guiding teams through early-stage projects.Familiarity with DBT, Redshift, and broader AWS platform tools such as Athena, Glue, and DataLake architecture.Expertise in data migration and implementing new data modeling stacks, particularly within gaming or entertainment sectors.Gaming industry experience is highly desirable more »
AWS cloud services Developer for Machine Learning Software Development company. Key Skills Big data; import, manipulation, storage and management. Redshift; (Athena and Glue, security process and Infrastructure on Cloud/IoC). Python DevOps; Automation Testing, CI, implementation and environment provisioning. This is a senior role that will mix more »
ensuring it operates at peak performance, scalability, and reliability. Technical Skills required: RedShift Glue (inc. Glue Studio, Glue Data Quality, Glue DataBrew) Step Functions Athena Lambda Kinesis Python, Spark, Pyspark, SQL Your contributions as a Data Engineer will directly impact the organization's operations and revenue. In addition to more »
a majority of the following:Extensive experience in Python/PySpark coding and development, as well as SQL Expertise in AWS - Redshift, S3, Glue, Athena, Lambda etc Previous commercial experience in cloud migration projectsYou have led teams of Data Engineers before - making design decisions, interacting with stakeholders and being more »
Kafka or equivalent distributed event store and stream-processing platform. Experience working with Redis or equivalent in-memory storage. Experience working with AWS S3, Athena, ECS, Cloud Formation, Lambdas & Cloudwatch. Experience with concurrent development source control (GIT). Systems integration experience with networking, data migrations, API integration and design. more »
using relevant Data Architectural paradigms such as Kimball, Data Vault, Data Mesh, Lakehouse Demonstrable knowledge of key AWS services such as S3, EMR, Redshift, Athena, Lambda Excellent stakeholder management skills To be successfully appointed to this role, it is a requirement to obtain Security Check (SC) clearance. To obtain more »
SQL, Python, and Spark. Strong experience in big data technologies, AI, ML, and data modeling. Familiarity with AWS tools like S3, Iceberg, Glue Jobs, Athena, etc., is highly desirable.Experience: At least 5 years in data science, with a proven track record of impactful project delivery. Minimum 3 years of more »
of data from multiple data sourcesExperience of CI/CD best practicesAnd would love you to know or learn:Experience of ETL technologiesAWS exposure (Athena, Glue, EMR, Step functions)Experience of relational database technologies (MS SQL Server, Redshift, Aurora)Experience with data solution BAU processes (ETL, table refresh etcAbout more »
cloud hosting provider (AWS (preferred), Google Cloud, Azure or similar). Experience using modern build tools such as Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL more »