Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
startup environmentNice to Have•\tExperience solving problems using Digital Signal Processing•\tExperience with the properties of fresh concrete•\tUse of AWS Lambda functions and Athena•\tExperience working with time series data generated by IoT platformsPackageSalary for this role is in the range of £60-80k plus an equity more »
South East London, England, United Kingdom Hybrid / WFH Options
Maclean Moore
using Apache AirflowProficiency in Git based version control toolsProficiency with Linux commands and Bash ScriptingWorking experience in AWS Bigdata services (EMR, Glue, Data Pipelines, Athena, S3, Step Functions etc.) & AWS CLIExperience with CI/CD tools such as JenkinsExperience working with relational and/or MPP databasesKnowledge of Data more »
product thinkingTechnical SkillsArchitecture & DesignEnterprise Architecture and good knowledge of object-oriented programming and design patternsAWS services: API gateway, Lambda, SNS, SQS, DynamoDB, Kinesis, EC2, Athena, Elastic BeanstalkREST API Design and specification using Swagger/OpenAPIProgrammingExperience of both functional programming and object-orientated programmingExcellent programming skills in R and PythonExperience more »
Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT.Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.),Experience on RDBMS like PostgreSQL would be a plus.Experience building modern enterprise more »
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
desirable Strong skills and knowledge of Public cloud technologies to enable Cloud First delivery - AWS Elastic Kubernetes Service (EKS)/Cluster, EC2, S3 Buckets, Athena, Lambda, Glue and other services Docker – Container and Package Registry, AWS PostGres (database), Grafana dashboards to visualise test results Strong experience of setting up more »
cloud hosting provider (AWS (preferred), Google Cloud, Azure or similar). Experience using modern build tools such as Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL more »
success. Job Description: We are seeking a highly skilled and motivated Data Engineer with expertise in designing and implementing robust data pipelines on the Amazon Web Services (AWS) platform. As a Data Engineer at Luupli, you will play a critical role in developing and maintaining a scalable and efficient … Data Engineer, preferably in a startup or fast-paced environment. Strong expertise in designing and implementing data pipelines on AWS, including services such as Amazon S3, Glue, EMR, Athena, Redshift, and Lambda. Proficiency in programming languages commonly used in data engineering, such as Python or Scala. Experience with more »
cloud technologies. Strong experience with data orchestration tools: e.g. Apache Airflow, Dagster. Experience with big data storage and processing technologies: e.g. DBT, Spark, SQL, Athena/Trino, Redshift, Snowflake, RDBMSs (PostgreSQL/MySQL). Knowledge of event-driven architectures and streaming technologies: e.g. Apache Kafka, Kafka Streams, Apache Flink. more »
Preston, England, United Kingdom Hybrid / WFH Options
Uneek Global
in Python or Go Lang. • AWS Services: Significant hands-on experience with AWS services such as EKS, EC2, S3, IAM, Networks, serverless, Lambda, DynamoDB, Athena, CloudWatch. • CI/CD: Experience with CI/CD platforms and creating CI/CD pipelines. Such as Jenkins, ArgoCD, GitOps • Containerization and Microservice more »
cloud technologies. Strong experience with data orchestration tools: e.g. Apache Airflow, Dagster. Experience with big data storage and processing technologies: e.g. DBT, Spark, SQL, Athena/Trino, Redshift, Snowflake, RDBMSs (PostgreSQL/MySQL). Knowledge of event-driven architectures and streaming technologies: e.g. Apache Kafka, Kafka Streams, Apache Flink. more »
cloud hosting provider (AWS (preferred), Google Cloud, Azure or similar). Experience using modern build tools such as Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL more »
an understanding of Data modelling Principles & best practices and also needs prior experience leading a data engineering team. Key Tech: - AWS (S3, Glue, EMR, Athena, Lambda) - Snowflake, Redshift - DBT (Data Build Tool) - Programming: Python, Scala, Spark, PySpark or Ab Initio - Data pipeline orchestration (Apache Airflow) - Knowledge of SQL This more »
Sheffield, England, United Kingdom Hybrid / WFH Options
BJSS
variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient data applications more »
Lincoln, England, United Kingdom Hybrid / WFH Options
BJSS
variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient data applications more »
event store and stream-processing platform. Experience (1+ year) working with Redis or equivalent in-memory storage. Experience (1+ year) working with AWS S3, Athena, ECS, Cloud Formation, Lambdas & Cloudwatch. Experience (1+ year) with concurrent development source control (GIT). Systems integration experience (1+ year) with networking, data migrations more »
a Data Architect or similar role, with a focus on AWS cloud environments. Strong knowledge of AWS services relevant to data architecture, such as Amazon Redshift, AmazonAthena, Amazon S3, AWS Glue, and AWS Lambda. Experience designing and implementing data lakes, data warehouses, and analytics solutions more »
Greater London, England, United Kingdom Hybrid / WFH Options
CommuniTech Recruitment Group
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience building modern more »
Proficiency in Git based version control tools Proficiency with Linux commands and Bash Scripting Working experience in AWS Bigdata services (EMR, Glue, Data Pipelines, Athena, S3, Step Functions etc.) & AWS CLI Experience with CI/CD tools such as Jenkins Experience working with relational and/or MPP databases more »
development (e.g. usage of Express on EKS/ECS), as well as common cloud data engineering solutions and databases (e.g. AWS Lambda functions, AWS Athena, AWS Glue, AWS Step Functions etc.).Software engineering best practices, including DevOps, CI/CD, Agile, and infrastructure-as-code (particularly Terraform).In-depth more »
London, England, United Kingdom Hybrid / WFH Options
Ripple
financial datasets Experience with RESTful APIs and server-side APIs integration Highly or conceptually familiar with AWS cloud resources (S3, Lambda, API Gateway, Kinesis, Athena, etc.,) Experience with CI/CD pipeline orchestration, leveraging Gitlab and Terraform Experience with administration of Docker or Kubernetes infrastructure Appreciate the importance of more »
Reading, England, United Kingdom Hybrid / WFH Options
BJSS
variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient data applications more »
