building large scale DW/BI systems for B2B SAAS companies · Experience with open-source tools like Apache Flink and AWS tools like S3, Redshift, EMR and RDS. · Experience with AI/Machine Learning and Predictive Analytics · Experience in developing global products will be a big plus. · Understanding of more »
in AWS, across a wide range of AWS services with the ability to demonstrate working on large engagements * Experience of AWS tools (e.g. Athena, Redshift, Glue, EMR) * Java, Scala, Python, Spark, SQL * Experience of developing enterprise grade ETL/ELT data pipelines. * Deep understanding of data manipulation/wrangling more »
These: Exposure to, and ideally experience with, modern data architectures (e.g. data lake, lake house, data mesh) and accompanying technologies (e.g. Azure Synapse, Snowflake, AmazonRedshift) Awareness of data governance and all surrounding legislation Interest in security and how to handle PII data Excellent written and verbal communication more »
Reading, England, United Kingdom Hybrid / WFH Options
Xpertise Recruitment
develop, and maintain scalable data pipelines and ETL processes leveraging GCP, AWS, and/or Azure services Cloud Database Management: BigQuery, Snowflake, Databricks, and Redshift Architect data models and schemas in BigQuery to support analytics, reporting, and business intelligence initiatives. Python development Implement data governance and security best practices more »
working on large engagements. This role requires candidates to go through SC Clearance, so you must be eligible. Experience of AWS tools (e.g Athena, Redshift, Glue, EMR) Java, Scala, Python, Spark, SQL Experience of developing enterprise grade ETL/ELT data pipelines. NoSQL Databases. Dynamo DB/Neo4j/ more »
experience with data orchestration tools: e.g. Apache Airflow, Dagster. Experience with big data storage and processing technologies: e.g. DBT, Spark, SQL, Athena/Trino, Redshift, Snowflake, RDBMSs (PostgreSQL/MySQL). Knowledge of event-driven architectures and streaming technologies: e.g. Apache Kafka, Kafka Streams, Apache Flink. Experience with public more »
a plus) and SQL, using on a daily basis over number of years Big Data on the cloud (Snowflake, Big Query, S3/Athena, Redshift, Delta Lake) Strong communication skills (both written and verbal) Degree in Computer Science, Engineering, Management Information Systems, Mathematics, a related field, or equivalent work more »
as a code (AWS CloudFormation or Terraform) Monitoring and Alerting Documentation and Knowledge sharing Experiences required: Extensive experience with AWS database technologies Knowledge of Amazon RDS, Amazon Aurora, Amazon DynamoDB and Redshift Extensive experience with SQL and Scripting languages such as Python, Bash or Powershell Strong more »
pipelines (e.g., Beam, Flink etc) Proven expertise in designing and constructing data lakes and data warehouse solutions utilising technologies such as BigQuery, Azure Synapse, Redshift, Oracle, Teradata, and more. Familiarity with Agile methodologies, particularly Scrum, to support dynamic project management. Valuable contributions to open-source projects, reflecting your commitment more »
database structure systems, data mining, data analysis, and strong software engineering skills. Strong understanding of Data Engineering Proficiency in AWS, data warehousing (Snowflake, Databricks, Redshift), big data frameworks (Spark, Kafka), container orchestration platforms (Kubernetes), and data integration/ETL tools. Strong written and verbal communication skills, with the ability more »
useful. Engineer with past experience with Java, Data, and Infrastructure (DevOps). Java is a key skill Programming: Java, Python, PySpark Storage Mechanisms: MongoDB, Redshift, AWS S3 Cloud Environments/Infra: AWS (required), [AWS Lambda, Terraform] (nice to have) Data Platforms: Creating data pipelines within Databricks or equivalent such more »
South East London, London, United Kingdom Hybrid / WFH Options
Stepstone UK
able to lend hands-on support to the team working on and using the following technologies:Data Warehousing, Data Modelling, Database Design, ETL, AWS Redshift, SQL Server, Power BI, Cloud/DevOps AWS, Docker, Terraform, Bitbucket, Bamboo, Team City, Octopus CI/CD deploy pipeline, Agile, pair programming, code more »
strong DataOps team. As a Data Engineer, you will be working closely with devOps and analytics teams building out and supporting the Data Warehouse (Redshift, migrating to Snowflake), core data pipelines, and supporting our data infrastructure, and analytics capabilities. The role will also have DBA responsibilities for databases across … UK and meet the following criteria: Required Skills & Experience: Working experience of core AWS services (S3, EC2, VPC, RDS, Lambda) Expert knowledge of AWS Redshift, Snowflake Cloud Data warehouse (Both preferable) Experience in designing and implementing data warehouses, data marts or data lakes Data-modelling techniques (Relational, 3NF and … AWS Glue, DBT, airflow etc. GIT and experience in building CI/CD pipelines DBA Experience in AWS cloud environment managing AWS Aurora, and Amazon RDS (MySQL, Postgres, MSSQL) Desired: Experience of financial services or consumer finance IaaC such as Terraform or AWS CloudFormation Knowledge of visualization tools, e.g. more »
Birmingham, England, United Kingdom Hybrid / WFH Options
Xpertise Recruitment
deploying, and maintaining machine learning models in production environments. AWS cloud services, especially in building and managing data pipelines and machine learning workflows: S3, Redshift, Lambda, Glue, EMR, EKS (Kubernetes) Familiarity with MLOps/DevOps concepts and practices, including version control, CI/CD, and model monitoring. Proficiency in more »
Newcastle Upon Tyne, England, United Kingdom Hybrid / WFH Options
Xpertise Recruitment
deploying, and maintaining machine learning models in production environments. AWS cloud services, especially in building and managing data pipelines and machine learning workflows: S3, Redshift, Lambda, Glue, EMR, EKS (Kubernetes) Familiarity with MLOps/DevOps concepts and practices, including version control, CI/CD, and model monitoring. Proficiency in more »
pipelines (e.g., Beam, Flink etc) Proven expertise in designing and constructing data lakes and data warehouse solutions utilising technologies such as BigQuery, Azure Synapse, Redshift, Oracle, Teradata, and more. Familiarity with Agile methodologies, particularly Scrum, to support dynamic project management. Valuable contributions to open-source projects, reflecting your commitment more »
pipelines (e.g., Beam, Flink etc) Proven expertise in designing and constructing data lakes and data warehouse solutions utilising technologies such as BigQuery, Azure Synapse, Redshift, Oracle, Teradata, and more. Familiarity with Agile methodologies, particularly Scrum, to support dynamic project management. Valuable contributions to open-source projects, reflecting your commitment more »
Manchester, North West, United Kingdom Hybrid / WFH Options
N Brown Group
in principles and practices and tools like Jira and Confluence. What technical skills you will have Experience with general Cloud products (Cloyd SQL, BigQuery, RedShift, Snowflake, Apache Beam, Spark) or similar products. Experience with open-source data-stack tools such as Airflow, Airbyte, DBT, Kafka etc. Awareness of data more »
Cardiff, Wales, United Kingdom Hybrid / WFH Options
BJSS
involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient more »
Swansea, Wales, United Kingdom Hybrid / WFH Options
BJSS
involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient more »
Exeter, England, United Kingdom Hybrid / WFH Options
BJSS
involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient more »
Nottingham, England, United Kingdom Hybrid / WFH Options
BJSS
involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient more »
Reading, England, United Kingdom Hybrid / WFH Options
BJSS
involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient more »
