experience with data orchestration tools: e.g. Apache Airflow, Dagster. Experience with big data storage and processing technologies: e.g. DBT, Spark, SQL, Athena/Trino, Redshift, Snowflake, RDBMSs (PostgreSQL/MySQL). Knowledge of event-driven architectures and streaming technologies: e.g. Apache Kafka, Kafka Streams, Apache Flink. Experience with public more »
pipelines (e.g., Beam, Flink etc) Proven expertise in designing and constructing data lakes and data warehouse solutions utilising technologies such as BigQuery, Azure Synapse, Redshift, Oracle, Teradata, and more. Familiarity with Agile methodologies, particularly Scrum, to support dynamic project management. Valuable contributions to open-source projects, reflecting your commitment more »
building large scale DW/BI systems for B2B SAAS companies · Experience with open-source tools like Apache Flink and AWS tools like S3, Redshift, EMR and RDS. · Experience with AI/Machine Learning and Predictive Analytics · Experience in developing global products will be a big plus. · Understanding of more »
Sheffield, England, United Kingdom Hybrid / WFH Options
BJSS
involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient more »
analytics packages (i.e. GA) Familiar with digital tracking technologies (ad servers, DSPs, DMPs) Experience with big data (e.g. cookie logs) and cloud technologies - AWS, Redshift, S3, Athena, GCP, BigQuery more »
cloud hosting provider (AWS (preferred), Google Cloud, Azure or similar). Experience using modern build tools such as Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL and more »
useful. Engineer with past experience with Java, Data, and Infrastructure (DevOps). Java is a key skill Programming: Java, Python, PySpark Storage Mechanisms: MongoDB, Redshift, AWS S3 Cloud Environments/Infra: AWS (required), [AWS Lambda, Terraform] (nice to have) Data Platforms: Creating data pipelines within Databricks or equivalent such more »
Lead AWS Data Engineer - London (Hybrid) - Permanent - £90,000-£100,000 Start-up, AWS, DBT, Redshift, PostgreSQL, Python, MongoDB, ELT *You must be based in London, and have full permanent right to work in the UK to apply for this role* I'm currently working with an exciting and … Engineer to join the team! Specifically, they're looking for: Extensive experience as a Data Engineer using AWS Very strong ability in DBT and Redshift Proven experience working in an autonomous, start-up environment . Expert ability with PostgreSQL , ELT , unstructured data , and MongoDB . Experience with infrastructure architecture … advert above ASAP and I will be in touch. Lead AWS Data Engineer - London (Hybrid) - Permanent - £90,000-£100,000 Start-up, AWS, DBT, Redshift, PostgreSQL, Python, MongoDB, ELT more »
Lincoln, England, United Kingdom Hybrid / WFH Options
BJSS
involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient more »
Strong experience of Python Deep knowledge of NLP such as hugging face and spacy AWS - ETL Processes (Glue, Lambda etc.), ECS, S3, Database Solutions (Redshift, RDS) Vector Databases a big plus Familiar with Graph Data Structure and Algorithms Benefits: Competitive salary and benefits package, including health insurance, life insurance more »
self-service analytics solutions. Proficiency in data modelling, ETL processes, data integration, and data visualisation tools. Previous Cloud Migration experience essential (either Synapse, BigQuery, Redshift) Expert level experience working with Azure and or Certified Azure Data Engineer Associate Interest on and exposure to on Generative AI are beneficial. Desired more »
cloud hosting provider (AWS (preferred), Google Cloud, Azure or similar). Experience using modern build tools such as Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL and more »
a Data Architect or similar role, with a focus on AWS cloud environments. Strong knowledge of AWS services relevant to data architecture, such as AmazonRedshift, Amazon Athena, Amazon S3, AWS Glue, and AWS Lambda. Experience designing and implementing data lakes, data warehouses, and analytics solutions more »
database structure systems, data mining, data analysis, and strong software engineering skills. Strong understanding of Data Engineering Proficiency in AWS, data warehousing (Snowflake, Databricks, Redshift), big data frameworks (Spark, Kafka), container orchestration platforms (Kubernetes), and data integration/ETL tools. Strong written and verbal communication skills, with the ability more »
Data modelling Principles & best practices and also needs prior experience leading a data engineering team. Key Tech: - AWS (S3, Glue, EMR, Athena, Lambda) - Snowflake, Redshift - DBT (Data Build Tool) - Programming: Python, Scala, Spark, PySpark or Ab Initio - Data pipeline orchestration (Apache Airflow) - Knowledge of SQL This is a more »
an enterprise environment, component technologies, and service-oriented architectures Experience with No-SQL and SQL DBs, also exposure to big data environments (e.g., Hadoop, Redshift) Technical experience with Cloud services and Infraestructure more »
an enterprise environment, component technologies, and service-oriented architectures Experience with No-SQL and SQL DBs, also exposure to big data environments (e.g., Hadoop, Redshift) Technical experience with Cloud services and Infraestructure more »
Data Factory, Azure SQL Database, Azure Databricks, Azure Cosmos DB, Azure Synapse Analytics (formerly SQL Data Warehouse), etc. Familiarity with AWS services such as AmazonRedshift, AWS Glue, Amazon S3, Amazon RDS, Amazon EMR, etc. Basic understanding of GCP services like BigQuery, Cloud Dataflow, Cloud more »
AWS Certified Solutions Architect - Professional, AZ-305) Intermediate to expert level familiarity with a commercial analytics or data warehousing platform such as Databricks, Snowflake, RedShift, Azure DataLake Experience with AI/ML applications and pipelines Industry knowledge in any of the following verticals is highly desired: Healthcare/HealthTech more »
platforms. We specialise on using the latest frameworks, reference architectures and technologies using AWS, Azure and GCP. Essential Skills and Experience: * AWS (e.g., Athena, Redshift, Glue, EMR) * Strong AWS Data Solution Architect Experience on Data Related Projects * Java, Scala, Python, Spark, SQL * Experience of developing enterprise grade ETL/ more »
related to database management. Ability to independently analyze and gather insights from data in real time. Knowledge of statistical methods & scripting (SQL, Snowflake or Redshift); Python or R, PowerShell a plus. Experience with visualization of data including Tibco Spotfire, Tableau, R, PowerPivot, PowerBI, Excel and others. Processes to transform more »
At Amazon, we're working to be the most customer-centric company on earth. One customer experience that were constantly taking to new levels is how we fulfill and deliver customers orders. Our goal is to delight our customers by delivering their packages quickly and accurately, anywhere in the … world. To meet this goal, Amazon is continually striving to innovate and provide best-in-class service levels by pioneering new products and services in the last mile delivery space. Come join the team and help us work hard, have fun, and make history! The EU DSP Management team … of results PREFERRED QUALIFICATIONS Experience managing, analyzing and communicating results to senior leadership AWS Cloud Practitioner/AWS Solutions Architect/AWS Data Engineer Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on more »
transform and load the datasets. Your Profile Key skills/knowledge/experience: Good understanding of AWS cloud data platform services: EC2, EMR, RDS, Redshift, Glue. Ability to work with object-oriented scripting languages: Python, Pyspark. Knowledge of data pipeline and workflow management and their tools such as Airflow. more »
Reading, England, United Kingdom Hybrid / WFH Options
BJSS
involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient more »
Leeds, England, United Kingdom Hybrid / WFH Options
BJSS
involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient more »