South East London, England, United Kingdom Hybrid / WFH Options
Anson McCade
Principal Data Engineer – AWS Location : London (Hybrid) Salary : £105,000 Job Type : Permanent A top-tier digital consultancy is making a key strategic hire at the Associate Director level for a hands-on, stakeholder-savvy Principal Data Engineer. You will take the helm of public and private sector data transformation programmes, drive technical delivery, and help shape a growing … practice at scale. This is a greenfield opportunity for a high-impact leader with deep AWS expertise and a consulting mindset as an experienced Principal Data Engineer. Key Responsibilities • Lead and deliver enterprise-grade data engineering solutions using core AWS services (S3, Glue, Lambda, Redshift, Matillion, etc.). • Define architecture, mentor large technical teams, and engage directly … and thought leadership. • Work closely with delivery and consulting leadership (including Head of Data Consulting) to shape project and platform strategy. Key Skills & Expertise • Extensive hands-on experience in AWS-first data engineering environments. • Proven track record leading multi-million-pound projects within consulting or enterprise-level engagements. • Strong stakeholder engagement at CxO or Director level. • Deep experience in More ❯
Based You must be eligible for SC Clearance Role Overview The Principal Data Engineer will be responsible for designing and implementing cloud-based data solutions using a range of AWS services. This role involves working closely with clients to define requirements, build custom solutions, and transfer knowledge to client technical teams. The ideal candidate is passionate about problem-solving … thrives in greenfield project environments, and enjoys working both independently and collaboratively. Key Responsibilities as a Principal Data Engineer Propose and implement data solutions using AWS services including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, and Matillion . Work directly with clients to define requirements, refine solutions, and ensure successful handover to internal teams. Design and … as-code principles. Contribute to a collaborative, knowledge-sharing team culture. Required Qualifications & Skills Strong experience in ETL processes and cloud data warehouse patterns . Hands-on expertise with AWS services (S3, Glue, Redshift). Proficiency with Matillion for data transformation. Experience working with various relational databases . Familiarity with data visualization tools such as QuickSight, Tableau, Looker, or More ❯
Based You must be eligible for SC Clearance Role Overview The Principal Data Engineer will be responsible for designing and implementing cloud-based data solutions using a range of AWS services. This role involves working closely with clients to define requirements, build custom solutions, and transfer knowledge to client technical teams. The ideal candidate is passionate about problem-solving … thrives in greenfield project environments, and enjoys working both independently and collaboratively. Key Responsibilities as a Principal Data Engineer Propose and implement data solutions using AWS services including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, and Matillion . Work directly with clients to define requirements, refine solutions, and ensure successful handover to internal teams. Design and … as-code principles. Contribute to a collaborative, knowledge-sharing team culture. Required Qualifications & Skills Strong experience in ETL processes and cloud data warehouse patterns . Hands-on expertise with AWS services (S3, Glue, Redshift). Proficiency with Matillion for data transformation. Experience working with various relational databases . Familiarity with data visualization tools such as QuickSight, Tableau, Looker, or More ❯
such as Ansible, Chef, Puppet, Salt Stack • Has experience of managing solutions, technologies and processes associated with vulnerability and configuration compliance in a Linux Red Hat/VMware/AWS environment. • Has experience of supporting production systems in an enterprise Linux Red Hat environment. • Experience performing monthly operating system security patching and remediating non-patchable vulnerabilities. • Has experience of … working with ITSM systems such as Service Now and understands priorities and SLA’s. • Has experience of AWS Product set such as EC2, Lambda, EKS, ECR, WorkSpaces, EBS, EFS, S3, RDS MSSQL, Route 53, VPC, Cloud Formation.Has strong documentation and technical writing skills. Desired • Has experience working in financial services sector. • Has experience of Qualys, and Ivanti Risk More ❯
such as Ansible, Chef, Puppet, Salt Stack • Has experience of managing solutions, technologies and processes associated with vulnerability and configuration compliance in a Linux Red Hat/VMware/AWS environment. • Has experience of supporting production systems in an enterprise Linux Red Hat environment. • Experience performing monthly operating system security patching and remediating non-patchable vulnerabilities. • Has experience of … working with ITSM systems such as Service Now and understands priorities and SLA’s. • Has experience of AWS Product set such as EC2, Lambda, EKS, ECR, WorkSpaces, EBS, EFS, S3, RDS MSSQL, Route 53, VPC, Cloud Formation.Has strong documentation and technical writing skills. Desired • Has experience working in financial services sector. • Has experience of Qualys, and Ivanti Risk More ❯
such as Ansible, Chef, Puppet, Salt Stack • Has experience of managing solutions, technologies and processes associated with vulnerability and configuration compliance in a Linux Red Hat/VMware/AWS environment. • Has experience of supporting production systems in an enterprise Linux Red Hat environment. • Experience performing monthly operating system security patching and remediating non-patchable vulnerabilities. • Has experience of … working with ITSM systems such as Service Now and understands priorities and SLA’s. • Has experience of AWS Product set such as EC2, Lambda, EKS, ECR, WorkSpaces, EBS, EFS, S3, RDS MSSQL, Route 53, VPC, Cloud Formation.Has strong documentation and technical writing skills. Desired • Has experience working in financial services sector. • Has experience of Qualys, and Ivanti Risk More ❯
Work on different data model designs, architecture, implementation, discussions and optimizations Interface with other teams to extract, transform, and load data from a wide variety of data sources using AWS big data technologies like EMR, RedShift, Elastic Search etc. Work on different AWS technologies such as S3, RedShift, Lambda, Glue, etc and Explore and learn the latest … AWS technologies to provide new capabilities and increase efficiency Work on data lake platform and different components in the data lake such as Hadoop, Amazon S3 etc. Work on SQL technologies on Hadoop such as Spark, Hive, Impala etc Help continually improve ongoing analysis processes, optimizing or simplifying self-service support for customers Must possess strong verbal and written More ❯
to grow – We’re on a transformation journey, and there’s huge opportunity to shape the future with us. Training and development - Paid for training, conferences and certification e.g. AWS Certs. We combine a passion for travel with a love for technology , delivering smart, seamless customer experiences and building platforms that handle the complexity of modern cruising — all while … reliable data pipelines, focusing on ingesting and transforming CRM and customer data from various sources. Lead & Innovate: Take technical ownership of customer data integration solutions within our data platform (AWS/SQL Server). Drive improvements and implement best-in-class data engineering practices. Ensure Quality: Champion data quality and governance for customer datasets. Implement robust monitoring, validation checks … production environment. Strong Technical Foundation: Expert-level SQL and proficiency in ETL principals. We currently use SQLSvr/SSIS, but are on a transformation journey of our data platform (AWS) Cloud Proficiency: Hands-on experience with at least one major cloud platform (AWS, Azure, or GCP) and its core data services (e.g., S3, Redshift, Lambda/Functions More ❯
to grow - We're on a transformation journey, and there's huge opportunity to shape the future with us. Training and development - Paid for training, conferences and certification e.g. AWS Certs. We combine a passion for travel with a love for technology , delivering smart, seamless customer experiences and building platforms that handle the complexity of modern cruising - all while … reliable data pipelines, focusing on ingesting and transforming CRM and customer data from various sources. Lead & Innovate: Take technical ownership of customer data integration solutions within our data platform (AWS/SQL Server). Drive improvements and implement best-in-class data engineering practices. Ensure Quality: Champion data quality and governance for customer datasets. Implement robust monitoring, validation checks … production environment. Strong Technical Foundation: Expert-level SQL and proficiency in ETL principals. We currently use SQLSvr/SSIS, but are on a transformation journey of our data platform (AWS) Cloud Proficiency: Hands-on experience with at least one major cloud platform (AWS, Azure, or GCP) and its core data services (e.g., S3, Redshift, Lambda/Functions More ❯
requested tens of millions of times per day as well as internal tools that keep our community safe and our business efficient. We run a modern containerised stack in AWS using a mixture of database technologies (MySQL, DynamoDB, Redis, Redshift, Elasticsearch) to serve different workloads. Our architecture is event-driven and we're bringing increasingly more machine learning into … get stuck in Bags of common sense with the raw ability and energy to make things happen, a real entrepreneurial spirit Bonus points Familiarity with building on the cloud AWS services - we use over 30 AWS services Experience working with ML technologies Protocols such as websockets and XMPP What you'll accomplish Collaborating on building new product features … of a supportive on-call team. Building internal tools to support your colleagues. Technology we love Go, Python, PHP Protocol buffers, gRPC Node, Typescript MySQL, Redis Elasticsearch, DynamoDB Containerisation, Lambda Why join Muzz? We're a profitable Consumer Tech startup, backed by Y Combinator (S17) and based in London. Join our fast growing team and work on an amazing More ❯
requested tens of millions of times per day as well as internal tools that keep our community safe and our business efficient. We run a modern containerised stack in AWS using a mixture of database technologies (MySQL, DynamoDB, Redis, Redshift, Elasticsearch) to serve different workloads. Our architecture is event-driven and we're bringing increasingly more machine learning into … get stuck in Bags of common sense with the raw ability and energy to make things happen, a real entrepreneurial spirit Bonus points Familiarity with building on the cloud AWS services - we use over 30 AWS services Experience working with ML technologies Protocols such as websockets and XMPP What you'll accomplish Collaborating on building new product features … of a supportive on-call team. Building internal tools to support your colleagues. Technology we love Go, Python, PHP Protocol buffers, gRPC Node, Typescript MySQL, Redis Elasticsearch, DynamoDB Containerisation, Lambda Why join Muzz? We're a profitable Consumer Tech startup, backed by Y Combinator (S17) and based in London. Join our fast growing team and work on an amazing More ❯
optimize user's data pipeline and SQL and database infrastructure across RoW; 2) help business stakeholders to provide data pipeline solutions with Amazon/ARTS internal tech products and AWS services (e.g. Redshift, SageMaker, EMR, ETL tools, data lake); 3) develop scripts for maintenance automation; 4) execute the tech implementation with a clear milestone planning and lead it to … Monitor, maintain and optimize the team data infra health and performance - Develop script to automate maintenance of the team data infra - Learn about a new business intelligence technology and AWS services About the team The Amazon ARTS (APEX-RoW Technology Solutions) team is responsible for creating core analytics tech capabilities and data engineering services for RoW (the rest of … to our customers around the world, including India, Japan, Australia, Brazil, Mexico, Singapore, Turkey and MENA. BASIC QUALIFICATIONS - Experience with scripting language (e.g., Python, Java, or R) - Experience with AWS tools and technologies (Redshift, S3, SageMaker, EMR, Lambda) - Business level communication skills in Japanese (listening, speaking, reading, writing) - Ability to read and write in English (ex. e-mail More ❯
business and customer value driven by real time analytics alongside our traditional products. How you will contribute: Build data pipelines: creating and maintaining data pipelines and ETL processes in AWS based infrastructure Support and Transition: Support and optimize our Forecasting Data Platform built on a serverless cloud native architecture. Work in an agile environment: within a collaborative agile cross … culture and Continuous Delivery process To succeed in this role it would be ideal if you possess Experience with programming in Python, Spark, and SQL. Hands-on experience with AWS services, including AWSLambda, Glue, Step Functions, Fargate and CDK. Experience with Docker containerization and managing container images using AWS ECR. Experience with Apache Iceberg or More ❯
unit and integration tests Familiar with xUnit, NUnit, Moq, etc. DevOps & Cloud Awareness (Nice to have) Knowledge of Azure DevOps pipelines, CI/CD workflows Deployment experience on Azure, AWSLambda, or container platforms 🌍 Why join Valcon? You’ll work on impactful consulting projects across industries You'll be surrounded by smart, supportive people who value clean code More ❯
unit and integration tests Familiar with xUnit, NUnit, Moq, etc. DevOps & Cloud Awareness (Nice to have) Knowledge of Azure DevOps pipelines, CI/CD workflows Deployment experience on Azure, AWSLambda, or container platforms 🌍 Why join Valcon? You’ll work on impactful consulting projects across industries You'll be surrounded by smart, supportive people who value clean code More ❯
unit and integration tests Familiar with xUnit, NUnit, Moq, etc. DevOps & Cloud Awareness (Nice to have) Knowledge of Azure DevOps pipelines, CI/CD workflows Deployment experience on Azure, AWSLambda, or container platforms Why join Valcon? You ll work on impactful consulting projects across industries You'll be surrounded by smart, supportive people who value clean code More ❯
unit and integration tests Familiar with xUnit, NUnit, Moq, etc. DevOps & Cloud Awareness (Nice to have) Knowledge of Azure DevOps pipelines, CI/CD workflows Deployment experience on Azure, AWSLambda, or container platforms Why join Valcon? You’ll work on impactful consulting projects across industries You'll be surrounded by smart, supportive people who value clean code More ❯
the opportunity to spin up MVPs of new products and features that we're excited about. What we need: Proficient with React, Styled Components, Typescript, Node, Express, PostgreSQL, and AWS (S3, Lambda) - ps. we've done our best to check this already Experience working with RESTful and GraphQL APIs. Opinionated about product: you care about creating beautiful user More ❯
what doesn't. Nice to have: experience with dbt, dagster, Metabase, or Snowflake. Our Tech Stack We work with a modern, scalable data stack: Data & Infrastructure : Snowflake, S3, OpenSearch, AWSLambda & Batch, Dagster, dbt Analytics & Experimentation : Amplitude, Appsflyer, Metabase Orchestration & Modeling : Dagster for pipelines, dbt for transformations, and a strong experimentation layer across tools. You'll help shape More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Intec Select
integrate data from diverse sources, including APIs like Facebook, Google Analytics, and payment providers. Develop and optimize data models for batch processing and real-time streaming using tools like AWS Redshift, S3, and Kafka. Lead efforts in acquiring, storing, processing, and provisioning data to meet evolving business requirements. Perform customer behavior analysis, gaming analytics, and create actionable insights to … Technical Requirements: 5+ years of experience in data engineering roles, with a proven ability to lead and mentor a team. Expertise in SQL, Python, and R. Strong proficiency in AWS technologies such as Redshift, S3, EC2, and Lambda. Experience with Kafka and real-time data streaming technologies. Advanced skills in building ETL pipelines and integrating data from APIs. Familiarity More ❯
integrate data from diverse sources, including APIs like Facebook, Google Analytics, and payment providers. Develop and optimize data models for batch processing and real-time streaming using tools like AWS Redshift, S3, and Kafka. Lead efforts in acquiring, storing, processing, and provisioning data to meet evolving business requirements. Perform customer behavior analysis, gaming analytics, and create actionable insights to … Technical Requirements: 5+ years of experience in data engineering roles, with a proven ability to lead and mentor a team. Expertise in SQL, Python, and R. Strong proficiency in AWS technologies such as Redshift, S3, EC2, and Lambda. Experience with Kafka and real-time data streaming technologies. Advanced skills in building ETL pipelines and integrating data from APIs. Familiarity More ❯
South East London, England, United Kingdom Hybrid / WFH Options
Intec Select
integrate data from diverse sources, including APIs like Facebook, Google Analytics, and payment providers. Develop and optimize data models for batch processing and real-time streaming using tools like AWS Redshift, S3, and Kafka. Lead efforts in acquiring, storing, processing, and provisioning data to meet evolving business requirements. Perform customer behavior analysis, gaming analytics, and create actionable insights to … Technical Requirements: 5+ years of experience in data engineering roles, with a proven ability to lead and mentor a team. Expertise in SQL, Python, and R. Strong proficiency in AWS technologies such as Redshift, S3, EC2, and Lambda. Experience with Kafka and real-time data streaming technologies. Advanced skills in building ETL pipelines and integrating data from APIs. Familiarity More ❯
Job Description AWS Stack, data being landed in S3, Lambda triggers, Data Quality, data written back out to AWS S3(Parquet Formats), Snowflake for dimensional model. Design and build the data pipelines, work with someone around understanding data transformation, this is supported by BA's, building out the data pipelines, moving into layers in the data architecture … Medallion architecture). Requirements 5 plus year's experience with AWS 5-8 years overall exposure to Data Technical Lead experience Proficient in Snowflake, S3, Lambda Triggers Hybrid London 1-2 days a week £(Apply online only) (Outside IR35) The reason they're hiring now, they have a client that is all on a legacy system, on-prem … platform, and they want to build out their AWS platform. They want to do a High-level architecture design to take to the low-level design. The client operates in the insurance domain (Commercial Finance). Please send me a copy of your CV if you meet every requirement and are interested to (url removed More ❯
My client is based in the London area are currently looking to recruit for an experienced AWS Databricks Data Architect to join their team. They are one of the leaders within the consulting space and are currently going through a period of growth and are looking for an experienced Data Architect to join their team. They are backed by … Gen AI within their organisation are looking to utilise the newest technologies on the market. Your role will include: Responsible for designing and implementing effective Architectural solutions around the AWS Severless Technologies (S3, Lambda, Athena, Kafka) and Databricks including Data Lake and Data Warehousing. Assess database implementation procedures to ensure they comply with GDPR and data compliance. Guide … landscape and solutions, for the short and long term, in collaboration with delivery and engineering teams. This is a hands on role which requires extensive exposure to cloud technologies (AWS and Azure). The right candidate will have extensive knowledge of writing codes, building data pipelines and doing digital transformation and ingestion a certain tech suite. Extensive experience in More ❯
analysis and a track record of translating complex data into clear business recommendations. Key job responsibilities - Design and implement modern data pipelines and business intelligence solutions - Configure and optimize AWS services including EC2, RDS, Redshift, Kinesis, EMR, and Lambda - Create scalable data architecture to support analytics, data science, and customer reporting needs - Collaborate with technology teams to develop … s competitive advantage. BASIC QUALIFICATIONS - 3+ years of data engineering experience - 4+ years of SQL experience - Experience with data modeling, warehousing and building ETL pipelines PREFERRED QUALIFICATIONS - Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions - Experience with non-relational databases/data stores (object storage, document or More ❯