High volume NoSQL and SQL databases such as; Dynamo DB, Postgres Terraform built environments Experience working with data and infrastructure at scale Event driven architecture such as Kafka/Kinesis Our standards around security, quality, and service availability can only be the highest, but at the same time we foster psychological safety, as we are comfortable with the unknowns More ❯
career development opportunities Ability to evangelize next-generation infrastructure in analytics space (batch, near real-time, real-time technologies), using both SAS components and AWS tooling (e.g., Redshift, SQS, Kinesis) Strong familiarity with spatial-temporal data sets, with exposure to maritime data preferred Experienced in evaluating, training, and communicating the performance of ML models (e.g., supervised models, such as More ❯
platforms (AWS, GCP, or Azure) • Experience with: o Data warehousing and lake architectures o ETL/ELT pipeline development o SQL and NoSQL databases o Distributed computing frameworks (Spark, Kinesis etc) o Software development best practices including CI/CD, TDD and version control. o Containerisation tools like Docker or Kubernetes o Experience with Infrastructure as Code tools (e.g. More ❯
with Data Science to deploy ML workloads in streaming systems Influence architecture and own key infrastructure components Key Skills: Five years with TypeScript and AWS Strong experience with Lambda, Kinesis, EventBridge, and CDK v2 Strong attention to detail and ability to work independently Python experience Familiarity with JIRA and Confluence Hybrid – 2 days a week in Central London More ❯
with cross-functional teams to deliver scalable solutions Mentoring junior engineers and contributing to a strong engineering culture Working with a modern, cloud-native stack Cloud: AWS (Lambda, S3, Kinesis, RDS, Step Functions, AppFlow) Monitoring: Graphite, Grafana, Splunk Bonus: Experience in marketing tech or AI What We're Looking For Strong full stack engineering experience Comfortable working without front More ❯
mean you can move into a technical leadership role as quickly as possible propelling product roadmap and R&D pipeline forward. Skills Typescript expert with AWS including AWS Lambda, Kinesis and EventBridge. AWS CDK2 Python knowledge Confluence and JIRA Role The Senior Backend Software Engineer will join an existing software team reporting to the Chief Technology Officer. Working on More ❯
successes to team members and Product Owners. Has experience of people management or desire to manage individuals on the team Nice to Have Experience with some of these- Kafka, Kinesis, Kinesis Analytics, Glue, Lambda, Kubernetes, ETL pipelines, BigQuery, Dataflow, BigTable, and SQL Enthusiastic about learning and applying new technologies (growth mindset). Ability to build new solutions and More ❯
Central London, Oxford Circus, Greater London, United Kingdom
Expert Employment
mean you can move into a technical leadership role as quickly as possible propelling product roadmap and R&D pipeline forward. Skills Typescript expert with AWS including AWS Lambda, Kinesis and EventBridge. AWS CDK2 Python knowledge Confluence and JIRA Role The Senior Backend Software Engineer will join an existing software team reporting to the Chief Technology Officer. Working on More ❯
event structures, attribution, retention, LTV , and other mobile metrics . Ability to collect and aggregate user data from mobile sources for analytics. Experience building real-time data pipelines (e.g., Kinesis, Kafka, Spark Streaming ). Hands-on CI/CD experience with GitHub . Startup or small team experience - the ability to quickly switch between tasks , suggest lean architectural solutions More ❯
scalable, and high-availability architectures. Solid understanding of networking, security, authentication, and authorization (OAuth, JWT, OpenID Connect, IAM roles, etc.). Familiarity with big data technologies, streaming platforms like Kinesis, and data lake architectures. Proficiency in C#, Python, or Node.js for backend development and scripting. Strong problem-solving, analytical, and communication skills. AWS certification (e.g., AWS Certified Solutions Architect More ❯
AWS Data Engineer London, UK Permanent Strong experience in Python, PySpark, AWS S3, AWS Glue, Databricks, Amazon Redshift, DynamoDB, CI/CD and Terraform. Total 7 + years of experience in Data engineering is required. Design, develop, and optimize ETL pipelines using AWS Glue, Amazon EMR and Kinesis for real-time and batch data processing. Implement data … transformation, streaming, and storage solutions on AWS, ensuring scalability and performance. Collaborate with cross-functional teams to integrate and manage data workflows. Skill-set Amazon Redshift, S3, AWS Glue, Amazon EMR, Kinesis Analytics Ensure data security, compliance, and best practices in cloud data engineering Experience with programming languages such as Python, Java, or Scala. More ❯
Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with: Data warehousing and lake architectures ETL/ELT pipeline development SQL and NoSQL databases Distributed computing frameworks (Spark, Kinesis etc) Software development best practices including CI/CD, TDD and version control. Strong understanding of data modelling and system architecture Excellent problem-solving and analytical skills Whilst having More ❯
languages Proven experience building and operating scalable distributed systems and services within AWS cloud infrastructure or similar technologies. Designed and implemented distributed, event-driven systems using Kafka Streams, AWS Kinesis, or similar. Optimize for low-latency and high-throughput processing (1M+ TPS) microservices. Implemented auto-scaling , blue-green deployments , and canary releases andBuild and maintain SLAs, SLOs, and SLIs More ❯
may be a fit if you have: Expertise in Cloud-Native Data Engineering: 3+ years building and running data pipelines in AWS or Azure, including managed data services (e.g., Kinesis, EMR/Databricks, Redshift, Glue, Azure Data Lake). Programming Mastery: Advanced skills in Python or another major language; writing clean, testable, production-grade ETL code at scale. Modern More ❯
balancing technical excellence with business priorities and constraints Nice to have Experience building Data Mesh or Data Lake architectures. Familiarity with Kubernetes, Docker, and real-time streaming (e.g. Kafka, Kinesis). Exposure to ML engineering pipelines or MLOps frameworks. What's it like to work at Zego? Joining Zego is a career-defining move. People go further here, reaching More ❯
balancing technical excellence with business priorities and constraints Nice to have Experience building Data Mesh or Data Lake architectures. Familiarity with Kubernetes, Docker, and real-time streaming (e.g. Kafka, Kinesis). Exposure to ML engineering pipelines or MLOps frameworks. Whats it like to work at Zego? Joining Zego is a career-defining move. People go further here, reaching their More ❯
Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with: Data warehousing and lake architectures ETL/ELT pipeline development SQL and NoSQL databases Distributed computing frameworks (Spark, Kinesis etc) Software development best practices including CI/CD, TDD and version control. Strong understanding of data modelling and system architecture Excellent problem-solving and analytical skills Whilst having More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Harnham - Data & Analytics Recruitment
assets Strong architectural acumen and software engineering fundamentals Experience driving adoption of data governance and improving data platform usage across internal teams stack including: Snowflake AWS DBT Airflow Python Kinesis Terraform CI/CD tools BENEFITS The successful Principal Data Engineer will receive the following benefits: Salary up to £107,000 Hybrid working: 2 days per week in the More ❯
Manchester, Lancashire, United Kingdom Hybrid / WFH Options
Parking Network BV
data engineering professional with a proven ability to lead and inspire teams. You bring deep technical skills in Python, SQL, and AWS services such as EC2, Redshift, Lambda and Kinesis, alongside strong stakeholder management and commercial awareness. You'll also bring: Proven experience designing and implementing data pipelines, ETL processes, and warehousing in cloud environments. The ability to manage More ❯
side programming language Experience with microservices architecture and distributed systems Strong understanding of data storage technologies (MySQL, Hadoop, Cassandra) Familiarity with AWS services such as RDS, Step Functions and Kinesis (preferred) Experience with unit, integration and end-to-end testing frameworks Ability to define and monitor SLOs/KPIs and contribute to architecture design Exposure to regulatory processes or More ❯
as a Database Designer & Senior Data Engineer, with hands-on experience in cloud based data services. Proficiency in SQL, Python, or Scala. Experience with AWS RDS, AWS Glue, AWS Kinesis, AWS S3, Redis and/or Azure SQL Database, Azure Data Lake Storage , Azure Data Factory. Knowledge of data modelling , ETL processes, and data warehousing principles. Preferred Skills Strong More ❯
Knowledge of orchestration tooling (e.g., Airflow, Dagster, Azure Data Factory, Fivetran) Desirable: - Experience deploying AI/ML models in production environments - Familiarity with AWS data services (e.g., S3, Glue, Kinesis, Athena) - Exposure to real-time data streaming and analytics paradigms #LI-RJ1 Together, as owners, let's turn meaningful insights into action. Life at CGI is rooted in ownership More ❯
the Data Platform by designing and building the next generation of the stack. Develop, run and support our batch and real-time data pipelines using tools like Airflow, PlanetScale, Kinesis, Snowflake, Tableau, all in AWS. Collaborate with product managers, data engineers, analysts and data scientists to develop tooling and infrastructure to support their needs. Develop automation and tooling to More ❯
CI/CD pipelines with tools like Jenkins or CircleCI Knowledge of data security protocols and distributed system design Bonus Points For Experience with messaging systems (Kafka, Spark Streaming, Kinesis) Familiarity with schema design and semi-structured data formats Exposure to containerisation, graph databases, or machine learning concepts Proficiency with cloud-native data tools (BigQuery, Redshift, Snowflake) Enthusiasm for More ❯
ODS or DWH. Experience in integrating data analytical outcomes and key information into clinical workflows. Desired skills Knowledge of streaming data architectures and technologies (e.g., Kafka, Azure Event Hubs, Kinesis). Knowledge of handing Genome datasets (FASTQ, VCF etc.) and document formats (IHE). General experience working with Gen AI including LLM generated clinical data/summaries Experience Extensive More ❯