London, England, United Kingdom Hybrid / WFH Options
RED Global
for skills in the following: Proven experience as an AWS Data SME or AWS Data Engineer , working extensively with AWS cloud services. Expertise in AWS Redshift, Glue, Lambda, Terraform, Kinesis, Athena, and EMR . Strong ETL/ELT development and data warehousing experience. Proficiency in Python, Java, or Scala for data processing and automation. In-depth knowledge of SQL … Apache Kafka, and Amazon RDS . Experience in data security, governance, and compliance best practices . Familiarity with CI/CD pipelines, DevOps methodologies, and monitoring/logging best practices . Strong problem-solving skills , with the ability to work in a collaborative and fast-paced environment . Preferred Qualifications: AWS Certified Data Analytics - Specialty or AWS Certified Solutions More ❯
development, infrastructure optimization, and deployment of scalable solutions for our programmatic advertising platform. What You'll Do Operate and evolve our big data stack on AWS (including MSK, EMR, Kinesis, Glue, and MWAA) Design, implement, and optimize ETL pipelines for large-scale data processing Collaborate with the Data Science team to prepare and manage datasets for model training and … activities: evaluating new tools, improving system performance, and ensuring scalability What We're Looking For Knowledge of AWS data services: MSK (Kafka: message broker), EMR (Spark/Flink), Glue, Kinesis, MWAA (Airflow) Basic understanding of cloud environments (preferably AWS) Basic experience with infrastructure-as-code tools (e.g., Terraform, AWS CDK, or CloudFormation) Strong interest in big data processing and More ❯
control with Git or SVN. Capable of presenting technical issues and successes to team members and Product Owners. Nice to Have Experience with any of these- Python, Spark, Kafka, Kinesis, Kinesis Analytics, BigQuery, Dataflow, BigTable, and SQL. Enthusiastic about learning and applying new technologies (growth mindset). Ability to build new solutions and support our data solutions/ More ❯
team members and Product Owners. Has experience of people management or desire to manage individuals on the team Nice to Have Experience with some of these- Python, Spark, Kafka, Kinesis, Kinesis Analytics, BigQuery, Dataflow, BigTable, and SQL. Enthusiastic about learning and applying new technologies (growth mindset). Ability to build new solutions and support our data solutions/ More ❯
gather requirements and build a roadmap. Develop and manage the engineering budget, ensuring cost-effectiveness and tracking expenditure. Utilize AWS, Terraform, CI/CD (GitHub Actions), Python, Java, Kafka, Kinesis, and Microservices. If you are interested, please get in touch. #J-18808-Ljbffr More ❯
as a Database Designer & Senior Data Engineer, with hands-on experience in cloud based data services. Proficiency in SQL, Python, or Scala. Experience with AWS RDS, AWS Glue, AWS Kinesis, AWS S3, Redis and/or Azure SQL Database, Azure Data Lake Storage, Azure Data Factory. Knowledge of data modelling, ETL processes, and data warehousing principles. Preferred Skills Strong More ❯
as a Database Designer & Senior Data Engineer, with hands-on experience in cloud based data services. Proficiency in SQL, Python, or Scala. Experience with AWS RDS, AWS Glue, AWS Kinesis, AWS S3, Redis and/or Azure SQL Database, Azure Data Lake Storage, Azure Data Factory. Knowledge of data modelling, ETL processes, and data warehousing principles. Preferred Skills Strong More ❯
complex and large-scale project management experience 5+ years of continuous integration and continuous delivery (CI/CD) experience 5+ years of database (e.g., SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) experience 5+ years of software development with object-oriented language experience 3+ years of cloud-based solution (AWS or equivalent), system, network, and operating system experience Bachelor's degree More ❯
systems Strong understanding of data modeling, ETL processes, and database design Demonstrated ability to architect solutions for big data challenges Preferred Qualifications Experience with real-time data processing (Kafka, Kinesis, Flink) Knowledge of containerization and infrastructure-as-code (Docker, Kubernetes, Terraform) Familiarity with MLOps practices and tools (MLflow, Kubeflow, etc.) Experience with data governance frameworks and data cataloging Understanding More ❯
as a Database Designer & Senior Data Engineer, with hands-on experience in cloud based data services. Proficiency in SQL, Python, or Scala. Experience with AWS RDS, AWS Glue, AWS Kinesis, AWS S3, Redis and/or Azure SQL Database, Azure Data Lake Storage , Azure Data Factory. Knowledge of data modelling , ETL processes, and data warehousing principles. Preferred Skills Strong More ❯
Unix Shell Scripting Desired Qualifications: Key Management Service, IAM, CloudWatch, CloudTrail, Config, S3, Artifact, Secrets Manager AWS security, identity and Compliance services Experience with other AWS Analytics services like Kinesis, MSK is a plus. Shift: 1st shift (United States of America) Hours Per Week More ❯
Proficiency in SQL and NoSQL databases. Design & Implementation: Experience with three or more of the following: Azure Synapse, Azure SQL DB, Cosmos DB, Mongo DB, Redshift, S3, Stream Analytics, Kinesis, Azure Data Factory, IoT Hub, Azure ML Studio, SageMaker Modelling, Azure Data Lake Gen2, HD Insight. Desirable Skills Experience in Fabric and Synapse is highly desirable Programming: Knowledge of More ❯
experience as a Data Engineer, with significant exposure to AWS environments Extensive knowledge of AWS services related to data and analytics such as AWS Glue, AWS Redshift, S3, Athena, Kinesis, and DynamoDB Extensive experience with data pipeline and workflow management tools High levels of proficiency in SWL and scripting languages such as Python Excellent problem-solving skills, attention to More ❯
would be a bonus Proven ability to ensure high standards of data quality, accuracy and completeness Proficient with GitHub for version control and collaboration Familiarity with AWS (S3, Glacier, Kinesis, Redshift), large datasets, Looker, and gaming industry Why join us There are many reasons to join us, but here are a few: We strongly believe we are changing how More ❯
systems Experience with BI/reporting engines or OLAP stores Deep Ruby/Rails & ActiveRecord expertise Exposure to ClickHouse/Redshift/BigQuery Event-driven or stream processing (Kafka, Kinesis) Familiarity with data-viz pipelines (we use Highcharts.js) AWS production experience (EC2, RDS, IAM, VPC) Contributions to OSS or tech-blog posts on performance What Success Looks Like More ❯
Knowledge of orchestration tooling (e.g., Airflow, Dagster, Azure Data Factory, Fivetran) Desirable: - Experience deploying AI/ML models in production environments - Familiarity with AWS data services (e.g., S3, Glue, Kinesis, Athena) - Exposure to real-time data streaming and analytics paradigms #LI-RJ1 Skills: Data Engineering Snowflake What you can expect from us: Together, as owners, let’s turn meaningful More ❯
OLAP stores Deep Ruby/Rails & ActiveRecord expertise Exposure to ClickHouse/Redshift/BigQuery Hands-on MySQL tuning (indexes, partitioning, query plans) Event-driven or stream processing (Kafka, Kinesis) Proven record scaling background-job frameworks (Sidekiq, Resque, Celery, etc.) Familiarity with data-viz pipelines (we use Highcharts.js) AWS production experience (EC2, RDS, IAM, VPC) Contributions to OSS or More ❯
systems Experience with BI/reporting engines or OLAP stores Deep Ruby/Rails & ActiveRecord expertise Exposure to ClickHouse/Redshift/BigQuery Event-driven or stream processing (Kafka, Kinesis) Familiarity with data-viz pipelines (we use Highcharts.js) AWS production experience (EC2, RDS, IAM, VPC) Contributions to OSS or tech-blog posts on performance What Success Looks Like More ❯
systems Experience with BI/reporting engines or OLAP stores Deep Ruby/Rails & ActiveRecord expertise Exposure to ClickHouse/Redshift/BigQuery Event-driven or stream processing (Kafka, Kinesis) Familiarity with data-viz pipelines (we use Highcharts.js) AWS production experience (EC2, RDS, IAM, VPC) Contributions to OSS or tech-blog posts on performance What Success Looks Like More ❯
systems Experience with BI/reporting engines or OLAP stores Deep Ruby/Rails & ActiveRecord expertise Exposure to ClickHouse/Redshift/BigQuery Event-driven or stream processing (Kafka, Kinesis) Familiarity with data-viz pipelines (we use Highcharts.js) AWS production experience (EC2, RDS, IAM, VPC) Contributions to OSS or tech-blog posts on performance What Success Looks Like More ❯
systems Experience with BI/reporting engines or OLAP stores Deep Ruby/Rails & ActiveRecord expertise Exposure to ClickHouse/Redshift/BigQuery Event-driven or stream processing (Kafka, Kinesis) Familiarity with data-viz pipelines (we use Highcharts.js) AWS production experience (EC2, RDS, IAM, VPC) Contributions to OSS or tech-blog posts on performance What Success Looks Like More ❯
systems Experience with BI/reporting engines or OLAP stores Deep Ruby/Rails & ActiveRecord expertise Exposure to ClickHouse/Redshift/BigQuery Event-driven or stream processing (Kafka, Kinesis) Familiarity with data-viz pipelines (we use Highcharts.js) AWS production experience (EC2, RDS, IAM, VPC) Contributions to OSS or tech-blog posts on performance What Success Looks Like More ❯
Manchester, England, United Kingdom Hybrid / WFH Options
Halton Housing
roadmaps with Cox Automotive’s pan-European growth goals and client needs. Data Platform: Oversee the architecture of our data lakehouse (Snowflake, Databricks) and real-time pipelines (Kafka, AWS Kinesis). Salesforce Integrations: Ensure seamless workflows across Financial Services Cloud, Marketing Cloud, and CPQ. Decision Engine: Prioritise AI/ML use cases (e.g., dynamic pricing, desirability scoring) and ensure More ❯
Leeds, England, United Kingdom Hybrid / WFH Options
Halton Housing
roadmaps with Cox Automotive’s pan-European growth goals and client needs. Data Platform: Oversee the architecture of our data lakehouse (Snowflake, Databricks) and real-time pipelines (Kafka, AWS Kinesis). Salesforce Integrations: Ensure seamless workflows across Financial Services Cloud, Marketing Cloud, and CPQ. Decision Engine: Prioritise AI/ML use cases (e.g., dynamic pricing, desirability scoring) and ensure More ❯
