in implementing cloud based data solutions using AWS services such as EC2, S3, EKS, Lambda, API Gateway, Glue and bid data tools like Spark, EMR, Hadoop etc. Hands on experience on data profiling, data modeling and data engineering using relational databases like Snowflake, Oracle, SQL Server; ETL tools like More ❯
Milton Keynes, Buckinghamshire, United Kingdom Hybrid / WFH Options
Banco Santander SA
Previous experience developing, testing, and deploying data pipelines, data lakes, data warehouses, and data marts using ideally AWS services such as S3, Glue, Athena, EMR, Kinesis, and Lambda. Experience of major operating platforms and their linkage, connectivity functions and issues. Cloud Security - Experience/skills of addressing concept issues More ❯
East London, London, United Kingdom Hybrid / WFH Options
Asset Resourcing
and database management systems (e.g., MySQL, PostgreSQL, MongoDB). Hands-on experience with AWS services for data processing, storage and analysis (e.g., S3, Redshift, EMR, Glue). Familiarity with programming languages such as Python or Java. Understanding of data warehousing concepts and data modeling techniques. Experience working with big More ❯
and database management systems (e.g., MySQL, PostgreSQL, MongoDB). Hands-on experience with AWS services for data processing, storage and analysis (e.g., S3, Redshift, EMR, Glue). Familiarity with programming languages such as Python or Java. Understanding of data warehousing concepts and data modeling techniques. Experience working with big More ❯
Northampton, Northamptonshire, East Midlands, United Kingdom Hybrid / WFH Options
Data Inc. (UK) Ltd
for Search: When reviewing CVs, please look for relevant technologies such as: Spark, Hadoop, Big Data, Scala, Spark-Scala, Data Engineer, ETL, AWS (S3, EMR, Glue ETL) . Interview Process: the client will conduct an interview round that includes a Scala coding exercise . The candidate will be expected More ❯
with one or more of the following would also be beneficial: Scala AWS services like Kinesis, RDS, Elasticache, S3, Athena, Data pipeline, Glue, Lambda, EMR, Spark, EC2, ECS, CloudWatch or Elastic Beanstalk Jenkins or similar tools would also be a plus. A team player - we highly regard collaboration. Knowledge More ❯
Altrincham, Cheshire, United Kingdom Hybrid / WFH Options
INRIX, Inc
Familiarity one or more of the following would also be beneficial : Scala AWS services like Kinesis, RDS, Elasticache, S3, Athena, Data pipeline, Glue, Lambda, EMR, Spark, EC2, ECS, CloudWatch or Elastic Beanstalk Jenkins or similar tools would also be a plus A team player - we highly regard collaboration. Knowledge More ❯
Central London, London, United Kingdom Hybrid / WFH Options
167 Solutions Ltd
and lakehouse solutions for analytics, reporting, and machine learning. Implement ETL/ELT processes using tools such as Apache Airflow, AWS Glue, and Amazon Athena . Work with cloud-native technologies to support scalable, serverless architectures. Collaborate with data science teams to streamline feature engineering and model deployment. More ❯
Kafka and Kinesis DataHub ML Flow and Airflow Docker and Terraform Kafka, Spark, Kafka Streams and KSQL DBT AWS, S3, Iceberg, Parquet, Glue and EMR for our Data Lake Elasticsearch and DynamoDB More information: Enjoy fantastic perks like private healthcare & dental insurance, a generous work from abroad policy More ❯
and Airflow. Experience with CI/CD and infrastructure-as-code, ideally within AWS cloud. Also desirable - familiarity with AWS' data tools such as EMR, MWAA, MSK. You are Someone who loves collaboration - our teams are cross functional and you'll be working with other engineers, team leads and More ❯
Chantilly, Virginia, United States Hybrid / WFH Options
The DarkStar Group
databases, and services. Cloud infrastructure is deployed using AWS C2S available services in the IDL VPC boundaries. Commonly used AWS tools include Managed OpenSearch, EMR, EC2, Lambdas, etc. Microservices and Kubernetes container orchestration is used to deploy applications in a managed way Working with the ISSM and various networking More ❯
Arlington, Virginia, United States Hybrid / WFH Options
Amazon
DESCRIPTION The Amazon Web Services Professional Services (ProServe) team is seeking a skilled Delivery Consultant to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS solutions that meet their technical requirements … experience - 3+ years of experience with data warehouse architecture, ETL/ELT tools, data engineering, and large-scale data manipulation using technologies like Spark, EMR, Hive, Kafka, and Redshift - Experience with relational databases, SQL, and performance tuning, as well as software engineering best practices for the development lifecycle, including … with large datasets and extracting value from them - Experience leading large-scale data engineering and analytics projects using AWS technologies like Redshift, S3, Glue, EMR, Kinesis, Firehose, and Lambda, as well as experience with non-relational databases and implementing data governance solutions Amazon is an equal opportunity More ❯
opportunities for leveraging AWS services and implement effective metrics and monitoring processes. Your Skills and Experience Experience of AWS tools (e.g. Athena, Redshift, Glue, EMR), Java, Scala, Python, Spark. Experience of developing enterprise grade ETL/ELT data pipelines and demonstrable knowledge of applying Data Engineering best practices (coding … practices to DS, unit testing, version control, code review). Big Data Eco-Systems, Cloudera/Hortonworks, AWS EMR, GCP DataProc or GCP Cloud Data Fusion. Streaming technologies and processing engines, Kinesis, Kafka, Pub/Sub and Spark Streaming. Experience of working with CI/CD technologies, Git, Jenkins More ❯
Trafford Park, Trafford, Greater Manchester, United Kingdom Hybrid / WFH Options
ISR RECRUITMENT LIMITED
AWS Data Engineer Old Trafford/Trafford Park, Manchester (Hybrid-Working) c£80,000 per year Plus excellent company benefits and rewards package The Opportunity: Are you passionate about data and problem-solving? We're looking for a skilled Data More ❯
Employment Type: Permanent
Salary: £75000 - £85000/annum (plus excellent company benefits)
Reading, Berkshire, South East, United Kingdom Hybrid / WFH Options
TM Group (UK) Limited
governance, quality frameworks, and lifecycle management is second to none, and you're comfortable working with modern data platforms such as AmazonEMR, Glue, Databricks, DBT, Power BI or RStudio. Communication is your superpower whether you're presenting to the board or collaborating with IT, you know More ❯
Leeds, West Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Skills for Care
Pydeequ for data quality testing Circle CI for deployment Amazon Athena for querying data Hosted on AWS, using S3, Glue, Step functions, EMR, and Athena Terraform for Infrastructure as Code Our code is open source and we use Git and GitHub for source control If you are More ❯
for good. Responsibilities: Analyse source data from source databases (PostgreSQL) to understand structures, relationships and semantics. Design and implement streaming data pipelines using AWS EMR and PySpark to generate real-time (fast-moving) features for the feature store. Develop and maintain batch processing pipelines using DBT and BigQuery to … KSQL or similar) for developing data transformation pipelines. Solid understanding and practical experience with SQL and relational databases (PostgreSQL preferred). Proficiency with AWS EMR for running and managing Spark workloads. Experience in SQL-based transformation workflows, particularly using DBT in BigQuery. Experience with Terraform to define and manage More ❯