into AWS data stores for both batch and streaming data ingestion. AWS Expertise: Utilize your expertise in AWS services such as AmazonEMR, S3, AWS Glue, Amazon Redshift, AWS Lambda, and more to build and optimize data solutions. Data Modeling: Design and implement data models … deliver high-quality data solutions. Automation: Implement automation processes and best practices to streamline data workflows and reduce manual interventions. Must have: AWS, ETL, EMR, GLUE, Spark/Scala, Java, Python. Good to have: Cloudera - Spark, Hive, Impala, HDFS, Informatica PowerCenter, Informatica DQ/DG, Snowflake Erwin. Qualifications: Bachelor More ❯
implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda AWS S3 AWS Redshift AWS EMR). Develop and maintain data quality checks data validation rules and data lineage documentation. Collaborate with data analysts data scientists business stakeholders and product More ❯
Milton Keynes, Buckinghamshire, United Kingdom Hybrid / WFH Options
Banco Santander SA
Previous experience developing, testing, and deploying data pipelines, data lakes, data warehouses, and data marts using ideally AWS services such as S3, Glue, Athena, EMR, Kinesis, and Lambda. Experience of major operating platforms and their linkage, connectivity functions and issues. Cloud Security - Experience/skills of addressing concept issues More ❯
Northampton, Northamptonshire, East Midlands, United Kingdom Hybrid / WFH Options
Data Inc. (UK) Ltd
for Search: When reviewing CVs, please look for relevant technologies such as: Spark, Hadoop, Big Data, Scala, Spark-Scala, Data Engineer, ETL, AWS (S3, EMR, Glue ETL) . Interview Process: the client will conduct an interview round that includes a Scala coding exercise . The candidate will be expected More ❯
SQL queries and good understanding of data model, python knowledge is a plus. Working knowledge in AWS cloud (EC2, ECS, Load Balancer, Security Group, EMR, Lambda, S3, Glue, etc.) Experience in DevOps development and deployment using ontainer platforms About S&P Global Ratings At S&P Global Ratings, our More ❯
Altrincham, Cheshire, United Kingdom Hybrid / WFH Options
INRIX, Inc
Familiarity one or more of the following would also be beneficial : Scala AWS services like Kinesis, RDS, Elasticache, S3, Athena, Data pipeline, Glue, Lambda, EMR, Spark, EC2, ECS, CloudWatch or Elastic Beanstalk Jenkins or similar tools would also be a plus A team player - we highly regard collaboration. Knowledge More ❯
Proficiency in coding one or more languages such as Java, Python or PySpark Experience in Cloud implementation with AWS Data Services, Glue ETL (or) EMR, S3, Glue Catalog, Athena, Lambda, Step Functions, Event Bridge, ECS, Data De/Serialization, Parquet, JSON format, IAM Services, Encryption, KMS, Secrets Manager. Practical More ❯
NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with AWS cloud services: EC2, EMR, RDS, Redshift. Experience with stream-processing systems: Storm, Spark-Streaming, etc. Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala More ❯
of an Agile engineering or development team. Strong hands-on experience and understanding of working in a cloud environment such as AWS. Experience with EMR (Elastic Map Reduce), Spark. Strong experience with CI/CD pipelines with Jenkins. Experience with the following technologies: SpringBoot, Gradle, Terraform, Ansible, GitHub/ More ❯
years of experience in scaling SaaS services and infrastructure Goal-driven, positive attitude with strong communication skills Proficient in AWS services, including EC2, RDS, EMR, VPC networking, S3, etc. Comfortable with one or more of: Python, Ruby, Java, Groovy, Bash Working knowledge with one or more of: Terraform, Ansible More ❯
for customer data Implement least access principle Ensure reliability and security of microservices Skills and Requirements Proficiency in AWS services, such as EC2, RDS, EMR, VPC networking, S3, etc. Experience with programming languages like Python, Ruby, Java, Groovy, and Bash Familiarity with infrastructure as code tools like Terraform and More ❯
and analyze business requirements to develop scalable and efficient data solutions on AWS. Design and implement data pipelines using various AWS services such as EMR, Glue, Kinesis, and Redshift. Develop data models and ETL processes to efficiently transform and load data into AWS data lakes and data warehouses. Work … environment. Strong proficiency in SQL and experience with designing and maintaining data warehouses and data lakes. In-depth knowledge of AWS services such as EMR, Glue, Kinesis, and Redshift. Hands-on experience with data pipeline development, ETL processes, and data modeling on AWS. Strong leadership and project management skills More ❯
Trafford Park, Trafford, Greater Manchester, United Kingdom Hybrid / WFH Options
ISR RECRUITMENT LIMITED
AWS Data Engineer Old Trafford/Trafford Park, Manchester (Hybrid-Working) c£80,000 per year Plus excellent company benefits and rewards package The Opportunity: Are you passionate about data and problem-solving? We're looking for a skilled Data More ❯
Employment Type: Permanent
Salary: £75000 - £85000/annum (plus excellent company benefits)
trafford park, north west england, united kingdom Hybrid / WFH Options
ISR Recruitment
AWS Data Engineer Old Trafford/Trafford Park, Manchester (Hybrid-Working) c£80,000 per year Plus excellent company benefits and rewards package The Opportunity: Are you passionate about data and problem-solving? We're looking for a skilled Data More ❯
Reading, Berkshire, South East, United Kingdom Hybrid / WFH Options
TM Group (UK) Limited
governance, quality frameworks, and lifecycle management is second to none, and you're comfortable working with modern data platforms such as AmazonEMR, Glue, Databricks, DBT, Power BI or RStudio. Communication is your superpower whether you're presenting to the board or collaborating with IT, you know More ❯
Required Qualifications In computer science, engineering, analytics, mathematics, statistics, IT, or equivalent. Familiarity and comfort with Python, SQL, Docker, and Shell scripting. Java preferred but not necessary. Preferred Qualifications Experience with AWS technologies like Redshift and extracting value from large More ❯
manage development projects through the full project lifecycle, with a specific focus on ETL/data storage (data lake/warehouse) in an Amazon Web Service environment. This is a great opportunity for a technology-aware individual to lead a team of developers working on market-leading technologies … in a structured manner, and present technical concepts in easy-to-understand terms for business stakeholders. Experience working on cloud platforms, preferably AWS, S3, EMR Glue, Postgres, and Snowflake. What you'll get for this role: Starting salary £60,000 (depending on location, skills, experience, and qualifications) Bonus opportunity More ❯