strong proficiency in SQL and PL/SQL, Oracle access control (roles, privileges, user management, and data security). Working knowledge of AWS core services, including S3, EC2/EMR, IAM, Athena, Glue or Redshift. Hands-on experience with Databricks Spark on large datasets, using PySpark, Scala, or SQL. Familiarity with Delta Lake, Unity Catalog or similar data lakehouse More ❯
Pytest and Postman. Expertise in Pandas, SQL, and AWS analytics services (Glue, Athena, Redshift) for data profiling, transformation, and validation within data lakes. Solid experience with AWS (S3, Lambda, EMR, ECS/EKS, CloudFormation/Terraform) and understanding of cloud-native architectures and best practices. Advanced skills in automating API and backend testing workflows, ensuring robust and reliable system More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Rise Technical Recruitment Limited
Experience in a data-focused SRE, Data Platform, or DevOps role*Strong knowledge of Apache Flink, Kafka, and Python in production environments*Hands-on AWS experience with AWS (Lambda, EMR, Step Functions, Redshift, etc.)*Comfortable with monitoring tools, distributed systems debugging, and incident response Reference Number: BBBH259303 To apply for this role or for to be considered for further More ❯
Data Engineer II, Amazon Last Mile - Routing and Planning - DE, Amazon Last Mile - Routing and Planning - DE As part of the Last Mile Science & Technology organization, you'll partner closely with Product Managers, Data Scientists, and Software Engineers to drive improvements in Amazon's Last Mile delivery network. You will leverage data and analytics … skills for this role. Key job responsibilities • Design, implement, and support data warehouse/data lake infrastructure using AWS big data stack, Python, Redshift, Quicksight, Glue/lake formation, EMR/Spark/Scala, Athena etc. • Extract huge volumes of structured and unstructured data from various sources (Relational/Non-relational/No-SQL database) and message streams and … business intelligence engineer, data scientist) with a track record of manipulating, processing, and extracting value from large datasets PREFERRED QUALIFICATIONS - Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions - Experience with non-relational databases/data stores (object storage, document or key-value stores, graph databases, column-family databases) - Experience More ❯
a production environment Commercial experience developing in a Scaled Agile environment Working knowledge of the technology stack Java/J2EE , Spring, RESTful APIs, Open Source software, AWS S3, Lambda, EMR/Spark, Knowledge and understanding of CICD processes Passion for learning Strong collaborator Physical and Cognitive Requirements The physical requirements described here are representative of those that must be More ❯
Coventry, Warwickshire, United Kingdom Hybrid / WFH Options
Sannik
from the model, with a focus on AWS S3 storage. • Collaborate with the development team to implement architectural changes and system tweaks. • Work with AWS services such as Lambda, EMR, and DynamoDB to optimize data management processes. • Utilize Spark for data processing and analysis tasks. • Ensure the integrity and security of data during the extraction and processing stages. • Troubleshoot … programming is essential. Strong understanding of cloud technologies, including AWS services such as S3, Lambda, and DynamoDB. Demonstrated experience with database management and backend development. Familiarity with tools like EMR and Spark for data processing. Ability to work independently and as part of a collaborative team. Excellent problem-solving and analytical skills. Prior experience in financial or mortgage industries More ❯
