role will primarily focus on building and maintaining data pipelines in DBT using SQL, with opportunities to get hands-on experience with Dagster, Synq, AWS, and Python. Key responsibilities Develop and maintain SQL-based data solutions (PostgreSQL/MySQL). Work with DBT for data transformation and modeling. Support … the scheduling and execution of data pipelines using Dagster. Assist in managing and optimizing AWS-lambda based data infrastructure. Collaborate with the team to identify opportunities to improve the overall data architecture and data pipelines within the Data Platform. Write and maintain Python scripts for data processing (bonus … role. Proficiency in SQL (PostgreSQL/MySQL). Experience with DBT for data transformation. Understanding of Dagster or similar workflow orchestration tools. Familiarity with AWS, Lambda, Python, Tableau, Metabase (nice to have, but not essential). Understanding of key concepts within data architecture. Strong analytical mindset and problem More ❯
resilient technical solutions. Drive the delivery of business value via change programs/projects within the futures & options clearing technology group Implement and manage AWS cloud services to support application infrastructure and deployment. Develop a strong understanding of key functions of clearing, margining & settlements within the F&O world. … JS etc. Good understanding of core Java (at least JDK 1.8) & prefer to have some experience with Spring Boot. Good to have experience using AWS cloud services (e.g., EC2, S3, Lambda, MSK, ECS, EMR, RDS, Athena etc. ) Experience working with Maven, Jenkins, Git etc. Understanding of database concepts More ❯
experience: Coding experience, preferably in Python, and the ability to write and understand complex MS SQL queries. Knowledge and experience of testing and using AWS technologies, including some of the following: Lambda, Glue, Step Functions, EventBridge, SNS, SQS, EC2, RDS, DynamoDB. Experience in building efficient integration tests as … part of AWS automated deployment pipelines using AWS services. Test framework design experience across multiple programs, with technical leadership in test framework development. Additional valued skills include: Proven ability to test enterprise-level software solutions using tools and techniques such as BDD, Data Reconciliation, Source Control, TDD, Jenkins. … Documenting configurations, processes, and best practices. Knowledge of file formats JSON, Iceberg, Avro. Basic knowledge of AWS technologies like IAM roles, Lakeformation, Security Groups, CloudFormation, Redshift. Big Data/Data Warehouse testing experience. Experience in the Financial services domain. Mentoring experience (not line management). This role will be More ❯
APIs, Kubernetes, Kafka, Cassandra, Elastic Search Experience with SDLC, CI/CD toolsets, Automation, standard IDEs Experience with Public Cloud & related Technologies (ECS, S3, Lambda, Elastic Search, MongoDB, Athena, Glue) Experience with Agile, Test-driven development. In-depth knowledge of various software architecture solution patterns Self-learner focused on More ❯
glasgow, central scotland, united kingdom Hybrid / WFH Options
Virgin Money
audience. Excellent hands-on technical skills to help the team and solve problems at hand. Extensive experience in designing, developing, and deploying solutions using AWS Telephony Framework primarily Amazon Connect , Lex, Lambda Integration, VoiceID, Contact Flows etc. Experience with shared cloud AWS services like EC2, VPC Subnet … skills but also a background to Solution/Architectural Design It’s a bonus if you have but not essential Knowledge and experience of AWS AI platform integrations and services such as SageMaker, Bedrock AWS Certification (Cloud Practioner/Solution Architect/Software Professional) It’s a bonus More ❯