Senior Data Architect

Job Title: Data Architect-Technical

Job Location: London, UK

Job Type: Contract

The primary responsibilities are:

• Hands on Experience on design & architecture of the Data Platform, Technical components, and Data Engg. related activities for supporting the key capabilities

o Technical Data Architecture

o Data Ingestion framework ( Batch/ Micro Batch processing )

o Data Contract & Data management( including DQ, metadata & lineage)

o Delivery, Scaling & Op Model

• Discovery/ assessment along with the Data platform requirements

o Identify and document the relevant data sources to be used for collection & ingestion, cataloging , defining Data management. This includes assessing data quality, accessibility, data contract and lineage including any other potential capability evaluation

o Analyze existing Data pipeline and data workflows to determine the integration points and any design considerations/ framework and patterns for the data factory as per the need for TSA and Non-TSA batch business/ technical requirements for both batch and micro-batch processing.

• Define the E2E Data architecture framework

Required skills:

• Should have strong experience in AWS Data stack like S3/Lambda/Glue/Redshift etc.,
• Should be able to do Schema Management
• Good experience in Payment platform and ISO 20022.
• Strong experience on streaming and EDA tools like KAFKA and AWS MSK/Kinesis etc.,
• Good understanding of security aspects in terms of encryption, tokenisation, classification etc.,
• Should have strong data governance experience including ownership, retention, lineage, access controls etc.,
• Should be able to do performance profiling and do code reviews.
• Good experience in Logical and physical data modelling, normalisation, and design.
• Should have good understanding when to denormalize for queries; trade-offs between 3NF, Data Vault, and star schemas.
• Should do Command Query responsibility segregation.
• Good understanding of observability tools like Prometheus/Grafana/CloudWatch.
• Good hands-on experience with Scala/Python/SQL, IaC(Terraform), Glue/Spark, Lambda, CI/CD (Jenkins/Gitlab)

Nice to have skills:

- QuickSight/Tableau; Redshift tuning; ksqlDB/Flink; Aurora Postgres.

- Edge/API constraints (Apigee/API-GW), webhook patterns.