Senior Data Architect
Job Title: Data Architect-Technical
Job Location: London, UK
Job Type: Contract
The primary responsibilities are:
• Hands on Experience on design & architecture of the Data Platform, Technical components, and Data Engg. related activities for supporting the key capabilities
o Technical Data Architecture
o Data Ingestion framework ( Batch/ Micro Batch processing )
o Data Contract & Data management( including DQ, metadata & lineage)
o Delivery, Scaling & Op Model
• Discovery/ assessment along with the Data platform requirements
o Identify and document the relevant data sources to be used for collection & ingestion, cataloging , defining Data management. This includes assessing data quality, accessibility, data contract and lineage including any other potential capability evaluation
o Analyze existing Data pipeline and data workflows to determine the integration points and any design considerations/ framework and patterns for the data factory as per the need for TSA and Non-TSA batch business/ technical requirements for both batch and micro-batch processing.
• Define the E2E Data architecture framework
Required skills:
- Should have strong experience in AWS Data stack like S3/Lambda/Glue/Redshift etc.,
- Should be able to do Schema Management
- Good experience in Payment platform and ISO 20022.
- Strong experience on streaming and EDA tools like KAFKA and AWS MSK/Kinesis etc.,
- Good understanding of security aspects in terms of encryption, tokenisation, classification etc.,
- Should have strong data governance experience including ownership, retention, lineage, access controls etc.,
- Should be able to do performance profiling and do code reviews.
- Good experience in Logical and physical data modelling, normalisation, and design.
- Should have good understanding when to denormalize for queries; trade-offs between 3NF, Data Vault, and star schemas.
- Should do Command Query responsibility segregation.
- Good understanding of observability tools like Prometheus/Grafana/CloudWatch.
- Good hands-on experience with Scala/Python/SQL, IaC(Terraform), Glue/Spark, Lambda, CI/CD (Jenkins/Gitlab)
Nice to have skills:
- QuickSight/Tableau; Redshift tuning; ksqlDB/Flink; Aurora Postgres.
- Edge/API constraints (Apigee/API-GW), webhook patterns.