Big Data Engineer
London Area, United Kingdom
Thrive IT Systems Ltd
Extensive experience working with large data sets with hands on technology skills to design and build robust Big Data solutions using Spark PySpark framework and Industry standard frameworks like Databricks Azure DevOps and other tools technologies on Azure Cloud Platform Key Roles and Responsibilities Understand the requirement … and analyze the source system data to come up with a high performance Data Architecture Good to have the Retail functional Knowledge Must have Good Knowledge and Hands on experience in Python PySpark ADF and ADB Good to have Knowledge in ADF CI CD Experience in designing architecting … and implementing large scale data processing data storage data distribution systems Ability to produce high quality work products under pressure and within deadlines Strong understanding of Big Data Analytics platforms and ETL in the context of Big Data Ability to frame architectural decisions more »
Posted: