strong understanding of AWS deployment and management. Overall knowledge of the Software Development Life Cycle. Proficient in Data Lake and Data Mesh architectures, and performance optimization using client/server-side caching. Solid understanding of agile methodologies such as CI/CD, Application Resiliency, and Security. Proficient with modern More ❯
Interact with upstream and downstream systems and API for data ingestion and egestion. • Build ETL pipelines and data framework for monitoring the pipeline. • Ensure performance, quality, and consistency in the data and processes. • Champion good data design practices and promote data quality. • Collaborate and contribute with data architecture, DBA … required. • Any other tasks as required. You will be experienced working with the Azure data stack, building data pipelines, data warehouses/lakes, and performance optimization. You will have strong experience in: • Microsoft Azure data stack and SQL server, ETL; SSIS and Data Factory. • Stack design and performanceMore ❯
areas like cloud, AI, machine learning, or mobile platforms. Ability to solve data-oriented problems using technologies like SQL, Relational DB, Spark, NoSQL, with performance optimization. Preferred qualifications, capabilities, and skills Experience with Spark performance tuning on large datasets. Experience delivering production changes using Scala and Spark. About More ❯
