Business Intelligence - Data Engineer
Business Intelligence - Data EngineerExperience working with SEI frameworks and Data Delivery to various firms using Snowflake, Airflow, Azure Data Factory and Microsoft Azure.Day to Day job Duties: (what this person will do on a daily/weekly basis)Work closely with client stakeholders to understand business needs, translate them into technical specifications, and align deliverables with project goals.Participate in daily stand-ups, sprint planning, and review meetings to ensure continuous communication and progress tracking.Design, build, and optimize scalable data pipelines using Azure Data Factory and Apache Airflow for scheduling and orchestration.Implement efficient data ingestion, transformation, and movement processes from various sources into Snowflake Data Warehouse.Develop reusable components and templates to accelerate delivery of data pipelines.Create and maintain database objects (tables, views, stored procedures, stages, file formats, etc.) in Snowflake DW.Write complex SQL queries for data processing, validation, and reporting.Optimize data models, queries, and storage for performance and cost efficiency.Use GitLab for source code management, branching strategies, and version control.Support CI/CD pipelines for automated testing, deployment, and monitoring of data workflows.engagementsBasic Qualifications: (what are the skills required to this job with minimum years of experience on each)Proven hands-on expertise working with SEI’s processes, tools, and compliance standards in delivering high-quality solutions.Proven experience in building and maintaining data pipelines and workflows.Strong knowledge of Azure Data Factory for data movement and transformation.Proficiency with Apache Airflow (orchestration, scheduling, DAGs, error handling). 5+ Years experience in Data Engineering using Azure Data Factory, Snowflake and AirflowTravel:There could be a chance to travel to SEI’s client sites if required in UK.Degree: Bachelors in Computer Science or equivalent work experienceNice to Have; (But not a must)Data Modeling & designBusiness Intelligence - Data EngineerExperience working with SEI frameworks and Data Delivery to various firms using Snowflake, Airflow, Azure Data Factory and Microsoft Azure.Day to Day job Duties: (what this person will do on a daily/weekly basis)Work closely with client stakeholders to understand business needs, translate them into technical specifications, and align deliverables with project goals.Participate in daily stand-ups, sprint planning, and review meetings to ensure continuous communication and progress tracking.Design, build, and optimize scalable data pipelines using Azure Data Factory and Apache Airflow for scheduling and orchestration.Implement efficient data ingestion, transformation, and movement processes from various sources into Snowflake Data Warehouse.Develop reusable components and templates to accelerate delivery of data pipelines.Create and maintain database objects (tables, views, stored procedures, stages, file formats, etc.) in Snowflake DW.Write complex SQL queries for data processing, validation, and reporting.Optimize data models, queries, and storage for performance and cost efficiency.Use GitLab for source code management, branching strategies, and version control.Support CI/CD pipelines for automated testing, deployment, and monitoring of data workflows.engagementsBasic Qualifications: (what are the skills required to this job with minimum years of experience on each)Proven hands-on expertise working with SEI’s processes, tools, and compliance standards in delivering high-quality solutions.Proven experience in building and maintaining data pipelines and workflows.Strong knowledge of Azure Data Factory for data movement and transformation.Proficiency with Apache Airflow (orchestration, scheduling, DAGs, error handling). 5+ Years experience in Data Engineering using Azure Data Factory, Snowflake and AirflowTravel:There could be a chance to travel to SEI’s client sites if required in UK.Degree: Bachelors in Computer Science or equivalent work experienceNice to Have; (But not a must)Data Modeling & designBusiness Intelligence - Data EngineerExperience working with SEI frameworks and Data Delivery to various firms using Snowflake, Airflow, Azure Data Factory and Microsoft Azure.Day to Day job Duties: (what this person will do on a daily/weekly basis)Work closely with client stakeholders to understand business needs, translate them into technical specifications, and align deliverables with project goals.Participate in daily stand-ups, sprint planning, and review meetings to ensure continuous communication and progress tracking.Design, build, and optimize scalable data pipelines using Azure Data Factory and Apache Airflow for scheduling and orchestration.Implement efficient data ingestion, transformation, and movement processes from various sources into Snowflake Data Warehouse.Develop reusable components and templates to accelerate delivery of data pipelines.Create and maintain database objects (tables, views, stored procedures, stages, file formats, etc.) in Snowflake DW.Write complex SQL queries for data processing, validation, and reporting.Optimize data models, queries, and storage for performance and cost efficiency.Use GitLab for source code management, branching strategies, and version control.Support CI/CD pipelines for automated testing, deployment, and monitoring of data workflows.engagementsBasic Qualifications: (what are the skills required to this job with minimum years of experience on each)Proven hands-on expertise working with SEI’s processes, tools, and compliance standards in delivering high-quality solutions.Proven experience in building and maintaining data pipelines and workflows.Strong knowledge of Azure Data Factory for data movement and transformation.Proficiency with Apache Airflow (orchestration, scheduling, DAGs, error handling). 5+ Years experience in Data Engineering using Azure Data Factory, Snowflake and AirflowTravel:There could be a chance to travel to SEI’s client sites if required in UK.Degree: Bachelors in Computer Science or equivalent work experienceNice to Have; (But not a must)Data Modeling & designPosting Date:Department:ADM - Emerging Technologies - IB - 1005752071