Senior Data Engineer
paisley, central scotland, united kingdom
Hybrid / WFH Options
Hybrid / WFH Options
Infoplus Technologies UK Limited
Job Title: Senior Data Engineer · Location: Glasgow, UK (Hybrid, 3 days onsite) · Duration: 6 months (Inside IR35) Job Description: ## Mandate skills required: Pyspark Python SQL Snowflake Role Responsibilities You will be responsible for: • Collaborating with cross-functional teams to understand data requirements, and design efficient, scalable, and reliable ETL processes using Python and DataBricks • Developing … and deploying ETL jobs that extract data from various sources, transforming it to meet business needs. • Taking ownership of the end-to-end engineering lifecycle, including data extraction, cleansing, transformation, and loading, ensuring accuracy and consistency. • Creating and manage data pipelines, ensuring proper error handling, monitoring and performance optimizations • Working in an agile environment, participating in sprint … to streamline repetitive tasks. • Implementing unit, integration, and other testing methodologies to ensure the reliability of the ETL processes • Utilizing REST APls and other integration techniques to connect various data sources • Maintaining documentation, including data flow diagrams, technical specifications, and processes. You Have: • Proficiency in Python programming, including experience in writing efficient and maintainable code. • Hands-on experience More ❯
Posted: