Data Engineer
The Company NW Tech are delighted to be working with a rapidly expanding professional services organisation in their search for a Data Engineer. The Role Key responsibilities include:
- Design, build and maintain scalable data pipelines to ingest, process and transform structured and unstructured data from diverse sources.
- Ensure the data platform is fully documented, maintaining up-to-date information requirements, data models, data dictionaries, and ETL mappings.
- Collaborate with cross-functional teams, including system administrators, developers / engineers, external partners, and business stakeholders, to understand requirements and deliver solutions.
- Optimise solutions for performance, reliability, and scalability, ensuring efficient data processing and storage.
- Implement and manage orchestration workflows to automate data pipeline scheduling monitoring and error handling.
- Ideally experienced as a Data Engineer with hands-on experience designing and delivering data pipelines using industry-standard tools and cloud technologies.
- Knowledge of data engineering concepts, data pipeline development, ETL processes, data lake and data warehousing technologies.
- Proficiency in working with at least one major cloud data platform
- Proficiency in Python for data engineering tasks (e.g. pipeline scripting, data transformation, automation)
- Good knowledge of relational database technologies and concepts