Data Engineer

Data Engineer  
Location: 70 Redcliff Street, BS1 6AL
Start Date: ASAP
Contract Duration: 3+ months
Working Hours: Mon – Fri, 09:00 – 17:00, 37 Hours per week
Pay Rate: £ 200.00 per day
Job Ref: (phone number removed)
 
Job Responsibilities

• Analyze and document existing data pipelines, including diagrams and data-flow mapping.

• Develop and automate ETL pipelines using Python.

• Work with Databricks notebooks, Delta Lake, and Databricks Genie bots.

• Design, optimize, and debug ETL pipelines.

• Use SQL for querying, validation, and optimization in the Lakehouse environment.

Person Specifications
Must Have

• Advanced skills in Python for ETL pipeline development.

• Strong experience with Databricks and related tools.

• Proven ability to design and optimize ETL pipelines.

• Strong SQL skills.

Nice to Have

• Experience with the West of England Combined Authority (WECA).

 
DISCLAIMER: By applying for this vacancy, you consent to your personal information being shared with our client and any relevant third parties we engage with, for the purpose of assessing your suitability specific organizations or hirers to whom you do not wish your details to be disclosed.