Data Engineer
Data Engineer | Outside IR35 | £450 - £500 | 6 months | Hybrid London We’re supporting a company who are looking for a Data Engineer to build and enhance the data processing capabilities within their Databricks environment. You’ll be responsible for developing the code that drives their data pipelines, using Python, Spark, and Databricks Workflows to deliver new platform functionality and ensure efficient execution.Key Responsibilities
- Develop reliable Python and PySpark code to support data ingestion, transformation, and end-to-end processing.
- Deliver new technical features and components aligned to approved solution designs and business requirements.
- Enhance, extend, and tune existing data frameworks to support additional use cases and improved performance.
- Create, manage, and optimise Databricks Workflows, including orchestration logic and operational behaviours.
- Carry out testing, performance tuning, and provide day-to-day operational support for data pipelines.
- Work closely with Solution Designers / Architects and Configuration Analysts to ensure consistent and effective delivery.