Principal Data Engineer
- Hiring Organisation
- Corecom Consulting
- Location
- Preston, Lancashire, UK
- Employment Type
- Full-time
will be doing • Defining and owning the technical strategy for the data platform across ingestion, processing, and analytics • Designing scalable, secure, and high performance architectures using Databricks and distributed data systems • Building and overseeing robust data ingestion pipelines using PySpark, with a strong focus on reliability and accuracy • Ensuring … expertise in PySpark and distributed data processing at scale • Strong hands on experience designing, building, and optimising Databricks based platforms • Advanced SQL skills including performance optimisation and schema design for analytical workloads • Experience working across Azure based data warehouses, with some exposure to AWS • Proven experience defining ...