Sr Data Engineer
- Hiring Organisation
- Response Informatics
- Location
- Salford, Greater Manchester, North West, United Kingdom
- Employment Type
- Contract
- Contract Rate
- Up to £320 per day
data pipelines using ADF and Databricks. Build and implement end-to-end metadata frameworks, ensuring scalability and reusability. Optimize data workflows leveraging SparkSQL and Pandas for large-scale data processing. Collaborate with cross-functional teams to integrate data solutions into enterprise architecture. Implement CI/CD pipelines for automated deployment … Technical Skills Required Azure Data Factory (ADF): Expertise in building and orchestrating data pipelines. Databricks: Hands-on experience with notebooks, clusters, and job scheduling. Pandas: Advanced data manipulation and transformation skills. SparkSQL: Strong knowledge of distributed data processing and query optimization. CI/CD: Experience with tools like Azure DevOps ...