Senior Data Engineer
- Hiring Organisation
- IO Associates
- Location
- London, United Kingdom
- Employment Type
- Contract
- Contract Rate
- £500 - £600 per day
sources (APIs, databases, financial data providers) into Azure Databricks . Optimise pipelines for performance, efficiency, and cost-effectiveness . Implement data quality checks and validation rules within pipelines. Data Transformation & Processing Implement complex transformations using Spark (PySpark or Scala) and related technologies. Develop logic for data cleaning, enrichment, and aggregation ...