2 of 2 Remote/Hybrid ETL Jobs in Colchester

months. It is also fully remote. Key Responsibilities • Design, develop, and maintain batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources ...

Real Time Monitoring and Predictive AI Key responsibilities: Design and maintain scalable data pipelines. Structure, transform, and optimize data in Snowflake. Implement multi-source ETL/ELT flows (ERP, APIs, files). Leverage the AWS environment, including S3, IAM, and various data services. Prepare data for Data Science teams and … services including S3, IAM, Glue, and Lambda. Languages: Advanced SQL and Python for data manipulation, automation, and ML integration. Data Engineering: Proven experience in ETL/ELT pipeline design. AI/ML Integration: Ability to prepare data for model training and deploy AI models into production workflows (batch or real ...