7 of 7 ETL Jobs in Cambridgeshire

core database systems and data structures. Proficiency in Databricks and big data coding languages, including SQL, Python and Scala. Experience designing and deploying ETL/ELT pipelines using Azure Data Factory, Azure Synapse Analytics or equivalent tools in AWS/GCP. Strong engineering skills, with the ability to write clean ...

documenting requirements from non-technical users and translating them into effective technical solutions. Strong Excel skills and a sound understanding of data modelling and ETL processes. Knowledge of T-SQL and database management, together with proficiency in DAX and Power Query M. A quick learner, keen to develop across ...

silver/gold layer design) Data strategy and governance frameworks Data modeling and schema design for analytics workloads Modern data platform design and implementation ETL/ELT pipeline development and optimization (Glue, EMR) Data warehousing solutions (Redshift) Data catalog management and metadata governance Data quality and lineage frameworks Preferred Qualifications ...

data engineering foundation Hands-on experience with containerisation and orchestration (Docker, Kubernetes), and working with a major cloud provider Experience building data pipelines and ETL/ELT processes at scale, including web scraping or automated data collection A solid understanding of the ML lifecycle, from data through to model training ...

better use of modern Microsoft-based data and integration technologies. Design, develop and maintain automated data integrations between business applications. Build, support and optimise ETL/ELT processes and automated data pipelines. Develop automation solutions using APIs, scheduled processes and event-driven workflows. Monitor, troubleshoot and optimise data automation processes … years’ experience in Data Engineering, Integration Engineering, Automation Engineering or a similar role. Strong SQL Server and T-SQL skills. Experience developing ETL/ELT processes and data pipelines. Experience with APIs, integrations and data exchange technologies. Experience using Microsoft Azure services. Experience with Microsoft Fabric or similar cloud data ...

experience with both relational (e.g. PostgreSQL) and non-relational databases (e.g. Elasticsearch, Redis) Extensive experience in data warehousing architecture, big data processing and ETL Demonstrable expertise in Unix/Linux environments Experience with GIT and working in collaborative software environments Willingness to learn new skills as required by the project ...

agile practices and frequent updates. Design end-to-end data solutions: ingestion from collection systems and APIs, schema design and data storage, transformation/ETL, model training and evaluation, and operational delivery. Develop statistical and machine learning models for entity resolution, anomaly detection, classification, clustering, and pattern-of-life analysis … and unstructured sources Experience in Python and SQL or R, and with Pandas or NumPy, scikit-learn, and model evaluation or tuning Experience building ETL pipelines and querying APIs using tools such as Airflow or dbt, and Git-based version control Experience develop ing predictive models and quantitative analyses that ...