9 of 9 ETL Jobs in Cambridgeshire

core database systems and data structures. Proficiency in Databricks and big data coding languages, including SQL, Python and Scala. Experience designing and deploying ETL/ELT pipelines using Azure Data Factory, Azure Synapse Analytics or equivalent tools in AWS/GCP. Strong engineering skills, with the ability to write clean ...

and Cloud systems Awareness and experience of deploying Data systems via DevOps (DevSecOps desirable) Snowflake, Databricks or Fabric (Snowflake here) Strong SQL skills Extensive ETL Azure Cloud Python for scripting SAS Programming a bonus Tuesday/Wednesday in Peterborough, rest remote This is an exciting time to join this business ...

documenting requirements from non-technical users and translating them into effective technical solutions. Strong Excel skills and a sound understanding of data modelling and ETL processes. Knowledge of T-SQL and database management, together with proficiency in DAX and Power Query M. A quick learner, keen to develop across ...

silver/gold layer design) Data strategy and governance frameworks Data modeling and schema design for analytics workloads Modern data platform design and implementation ETL/ELT pipeline development and optimization (Glue, EMR) Data warehousing solutions (Redshift) Data catalog management and metadata governance Data quality and lineage frameworks Preferred Qualifications ...

data engineering foundation Hands-on experience with containerisation and orchestration (Docker, Kubernetes), and working with a major cloud provider Experience building data pipelines and ETL/ELT processes at scale, including web scraping or automated data collection A solid understanding of the ML lifecycle, from data through to model training ...

better use of modern Microsoft-based data and integration technologies. Design, develop and maintain automated data integrations between business applications. Build, support and optimise ETL/ELT processes and automated data pipelines. Develop automation solutions using APIs, scheduled processes and event-driven workflows. Monitor, troubleshoot and optimise data automation processes … years’ experience in Data Engineering, Integration Engineering, Automation Engineering or a similar role. Strong SQL Server and T-SQL skills. Experience developing ETL/ELT processes and data pipelines. Experience with APIs, integrations and data exchange technologies. Experience using Microsoft Azure services. Experience with Microsoft Fabric or similar cloud data ...

experience with both relational (e.g. PostgreSQL) and non-relational databases (e.g. Elasticsearch, Redis) Extensive experience in data warehousing architecture, big data processing and ETL Demonstrable expertise in Unix/Linux environments Experience with GIT and working in collaborative software environments Willingness to learn new skills as required by the project ...

design and maintenance of our scientific ontology, ensuring efficient data storage, retrieval, domain coverage, and integration with our software platformPipeline Development: Implement ETL pipelines for ingesting, cleaning, and transforming scientific datasets from multiple sourcesData Analysis and Modeling: Apply statistical and machine learning techniques to analyse scientific data, identify trends, and ...

agile practices and frequent updates. Design end-to-end data solutions: ingestion from collection systems and APIs, schema design and data storage, transformation/ETL, model training and evaluation, and operational delivery. Develop statistical and machine learning models for entity resolution, anomaly detection, classification, clustering, and pattern-of-life analysis … and unstructured sources Experience in Python and SQL or R, and with Pandas or NumPy, scikit-learn, and model evaluation or tuning Experience building ETL pipelines and querying APIs using tools such as Airflow or dbt, and Git-based version control Experience develop ing predictive models and quantitative analyses that ...