1 to 7 of 7 Contract Data Ingestion Jobs

experience in delivering a cloud-based solution to a problem based in the physical world. This work will support research, development and learning in data science (incl. machine learning), earth observation and digital twins. The key aim of the Front End is to expose (show) insights extracted from combining … a Front End on a cloud-based system (most likely AWS), in a reproducible, scalable and reusable way. The Front End will take in data from various sources (eg the land-surface physical model JULES, climate datasets, ecosystem-service models) produced with Python code by the TWINE scientists, and … the work will be to understand the scientific requirements, to document and test the Front End, and to adapt to continuous developments of the data to be exposed to users (more data, more geographical areas, etc.). Responsibilities Gather requirements for the Front End of the prototype digital more »

experience in delivering a cloud-based solution to a problem based in the physical world. This work will support research, development and learning in data science (incl. machine learning), earth observation and digital twins. The key aim of the Front End is to expose (show) insights extracted from combining … a Front End on a cloud-based system (most likely AWS), in a reproducible, scalable and reusable way. The Front End will take in data from various sources (eg the land-surface physical model JULES, climate datasets, ecosystem-service models) produced with Python code by the TWINE scientists, and … the work will be to understand the scientific requirements, to document and test the Front End, and to adapt to continuous developments of the data to be exposed to users (more data, more geographical areas, etc.). Responsibilities Gather requirements for the Front End of the prototype digital more »

experience in delivering a cloud-based solution to a problem based in the physical world. This work will support research, development and learning in data science (incl. machine learning), earth observation and digital twins. The key aim of the Front End is to expose (show) insights extracted from combining … a Front End on a cloud-based system (most likely AWS), in a reproducible, scalable and reusable way. The Front End will take in data from various sources produced with Python code by the project scientists, and be designed in such a way that the project team will be … the work will be to understand the scientific requirements, to document and test the Front End, and to adapt to continuous developments of the data to be exposed to users). Responsibilities Gather requirements for the Front End of the prototype digital twin being developed Develop the Front End more »

Native, Flutter Experience in developing frontend on a cloud-based system (most likely AWS). Experience working on Digital Twin projects Experience in automating data ingestion and quality-assurance processes on a scale Knowledge of lower-level languages (such as Fortran) Experience in working with machine learning approaches more »

Data Engineer vacancy for our Zurich based client in the technology sector . Your tasks: Designing, building, and maintaining scalable data pipelines to support data ingestion, processing, and analysis Developing and optimizing ETL processes to ensure data quality and integrity Collaborating with data scientists … analysts, and other stakeholders to understand data requirements and deliver solutions Implementing data modelling and database design for both relational and NoSQL databases Monitoring and troubleshooting data pipelines to ensure reliability and performance Ensuring compliance with data governance and security policies Your experience/knowledge: 5+ … years of experience in data engineering Proficiency in SQL and experience with relational databases like PostgreSQL, MySQL Strong programming skills in Python, Java, or Scala Experience with big data technologies such as Hadoop, Spark, or Kafka Familiarity with cloud platforms and their data services Knowledge of data more »

London office on a hybrid basis. As a Contract Senior Golang Developer, you will play a crucial role in assessing, analysing, and enhancing our data ingestion, transformation, and storage layers. Your primary focus will be on Go Programming and DBT, with secondary skills in Google Cloud Services. The … successful candidate will bring 5 to 10 years of experience in developing robust data pipelines, conducting unit testing, and providing support for production deployments. Key Responsibilities: Assess and analyse data ingestion, transformation, and storage layers, including RAW, Exploratory, Curated, and application layers. Understand existing codebase and make … alterations or fixes as per design requirements. Develop and optimize data ingestion pipelines using Go Programming and DBT. Conduct unit testing and validation of the developed code to ensure reliability and performance. Collaborate with cross-functional teams to support production deployments and resolve any issues that may arise. more »

Principal Data Engineer Job Type: Full-Time Sector: PropTech Location: Preston, Lancashire - Predominantly Remote!! (average expectation of one site visit per month) Salary: £85,000.00+ Standard benefits + Annual Bonus My well established PropTech client is looking for an experienced Principal Data Engineer to join their team and … be instrumental in transforming the way that they consume data and transitioning from On Premise to Google Cloud. This is an exciting time to join a growing business function and gain hands on experience working with market leading technology such as BIG Query, Looker, Data Flow, and more. … The Data Team: The Data and Platform Engineering team are the foundation for the Data Office function. Responsible for designing, building, and maintaining their data platform, they extract data from source, transform it into a usable format, load it into consumer models & marts as well more »