1 to 14 of 14 Data Ingestion Jobs with Remote Work Options

knowledge of Docker Experience working with a modern JavaScript framework such as React JS, Vue or Angular Experience with management and analysis of large data sets What you'll need to do: You will be working as part of a team of skilled software developers, building and delivering our … diverse client base, Integrates a wide range of digital services across the Cavendish team. The platform offers a wide range of features including, API data ingestion, aggregation and analytics, insight generation and dashboarding, reporting and notification, AI Data processing, social media integrations and much more. Write clean more »

Solution Architect, Microsoft Azure, Data Warehousing, Technical Integration Architect, API, ERP, Cloud Technology Operations, TOGAF, Logic Apps, Function Apps, Azure Message Bus, Remote Solution Architect, Technical Integrations Architect (within Data, API, ERP) required towork for a fast growing Enterprise business based in Central London. However, this will be … hands on and technology driven role where we need this person to be a solid Solution Architect within Cloud Technology Operations. You MUST have Data Architect/Data Ingestion/Data Warehousing experience within the likes of API and ERP. This is strictly a Microsoft Stack … Experience of designing, reviewing, improving Cloud Technology Operations Understanding of various integration patterns such as point-to-point, hub-and-spoke, publish-subscribe, etc. Data Ingestion and Data Warehousing experience Knowledge of middleware and messaging technologies like enterprise service buses (ESBs), message queues, and event-driven architecture. more »

of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About you: Our team … skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion more »

will include, but not be limited to: In the early stages of projects production: Establish quick, efficient and clear pipelines (particularly with regards to data ingestion into Unreal from 3D CAD packages) Prepare coherent documentation for pipelines, tools and procedures Do benchmarking for the project features through research more »

ideally with experience in the media industry, we re looking for an experienced engineer who is a real team individual to join our core data platform team, As a key member of our team, you will be responsible for developing systems for the ingest, processing, and summarization of audience … data, while also contributing to the future development of the BBC data platform. Over the next 12 months, we are transforming the platform proposition to enable data professionals to self-service their data needs from the platform in order to meet the huge demand for data across the organisation. This encompasses a wide data toolset, spanning data ingestion, transformation, developing systems for ingest, processing, and in summarization of audience data. Key Skills and Responsibilities You will: Testing: TDD, BDD, end-to-end, load testing, Stress Testing Database experience Have experience in cloud more »

The Role - Senior Software Engineer At Ophelos, we are revolutionising how data flows between us and our clients. Our small but dynamic I/O Squad plays a critical role in bridging this gap, ensuring seamless integration and information exchange. As we expand across Europe, we are looking for … role, you ll get to: Design, implement and deliver software features such as our developer dashboard to help external teams manage and debug the data integration process Collaborate as part of a close & multi-disciplinary team. Your work will have meaningful and measurable impact on our organisation and products … Build and maintain APIs capable of handling high-volume data ingestion from clients Own and deliver key projects such as batch file handling and transitioning existing integrations to our new API platform Mentor other members of the team to ensure technical excellence and continuously raise the bar when more »

experience in delivering a cloud-based solution to a problem based in the physical world. This work will support research, development and learning in data science (incl. machine learning), earth observation and digital twins. The key aim of the Front End is to expose (show) insights extracted from combining … a Front End on a cloud-based system (most likely AWS), in a reproducible, scalable and reusable way. The Front End will take in data from various sources (eg the land-surface physical model JULES, climate datasets, ecosystem-service models) produced with Python code by the TWINE scientists, and … the work will be to understand the scientific requirements, to document and test the Front End, and to adapt to continuous developments of the data to be exposed to users (more data, more geographical areas, etc.). Responsibilities Gather requirements for the Front End of the prototype digital more »

Data Engineer - Manchester - £35,000 - Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into their central Microsoft Azure repository. … Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Configure and troubleshoot Microsoft Azure, manage data ingestion Develop ETL scripts using Python, handle web scraping, APIs, and relational databases Familiarity with Power BI (you will not have to use … Power BI, but being aware of how to collaborate with people that do is important) Work closely with data analysts and scientists, contribute to data models and algorithms, and participate in data events Working knowledge of Git If you have the required skills and experience and would more »

Data Platform Architect €110k-€135k + Health + Pension + more Remote working (Two days per month in Dublin Office) We are looking for an experienced Data Architect to join a collaborative team of experts focused on creating a world-class data platform. As a subject matter … expert, you will serve as a technical thought leader in data management, database systems, and information processes across the company. You will have the freedom to design innovative solutions to unique challenges, using data to improve workplace experiences. This opportunity will allow you to really put your stamp … to the table. The role: Acting as an SME on how information is collected, organized, and used within the company. Shape and lead our data strategy and architectural vision. Create design patterns and blueprints for data ingestion, processing, and transformation. Develop a multi-year data platform more »

Principal Data Engineer Job Type: Full-Time Sector: PropTech Location: Preston, Lancashire - Predominantly Remote!! (average expectation of one site visit per month) Salary: £85,000.00+ Standard benefits + Annual Bonus My well established PropTech client is looking for an experienced Principal Data Engineer to join their team and … be instrumental in transforming the way that they consume data and transitioning from On Premise to Google Cloud. This is an exciting time to join a growing business function and gain hands on experience working with market leading technology such as BIG Query, Looker, Data Flow, and more. … The Data Team: The Data and Platform Engineering team are the foundation for the Data Office function. Responsible for designing, building, and maintaining their data platform, they extract data from source, transform it into a usable format, load it into consumer models & marts as well more »

week. Key Responsibilities : As a Azure Database Developer, you will: Design, develop, and maintain high-performance databases. Collaborate with cross-functional teams to understand data requirements. Optimize and enhance database performance. Troubleshoot and resolve database issues. Stay updated on the latest trends and technologies in database development. Requirements: Deliver … aspects of issues, reporting and development in an efficient and effective fashion, aligned to critical business timeframes and deadlines. Be an ambassador for the Data Warehouse team across the business through appropriate meetings around BAU and projects. Deliver analysis and development of business requirements through the following: Support ETL … architecture for overall data migration, data models, data mappings, business logic and data cleansing methods. Designing and scheduling complex SSIS Packages, PowerShell scripts for transferring data from multiple data sources to SQL Server. Data ingestion into the data warehouse using SSIS more »

days a week. As a Database Developer, you will: Design, develop, and maintain high-performance databases. Collaborate with cross-functional teams to understand data requirements. Optimize and enhance database performance. Troubleshoot and resolve database issues. Stay updated on the latest trends and technologies in database development. Requirements of the … aspects of issues, reporting and development in an efficient and effective fashion, aligned to critical business timeframes and deadlines. Be an ambassador for the Data Warehouse team across the business through appropriate meetings around BAU and projects. Deliver analysis and development of business requirements through the following: Support ETL … architecture for overall data migration, data models, data mappings, business logic and data cleansing methods. Designing and scheduling complex SSIS Packages, PowerShell scripts for transferring data from multiple data sources to SQL Server. Data ingestion into the data warehouse using SSIS more »

Data Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established organisation within the education sector who are looking for a Data Engineer to join their established IT team. Their current project is based around the creation and implementation of a brand new … Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. This is an opportunity to join a team who are serious about the way that they use data and work within an … organisation who are providing significant investment into all of their data teams. The teams itself are growing in size but the company are also investing in the technology that they use with an emphasis on Microsoft tech such as Azure Synapse, Databricks and Data Factory. As part of more »

Junior Data Architect- £50,000- £58,000 + Fantastic Pension & Benefits Bath- Hybrid working with 5 days per month working onsite This is an exciting time to join as leading business is embarking on the next stage of its digital transformation journey. They are transforming the way data & technology services are delivered and are looking to bring in a Data Architect to design, build, and optimise the data architecture to support the evolving business needs. My client would consider someone who is looking to step up and develop their career within data architecture and … offer excellent support, Role: You will collaborate closely with the business to understand our existing data landscape, identify opportunities for improvement, and develop strategic plans for managing and integrating data across the organisation. Design and implement scalable data architectures that support data ingestion, storage, processing more »