26 to 34 of 34 Data Ingestion Jobs

The Role - Senior Software Engineer At Ophelos, we are revolutionising how data flows between us and our clients. Our small but dynamic I/O Squad plays a critical role in bridging this gap, ensuring seamless integration and information exchange. As we expand across Europe, we are looking for … role, you ll get to: Design, implement and deliver software features such as our developer dashboard to help external teams manage and debug the data integration process Collaborate as part of a close & multi-disciplinary team. Your work will have meaningful and measurable impact on our organisation and products … Build and maintain APIs capable of handling high-volume data ingestion from clients Own and deliver key projects such as batch file handling and transitioning existing integrations to our new API platform Mentor other members of the team to ensure technical excellence and continuously raise the bar when more »

Role Senior Data Engineer Location: Central London Salary: Up to £70,000 plus Bonus and excellent benefits package Working Pattern: Hybrid Summary We have a brand-new role for a Senior Data Engineer with a large company, with an office in central London, close to transport links. … In this role, you will be responsible for owning and evolving the company s data stack. It s an amazing opportunity for a data engineer to focus on exploring solutions to maintain, improve, and scale their use of data. They re a collaborative business so you will be … for someone with ambition, problem-solving, and communication skills. The Company This is a creative and ambitious company who are looking to grow their data team. It s a large company with well-established operations across the UK and Europe. They offer all positions on a hybrid basis with more »

Rust Developer Location: UK Remote Salary £60k £80k Search 5.0 is delighted to be partnering with an exciting AI tech start-up within financial data for a Rust Developer to join their exciting journey Our client provides traders with a set of tools that are faster, smarter, and easier … opens a new horizon for trading opportunities, all with real-time analytics backed up by a world-leading, scalable, ultra-low latency architecture. The Data Platform underpins all capabilities and service offerings, providing data ingestion, analysis, querying and storage at near-real-time speeds is what sets … requirements are met and building a scalable product. Develop and maintain the platform services that underpin our products, in tandem with SME s in data science and quantitive finance. Contribute new products and technical ideas, providing feedback and collaboration sessions. Work closely with QA to ensure that systems are more »

We're representing a dynamic business dedicated to extending healthy lifespans and cutting unnecessary medical costs. They're seeking a Senior Data Engineer to propel their Data team forward. Key Responsibilities: Lead Cloud Data Warehouse Project: Oversee the next development phase, ensuring top-notch scalability, reliability, and … performance. Data Management Ownership: Be the go-to expert for data management, ensuring smooth operations and accessibility. Support BAU Workloads: Assist in prioritising and managing day-to-day tasks for efficiency and alignment with goals. Set Technical Direction: Define the systems and tools' technical direction, advancing towards ML … and AI integration. Required Experience: Snowflake: Proficiency in setup, configuration, and optimisation. DBT (Data Build Tool): Strong skills in managing transformations and data pipelines. Python: Expertise in scripting, automation, and data manipulation. Beneficial Experience: Dagster/Airflow: Managing complex workflows. Qlik Sense Cloud/Tableau: Data more »

knowledge of Docker Experience working with a modern JavaScript framework such as React JS, Vue or Angular Experience with management and analysis of large data sets What you'll need to do: You will be working as part of a team of skilled software developers, building and delivering our … diverse client base, Integrates a wide range of digital services across the Cavendish team. The platform offers a wide range of features including, API data ingestion, aggregation and analytics, insight generation and dashboarding, reporting and notification, AI Data processing, social media integrations and much more. Write clean more »

a production environment using Azure ML and related services. Pipeline Development: - Design, implement, and maintain CI/CD pipelines for machine learning projects. - Automate data ingestion, model training, evaluation, and deployment processes. Automation Architecture: - Develop and maintain automation scripts and tools to support the ML lifecycle. - Implement monitoring … and alerting systems to detect and address performance issues. Collaboration and Support: - Work closely with data scientists and machine learning engineers to understand requirements and provide operational support. - Collaborate with DevOps and IT teams to integrate ML systems with existing infrastructure. Performance Optimization: - Optimize model serving performance, ensuring minimal … latency and high throughput. - Conduct regular performance tests and tune system parameters accordingly. Security and Compliance: - Implement security best practices to protect data and models. - Ensure compliance with relevant data protection regulations. If you are passionate about machine learning and have experience in deployment, automation, and optimization, we more »

a production environment using Azure ML and related services. Pipeline Development: - Design, implement, and maintain CI/CD pipelines for machine learning projects. - Automate data ingestion, model training, evaluation, and deployment processes. Automation Architecture: - Develop and maintain automation scripts and tools to support the ML lifecycle. - Implement monitoring … and alerting systems to detect and address performance issues. Collaboration and Support: - Work closely with data scientists and machine learning engineers to understand requirements and provide operational support. - Collaborate with DevOps and IT teams to integrate ML systems with existing infrastructure. Performance Optimization: - Optimize model serving performance, ensuring minimal … latency and high throughput. - Conduct regular performance tests and tune system parameters accordingly. Security and Compliance: - Implement security best practices to protect data and models. - Ensure compliance with relevant data protection regulations. If you are passionate about machine learning and have experience in deployment, automation, and optimization, we more »

will include, but not be limited to: In the early stages of projects production: Establish quick, efficient and clear pipelines (particularly with regards to data ingestion into Unreal from 3D CAD packages) Prepare coherent documentation for pipelines, tools and procedures Do benchmarking for the project features through research more »

Native, Flutter Experience in developing frontend on a cloud-based system (most likely AWS). Experience working on Digital Twin projects Experience in automating data ingestion and quality-assurance processes on a scale Knowledge of lower-level languages (such as Fortran) Experience in working with machine learning approaches more »