1 to 25 of 65 Permanent Data Ingestion Jobs

of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About you: Our team … skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion more »

market. They are a dynamic financial service business that provides innovative solutions in credit risk assessment and sustainable finance. This newly created role of Data Warehouse Developer reports to the Head of IT and is responsible for the design, development, and maintenance of the company s data warehouse. … This role involves working closely with business stakeholders, data analysts, and the IT team to ensure the data warehouse meets business needs and performance standards. Responsibilities: Design and develop data models and schemas for the data warehouse. Build and maintain ETL (Extract, Transform, Load) processes to … integrate data from various sources. Develop complex SQL queries and scripts to ensure efficient data retrieval and manipulation. Responsible for the build and deployment of data warehouse capabilities. Ensure data quality and integrity through validation and cleansing processes. Implement data warehousing best practices for data more »

will include, but not be limited to: In the early stages of projects production: Establish quick, efficient and clear pipelines (particularly with regards to data ingestion into Unreal from 3D CAD packages) Prepare coherent documentation for pipelines, tools and procedures Do benchmarking for the project features through research more »

we do things differently. We re focused on our core values using these we ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

Data Engineer (6-Month Contract) - £450 per day inside IR35 Birmingham/Hybrid We are recruiting on behalf of a leading company dedicated to innovative solutions in waste management. As part of our ongoing commitment to excellence, we are currently seeking a skilled Data Engineer to join our … Commercial Waste programme on a 6-month contract basis. Role Overview We are looking for a talented Data Engineer to support enterprise data platforms and warehouses in Azure. You will play a crucial role in gathering detailed requirements from business sponsors/owners and executing data ingestion … reports is desirable but not essential. Key Responsibilities Collaborate with business sponsors/owners to understand and document detailed requirements. Design, develop, and maintain data pipelines using Azure Data Factory and Azure Databricks. Implement and manage SQL databases and queries. Develop and maintain data models to support more »

we do things differently. We re focused on our core values using these we ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design more »

benefits Please note: you need to have the right to work in the UK no sponsorship, unfortunately About the job Reporting to the Senior Data & Analytics Lead, the BI Developer will be responsible for driving the direction and maintaining the business data model ensuring it aligns with business … activities and processes. The role will work closely with key internal and external stakeholders in organising and creating a data model that makes data and information accessible with appropriate channels of access controls. Fostering a relationship of trust and playing an advisory role in the use of data to improve business performance. The role will require playing a highly collaborative role by overseeing cross-functional data governance while ensuring the adoption and adherence to data quality are understood by stakeholders. Key Responsibilities Responsible for designing effective, efficient data models to support various types of more »

JOB ALERT FOR! We are currently recruiting for a LEAD DATA ENGINEER for one of our clients in the insurance industry. The Lead Data Engineer will be responsible for: Leading a team of developers and data engineers who build and deliver the components of modern Data platform – Data Lakehouse Architecture in Azure, leveraging data lake, delta Lake for data storage Utilizing Azure Data Factory for data integration Databricks for data transformation Data governance using purview Profisee for MDM Synapse and Power BI for end-user data analytics … layer and reporting. In the pipeline – Co Pilot and Fabric. Key responsibilities Lead data engineer responsible of: • Mixture of hands on and lead a newly established data engineering team through both strategic development projects and day-to-day data management (BAU) activities. o Defining and orchestrating tasks more »

Job description: hands-on experience in business intelligence development or data engineering experience,Solid experience with data modelling, data warehouse design and data lake concepts and practices; Exposure working in a Microsoft Azure Data Platform environment. Exposer inAzure Data Factory Azure Storage Data Ingestion and Storage including Azure Data Factory, Azure Databricks, Azure Data Lake, Kafka and Spark Streaming, Azure EventHub/IoT Hub, and Azure Stream Analytics • Building new data pipelines and optimizing data flows using the Azure cloud stack. • Building data products from scratch. … Support Business Analysts and Data Architects with discovery and best practices. • Self-directed and comfortable supporting the data needs of multiple teams, systems and products. What’s required ? • Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure. • Experience building and optimizing more »

Our client, a prominent multi-strategy hedge fund, is seeking a talented Data Engineer to join their dynamic team in the London office. In this role, you will be a key contributor to building a robust data platform that services a wide range of investment teams and internal … clients. You will collaborate with data sourcing experts, data specialists, data scientists, and fellow data engineers to manage and deliver a diverse set of financial and alternative datasets and insights across asset classes and strategies. Responsibilities: Data Pipeline Design: Partner with the data strategy … and sourcing team to understand data requirements and design efficient data pipelines and delivery structures. Real-Time Data Capture: Develop components to enhance the existing platform for capturing real-time data. Data Ingestion and Evaluation: Work with vendors and technical teams to systematically ingest, evaluate more »

Contractor Rate: £400-£450 per day Duration: 6 months Number of Positions: 1 Role Description: As a database expert, you will design solutions for data ingestion, transform data, optimize data storage, and ensure data integrity. You will also structure data for easy consumption by … BI tools. This role significantly impacts the organization by leveraging cutting-edge technology to enhance data management and analysis. Key Responsibilities: Develop ETL processes to extract data from various sources, transform it into the desired format, and load it into Azure Data Lake. Transform raw data into structured datasets, create models, and manage data pipelines using DBT Lab. Create scalable data transformation processes using dbt models for analytics-ready data. Ensure data exposed in business tools is populated by version-controlled, quality-assured dbt models. Configure and manage databases in the cloud. more »

office Permanent Key Responsibilities: As a Database Developer, you will: Design, develop, and maintain high-performance databases. Collaborate with cross-functional teams to understand data requirements. Optimize and enhance database performance. Troubleshoot and resolve database issues. Stay updated on the latest trends and technologies in database development. Requirements: Deliver … aspects of issues, reporting and development in an efficient and effective fashion, aligned to critical business timeframes and deadlines. Be an ambassador for the Data Warehouse team across the business through appropriate meetings around BAU and projects. Deliver analysis and development of business requirements through the following: Support ETL … architecture for overall data migration, data models, data mappings, business logic and data cleansing methods. Designing and scheduling complex SSIS Packages, PowerShell scripts for transferring data from multiple data sources to SQL Server. Data ingestion into the data warehouse using SSIS more »

week. Key Responsibilities : As a Azure Database Developer, you will: Design, develop, and maintain high-performance databases. Collaborate with cross-functional teams to understand data requirements. Optimize and enhance database performance. Troubleshoot and resolve database issues. Stay updated on the latest trends and technologies in database development. Requirements: Deliver … aspects of issues, reporting and development in an efficient and effective fashion, aligned to critical business timeframes and deadlines. Be an ambassador for the Data Warehouse team across the business through appropriate meetings around BAU and projects. Deliver analysis and development of business requirements through the following: Support ETL … architecture for overall data migration, data models, data mappings, business logic and data cleansing methods. Designing and scheduling complex SSIS Packages, PowerShell scripts for transferring data from multiple data sources to SQL Server. Data ingestion into the data warehouse using SSIS more »

our vision. Key Responsibilities : As a Database Developer, you will: Design, develop, and maintain high-performance databases. Collaborate with cross-functional teams to understand data requirements. Optimize and enhance database performance. Troubleshoot and resolve database issues. Stay updated on the latest trends and technologies in database development. Requirements: Deliver … aspects of issues, reporting and development in an efficient and effective fashion, aligned to critical business timeframes and deadlines. Be an ambassador for the Data Warehouse team across the business through appropriate meetings around BAU and projects. Deliver analysis and development of business requirements through the following: Support ETL … architecture for overall data migration, data models, data mappings, business logic and data cleansing methods. Designing and scheduling complex SSIS Packages, PowerShell scripts for transferring data from multiple data sources to SQL Server. Data ingestion into the data warehouse using SSIS more »

Senior Data Engineer About us HENI is a technology company pioneering art markets and information. We work with world-leading artists and estates across various sectors, including printmaking, book publishing, NFTs, digital content, and art research – all underpinned by cutting-edge research in analytics, AI, and machine learning. Our … team comprises of talented web developers, data engineers, data scientists, and infrastructure specialists who thrive on solving complex problems. We enjoy developing machine learning tools and embracing the latest in infrastructure and coding methodologies. We maintain high standards of technical quality via thorough testing and a dedication to … and commercial decisions are driven by this innovative collection of art market data. Role overview We are seeking a highly skilled and experienced Senior Data Engineer. You would be joining a strong team of roughly 20 people (software and data engineers, data scientists, analysts), in a fast more »

An exciting opportunity for an experienced Data Engineer to join the Engineering team working within the Digital & Product Department. Location: Chiswick (West London) Work Type: 3 days in office, 2 day from home Salary: £80k - £90k dependent on experience The successful candidate will lead a team of 2 data engineers to design and create scalable data pipelines. This hands-on role involves discussing requirements, designing solutions, and coding to automate data ingestion, cleansing, and transformation. You'll collaborate with Products, Engineering, Data, and Business Analytics teams to understand data requirements and develop integration … solutions for necessary migrations. The Data Engineer will support software developers, PowerBI developers, data analysts, and data scientists, ensuring a consistent and optimal data delivery architecture across projects. Self-direction and comfort in supporting multiple teams, systems, and products are essential. DUTIES & RESPONSIBILITIES Understand, build and more »

Solution Architect (Presales) Remote (Travel for client visit) Permanent As a Solution Data Architect, you will be responsible for designing, implementing, and overseeing comprehensive data solutions that align with our business objectives. Your expertise in AI, cloud technologies, Databricks, data lakes, and data strategy will be … pivotal in driving our data initiatives forward. Additionally, you will play a key role in pre-sales activities, collaborating with clients to understand their needs and propose tailored solutions. Key Responsibilities: Architect and Design: Develop robust data architectures and strategies leveraging AI, cloud platforms, Databricks, and data lakes to support business goals. Data Strategy: Define and implement data strategies that align with business objectives and ensure data integrity, security, and scalability. Cloud Integration: Lead the integration of cloud services (AWS, Azure, GCP) with on-premises data systems, ensuring seamless data flow more »

Senior Data Engineer/Up to £95k + Benefits//Global Facilities Services Business Senior Data Engineer 1 Day per Week in London Azure Stack & DataBricks Summary My client is seeking a highly skilled Senior Data Engineer to join their team. This role involves building out … a robust data platform on Databricks, with a primary focus on facilitating seamless data migrations. As a Senior Data Engineer, you will leverage your expertise in Databricks and data engineering to develop scalable solutions that enhance data integration, transformation, and accessibility across the organization. Key … Responsibilities responsible for designing, developing, and managing data ingestion processes and pipelines within Azure and Databricks environments. The role involves utilizing Databrick's medallion architecture to create well-defined and governed data consumption models, adopting a data-as-a-product mindset. The ideal candidate will have more »

Quantitative Data Engineer Our client is a leading Hedge Fund headquartered in London and is seeking a Quantitative Data Engineer to join their Front Office technologies team. The firms team integrates innovative technology and trading strategies, while utilizing a sophisticated research platform and development environment to realise consistent … trading alphas. As a Quant Data Engineer, you'll collaborate closely with various departments within the organization and Your primary responsibility will involve constructing and maintaining data ingestion processes of varying complexity that drive investment decisions and support critical operations. In this dynamic role, you'll also … ideal candidate will thrive in a fast-paced environment, enjoy direct interaction with business stakeholders, and excel at delivering results under pressure. Responsibilities: Analyzing data, identifying features and issues, and effectively communicating findings to stakeholders. Constructing robust data ingestion pipelines, platforms, and systems for easy support and more »

Data Engineer Embark on a Rewarding Journey with MIKI Travel: Where Your Career Takes Flight. At MIKI Travel, our 55+ years of expertise make us a trailblazing wholesale travel provider, curating unforgettable global adventures. As a premier private travel company with a presence in 36 offices, we invite you … Fuel your career with opportunities for growth, powered by values of quality, innovation, and commitment that shape the Miki way. Job Purpose As a Data Engineer you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to enable efficient data ingestion, processing, storage … and analysis. The ideal candidate will have a strong background in data engineering, including expertise in building and optimizing ETL processes, data warehousing, and working with big data technologies. Main Responsibilities ● Collaborate with business stakeholders to gather and analyse business requirements, translating them into specific data more »

London office on a hybrid basis. As a Contract Senior Golang Developer, you will play a crucial role in assessing, analysing, and enhancing our data ingestion, transformation, and storage layers. Your primary focus will be on Go Programming and DBT, with secondary skills in Google Cloud Services. The … successful candidate will bring 5 to 10 years of experience in developing robust data pipelines, conducting unit testing, and providing support for production deployments. Key Responsibilities: Assess and analyse data ingestion, transformation, and storage layers, including RAW, Exploratory, Curated, and application layers. Understand existing codebase and make … alterations or fixes as per design requirements. Develop and optimize data ingestion pipelines using Go Programming and DBT. Conduct unit testing and validation of the developed code to ensure reliability and performance. Collaborate with cross-functional teams to support production deployments and resolve any issues that may arise. more »

An international Insurance company which is headquartered in the US, is looking to hire a Data Science Manager do join its Analytics team in London. This team is well established and has been using leading technologies for the past few years. Job Responsibilities: Collaborate with strategic partners to address … business challenges by guiding junior team members in developing top-tier data solutions. Oversee data engineering activities throughout the project lifecycle. Establish strong partnerships with peers across the organization to support data-related objectives. Proactively design intuitive data structures that anticipate analytical needs. Investigate new technologies … and data sources with curiosity and creativity. Utilize technology to automate data ingestion and integrate external and internal data sources. Ensure thorough documentation of data sources and technical solutions. Requirements: 4+ years of data engineering experience. 2+ years of project management experience Proven experience more »

3x Snowflake Data Engineers (Contract) – Outside IR35 £550 - £650 per day (Outside IR35) Snowflake, DBT, Fivetran, SQL. 6 month contract/1 day per week in London My Fintech client is at the beginning of a Data Transformation program, a global business that has multiple subsidiaries, they are … looking to bring each business together under one banner from a Data perspective and implement a centralized analytics platform in Snowflake. The Snowflake platform will serve the business from an analytics and reporting perspective. For this contract we need Data Engineers who have experience with: SQL Server Snowflake … Datawarehouse Working with DBT for Data Modelling Fivetran for Data Ingestion and ETL Strong Data Modelling experience AWS Cloud experience (Desirable) This is a 6 month contract initially with the view to extend, rates on offer up to £650 per day (Outside IR35) with up to more »

This is a predominantly remote role with some occasional travel into Canary Wharf. The main activities of the role will be: Understand and implement data fabric principles and methodologies to enhance data ingestion and processing. Design and implement compliance scanning solutions on on-prem/cloud along … in Computer Science, Information Technology, or a related field. Extensive experience in Infrastructure DevOps and Automation within the financial services industry. Strong understanding of data lake principles, data fabric, and related methodologies. Deep expertise in Infrastructure As Code (IaC) principles and best practices. Proficiency with IT tooling and … vibrant workplaces Exclusive discounts with major retailers, discount gym memberships and access to our wellness centre Protecting your privacy and the security of your data is a longstanding top priority for Bell Integration. Please consult our Privacy Notice (click here) to know more about how we collect, use and more »

Lead Data Engineer - SQL Server, Oracle, Python, Hadoop, ETL Do you enjoy leading a team that develops high-quality code? Are you A highly visible champion with a ‘can do’ attitude and enthusiasm that inspires others? About the Business : LexisNexis Risk Solutions is the essential partner in the assessment … solve difficult problems in the areas of Anti-Money Laundering/Counter Terrorist Financing, Identity Authentication & Verification, Fraud and Credit Risk mitigation and Customer Data Management. You can learn more about LexisNexis Risk at the link below, risk.lexisnexis.com About the Role: This is a Lead Data Engineer/… Software Engineering Lead role where you will be responsible for overseeing and guiding a team of Software Engineer, Data Engineers and QAs specialising in Data Ingestion. In addition to writing code on complex systems and applications, this position provides direction on project plans, schedules, and methodologies. The role more »