276 to 300 of 438 Data Ingestion Jobs in the UK

KDB+/Q Software Engineer, you will play a pivotal role in the firm's operations, working on the greenfield development of data intensive applications. This position offers a unique opportunity to join a dynamic team of professionals in an intellectually stimulating environment. Benefits: Exceptional professional growth opportunities … career progression and exposure to diverse technologies. Collaboration with top-tier infrastructure teams in the financial sector. Responsibilities: Build and maintain high-performance tick data storage systems using kdb+/q to efficiently store and retrieve large volumes of market data (e.g., trades, quotes, order books). Optimize ...

KDB+/Q Software Engineer, you will play a pivotal role in the firm's operations, working on the greenfield development of data intensive applications. This position offers a unique opportunity to join a dynamic team of professionals in an intellectually stimulating environment. Benefits: Exceptional professional growth opportunities … career progression and exposure to diverse technologies. Collaboration with top-tier infrastructure teams in the financial sector. Responsibilities: Build and maintain high-performance tick data storage systems using kdb+/q to efficiently store and retrieve large volumes of market data (e.g., trades, quotes, order books). Optimize ...

defence, water and beyond manage critical infrastructure. Work with the Best: Collaborate daily with a vibrant, multi-disciplinary team of consultants including geospatial experts, data scientists and engineers, sharing ideas and driving innovation across the globe. Cutting-Edge Technology: Get hands-on with the full Esri product suite (ArcGIS … want to make a real-world impact with geospatial technology, we want to hear from you. The role will involve contributions across Geospatial & Data Engineering, AI & Innovation, and Collaboration & Leadership: Collaborating with Tetra Techs digital solutions teams across the globe. Leverage and fine-tune foundation models and AI/ ...

defence, water and beyond manage critical infrastructure. Work with the Best: Collaborate daily with a vibrant, multi-disciplinary team of consultants including geospatial experts, data scientists and engineers, sharing ideas and driving innovation across the globe. Cutting-Edge Technology: Get hands-on with the full Esri product suite (ArcGIS … want to make a real-world impact with geospatial technology, we want to hear from you. The role will involve contributions across Geospatial & Data Engineering, AI & Innovation, and Collaboration & Leadership: Collaborating with Tetra Techs digital solutions teams across the globe. Leverage and fine-tune foundation models and AI/ ...

part of something bigger. The Role As a Palantir Solution Architect , you will lead multi-skilled agile teams to design and deliver contemporary data solutions. You’ll be recognised as an authority in data technology, providing strong technical and thought leadership while balancing pragmatism with innovation to deliver … complex solutions. Key Responsibilities Implementing functional and non-functional designs Collaborating with Ops and Infrastructure architects to productionise robust, resilient, and maintainable data solutions Partnering with customer architects to agree designs and guide sound solution outcomes Developing policy and standards, sharing knowledge, and mentoring peers Managing timelines and solution ...

Python Data Engineer Azure & PySpark - SC Cleared Contract £400-£458pd (Inside IR35) SC Clearance is Essential Summary Were looking for a Python Data Engineer skilled in PySpark, Delta Lake, Azure services, containerized development, and Behave-based testing. Youll design and build scalable data pipelines and maintain high … quality, test-driven code in a cloud environment. What youll do Build and maintain Python/PySpark pipelines for data ingestion, processing, and validation. Write unit and BDD tests using Behave, including mocking and patching. Create and optimize Delta Lake tables for reliable, performant data storage. ...

Data Engineer- Azure £500-£525 pd via Umbrella Birmingham- 1-2 days per week in the office Leading business is looking to bring in a Data Engineer to develop, maintain, and operate data-ingestion routines across the estate to create a single, trusted data source … that supports a data-driven culture click apply for full job details ...

team champions continuous learning, clean engineering practices, and building scalable, impactful applications that shape the firm's future. If you're passionate about data, eager to solve complex problems, and want to see your insights drive real organisational change, this is the role for you. About the Role … Risk & Compliance, and senior leadership. Your work will directly support improved decision-making, operational efficiency, and strategic outcomes across the firm-all while ensuring data confidentiality and regulatory compliance. Key Responsibilities Build robust data ingestion pipelines from systems such as PMS, DMS, CRM, HR and Risk/ ...

rate (Inside IR35) |12 months London Our Big Four client is looking to hire a experienced and certified Quantexa specialist to join their Data & AI practice and it's fast-growing and strategic capability. They combine technical implementation with deep domain understanding to deliver high-impact solutions for their … this space, Quantexa plays a critical role. Role Overview We are looking for a Quantexa Tech Lead to lead the design and delivery of data-driven solutions using the Quantexa platform. You'll take ownership of end-to-end implementations, provide technical leadership, and work closely with stakeholders ...

annual sales, they're now investing heavily in their technology to unlock the next phase: scaling from 150 sites to 5,000+, powered by data, AI, and automation. The Role You'll be a foundational member of their engineering team. This is a high-impact individual contributor role, ideal … real-world problems, and owning architecture decisions in a fast-moving environment. You'll work across the stack, with a focus on backend systems, data infrastructure, and internal tools. What You'll Be Doing Implementing AI tooling across all their products focusing on data ingestion and aggregation ...

annual sales, they're now investing heavily in their technology to unlock the next phase: scaling from 150 sites to 5,000+, powered by data, AI, and automation. The Role You'll be a foundational member of their engineering team. This is a high-impact individual contributor role, ideal … real-world problems, and owning architecture decisions in a fast-moving environment. You’ll work across the stack, with a focus on backend systems, data infrastructure, and internal tools. What You’ll Be Doing Implementing AI tooling across all their products focusing on data ingestion and aggregation ...

annual sales, they're now investing heavily in their technology to unlock the next phase: scaling from 150 sites to 5,000+, powered by data, AI, and automation. The Role You'll be a foundational member of their engineering team. This is a high-impact individual contributor role, ideal … real-world problems, and owning architecture decisions in a fast-moving environment. You’ll work across the stack, with a focus on backend systems, data infrastructure, and internal tools. What You’ll Be Doing Implementing AI tooling across all their products focusing on data ingestion and aggregation ...

site in London Key Responsibilities Design, develop and maintain Front End and Back End features Lead development activities within an Agile Scrum model Enhance data models and data catalogues to support data ingestion Build UI visualisations and manage associated metadata Develop and improve audit logging … Contribute to estimation, prioritisation and sprint planning Maintain high code quality through peer reviews and security-focused development Technical Skills & Experience Strong experience in data modelling JavaScript, TypeScript, React and Node.js OAuth-based authentication and authorisation Data streaming technologies PostgreSQL AWS Lambda Outside IR35- Full stack Developer ...

West of England Combined Authority are seeking a highly skilled Data Engineer to support the optimisation, documentation, and enhancement of our existing data pipelines within the Databricks Lakehouse environment. This role will involve hands-on development, reverse-engineering of current solutions, and close collaboration with internal teams … debug Databricks notebooks, Delta Lake workflows, and Genie-bot automations Design, maintain, and enhance ETL pipelines , ensuring reliability and performance Validate, transform, and orchestrate data using Python and SQL within the Lakehouse environment Manage data ingestion and scheduling processes via Azure Data Factory Reverse-engineer, document ...

Compliance Data & Automation Specialist Glasgow (Hybrid) £60,000 + Benefits My client is seeking a Data & Automation Specialist with strong compliance and governance experience to own the design, development, and continuous enhancement of a strategic internal platform that consolidates employee and technology communication-channel data. Using Microsoft … Responsibilities Develop, extend, and maintain the record-keeping platform using SQL, Power Platform, and Python. Build and document APIs; ensure accurate, complete, high-quality data ingestion. Optimise database performance and resolve technical issues. Enhance UI/UX, visualisation, navigation, and role-based access; maintain comprehensive audit trails. Create clear ...

build the digital brain of the ocean . You’ll be working on a next-generation ocean intelligence platform that turns raw environmental sensor data into insights trusted by ports, insurers, ocean developers, and compliance teams. From data streaming off autonomous marine systems to decision-ready dashboards … critical parts of a platform that connects hardware, data science, and real-world action. If you’re excited by systems that span edge devices → cloud → beautiful UX , and want your work to have tangible environmental impact, this role is for you. What You’ll Do You’ll help design ...

build the digital brain of the ocean . You’ll be working on a next-generation ocean intelligence platform that turns raw environmental sensor data into insights trusted by ports, insurers, ocean developers, and compliance teams. From data streaming off autonomous marine systems to decision-ready dashboards … critical parts of a platform that connects hardware, data science, and real-world action. If you’re excited by systems that span edge devices → cloud → beautiful UX , and want your work to have tangible environmental impact, this role is for you. What You’ll Do You’ll help design ...

will reach out to shortlisted professionals to begin the interview process. Location: London Work mode: hybrid About the Role: We are seeking an experienced Data Engineer with deep expertise in Power BI and enterprise-scale reporting environments. The ideal candidate will be responsible for designing, optimizing, and maintaining high … high-performance dashboards using Power BI Desktop & Power BI Service. Write advanced, performance-optimized DAX following best practices. Leverage Power Query (M) for scalable data ingestion and transformation. Perform deep model optimization using Tabular Editor, DAX Studio, and performance analyzer tools. Apply strong understanding of the Power ...

will reach out to shortlisted professionals to begin the interview process. Location : London Work mode: hybrid About the Role: We are seeking an experienced Data Engineer with deep expertise in Power BI and enterprise-scale reporting environments. The ideal candidate will be responsible for designing, optimizing, and maintaining high … performance dashboards using Power BI Desktop & Power BI Service . Write advanced, performance-optimized DAX following best practices. Leverage Power Query (M) for scalable data ingestion and transformation. Perform deep model optimization using Tabular Editor , DAX Studio , and performance analyzer tools. Apply strong understanding of the Power ...

will reach out to shortlisted professionals to begin the interview process. Location : London Work mode: hybrid About the Role: We are seeking an experienced Data Engineer with deep expertise in Power BI and enterprise-scale reporting environments. The ideal candidate will be responsible for designing, optimizing, and maintaining high … performance dashboards using Power BI Desktop & Power BI Service . Write advanced, performance-optimized DAX following best practices. Leverage Power Query (M) for scalable data ingestion and transformation. Perform deep model optimization using Tabular Editor , DAX Studio , and performance analyzer tools. Apply strong understanding of the Power ...

case definition through to high-level architecture and platform design. The role covers areas such as Predictive AI, Machine Learning and Generative AI, MLOps, data pipelines and modern AI platforms, across both cloud and private infrastructure. Alongside customer work, youll contribute to the development of AI offerings, standards … mentoring other architects within the wider team. Key Responsibilities Act as the AI subject matter expert in customer engagements, working directly with business stakeholders, data teams and IT operations. Lead discovery and design of AI strategies, governance models and platform architectures aligned to business outcomes. Design ...

case definition through to high-level architecture and platform design. The role covers areas such as Predictive AI, Machine Learning and Generative AI, MLOps, data pipelines and modern AI platforms, across both cloud and private infrastructure. Alongside customer work, you’ll contribute to the development of AI offerings, standards … mentoring other architects within the wider team. Key Responsibilities • Act as the AI subject matter expert in customer engagements, working directly with business stakeholders, data teams and IT operations. • Lead discovery and design of AI strategies, governance models and platform architectures aligned to business outcomes. • Design ...

case definition through to high-level architecture and platform design. The role covers areas such as Predictive AI, Machine Learning and Generative AI, MLOps, data pipelines and modern AI platforms, across both cloud and private infrastructure. Alongside customer work, you’ll contribute to the development of AI offerings, standards … mentoring other architects within the wider team. Key Responsibilities • Act as the AI subject matter expert in customer engagements, working directly with business stakeholders, data teams and IT operations. • Lead discovery and design of AI strategies, governance models and platform architectures aligned to business outcomes. • Design ...

case definition through to high-level architecture and platform design. The role covers areas such as Predictive AI, Machine Learning and Generative AI, MLOps, data pipelines and modern AI platforms, across both cloud and private infrastructure. Alongside customer work, you’ll contribute to the development of AI offerings, standards … mentoring other architects within the wider team. Key Responsibilities • Act as the AI subject matter expert in customer engagements, working directly with business stakeholders, data teams and IT operations. • Lead discovery and design of AI strategies, governance models and platform architectures aligned to business outcomes. • Design ...

case definition through to high-level architecture and platform design. The role covers areas such as Predictive AI, Machine Learning and Generative AI, MLOps, data pipelines and modern AI platforms, across both cloud and private infrastructure. Alongside customer work, you’ll contribute to the development of AI offerings, standards … mentoring other architects within the wider team. Key Responsibilities • Act as the AI subject matter expert in customer engagements, working directly with business stakeholders, data teams and IT operations. • Lead discovery and design of AI strategies, governance models and platform architectures aligned to business outcomes. • Design ...