1 to 25 of 128 Remote Big Data Jobs

We are searching for an experienced Lead Data Engineer for an exciting data-driven business with multiple office locations across the UK. The role is offered as a remote position, but you MUST be based in the UK to be considered for the opportunity. In this role you will be involved in determining the future direction and impact … of data engineering within the business. This is an extremely exciting Lead Data Engineering role, a fantastic opportunity for an experienced, innovative and hands-on data professional to help shape our client's products and solutions. Reporting directly to the Head of Data Engineering, you will play a crucial role in driving the team's vision … and objectives to completion. You will be expected to provide technical leadership, own the solution, ensure the reliability of data products, and collaborate closely with your team and other teams to optimise data solutions. This is a fantastic opportunity for highly skilled and motivated Lead Data Engineer with strong expertise in data architecture, ETL pipelines, cloud More ❯

We are searching for a remote working Senior Data Engineer to join our clients high-performing Data Engineering team. This role is ideal for an experienced, hands-on professional Senior Data Engineer who thrives on technical leadership, innovation, and delivery. You can be based anywhere in the UK to be considered for the role but you MUST … be UK based as overseas working is not possible with our client. Our client is a 100% data-driven company who pride themselves on engineering excellence and delivering impactful solutions to their clients. You will play a crucial role in driving the team's vision and objectives and you will be expected to provide technical leadership, own the solution … ensure the reliability of data products, and collaborate closely with the team and customers in order to optimise data solutions. This is a unique opportunity for a highly skilled and hard-working Senior Data Engineer with deep hands-on expertise in data engineering and architecture, a strong coding background, and a strategic mindset - someone who can More ❯

Overview Role: Staff Data Architect Location: Limerick, Ireland (Hybrid) Department: Architecture (Data & Analytics) Employment Type: Full-Time Who We are Transact Campus and CBORD have joined forces as industry leaders to bring the best integrated technology solutions to education, healthcare, and business campuses worldwide. Be a part of this exciting new partnership, committed to transforming organizations and improving … We maintain an entrepreneurial spirit, where creativity, innovative problem-solving, and learning agility drive our day-to-day actions. About the Role We are seeking a highly experienced Staff Data Architect to join our dynamic team in Ireland. In this senior role, you will lead the design, implementation, and optimization of our enterprise data architecture, ensuring it aligns … with business objectives and supports data-driven decision-making. You will collaborate with cross-functional teams, including engineering, product, and business stakeholders, to develop scalable data solutions that leverage modern technologies. This position requires a deep understanding of data strategy, governance, and compliance, particularly in a regulated environment like the EU, where GDPR is paramount. As a More ❯

Position: Big Data Architect Location: Washington DC (Hybrid-Onsite) Duration: 12+ Months contract on W2 or 1099 Required Skillsets Experience implementing modern Big Data storage and analytics platforms such as Databricks and Data Lakes 5 Years Knowledge of modern Big Data and Data Architecture and Implementation best practices 5 Years Knowledge of … architecture and implementation of networking, security and storage on cloud platforms such as Microsoft Azure 5 Years Experience with deployment of data tools and storage on cloud platforms such as Microsoft Azure 5 Years Knowledge of Data-centric systems for the analysis and visualization of data, such as Tableau, MicroStrategy, ArcGIS, Kibana, Oracle 5 Years Experience querying … structured and unstructured data sources including SQL and NoSQL databases - 5 Years Experience modeling and ingesting data into and between various data systems through the use of Data Pipelines 5 Years Experience with API/Web Services (REST/SOAP) 3 Years Experience with complex event processing and real-time streaming data 3 Years Experience More ❯

to provide innovative, user-focused solutions that empower organizations and end users to operate smarter, faster, and more securely in dynamic environments Responsibilities Job Description: We are seeking a Data Ecosystem Data Engineer SME - Hybrid to design, build, and maintain data collection, processing, and integration pipelines that centralize and structure data from various web-based applications. … You will work closely with software developers, data analysts, and product teams to ensure seamless data flow, high-quality data storage, and efficient retrieval methods. This role is ideal for someone passionate about data-driven decision-making and optimizing data aggregation processes while exploring and identifying right-sized technologies and computing resources. This is not … a Data Science, Big Data, ML-Ops, or AI-related role. Instead, this position focuses on wrangling disparate data sources into unified, consumable data APIs for internal and external stakeholders. This is a Hybrid position in Crystal City, VA (3 days onsite, 2 remote). Job Duties Include (but not limited to): Design, develop, and More ❯

the hunt for builders . No, we've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries such as telecoms … ready to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We're Intuita - a fast growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for … have working across our business, becoming a pivotal part of our journey, to not just meet, but continuously exceed our client expectations! The Role We are seeking a skilled Data Engineer(s) to join our team, ideally initially on a contract basis, however longer term there is potential to discuss longer term opportunities in the shape of a permanent More ❯

its exceptional customer service and innovation. We serve both government and commercial sectors, offering a range of solutions such as Healthcare IT, Human Services, Identity Credentialing, Cloud Computing, and Big Data Analytics. With clients in the US and abroad, we hold key contract vehicles including GSA IT Schedule 70, NIH CIO-SP3, GSA Alliant, and DHS-Eagle II. … strong experience in designing, developing, maintaining, and optimizing complex databases (PostgreSQL, MongoDB) in cloud environments. This role involves supporting critical systems like Maryland Health Connection, with a focus on data integrity, performance, security, and cost-efficiency. Database Architecture & Design: Lead the design, development, and maintenance of complex enterprise databases, data lakes, and data warehouses, including data modelling, schema design, and security architecture. Data Platform Management: Administer, monitor, and optimize performance for PostgreSQL and MongoDB databases, ensuring high availability, replication, and disaster recovery. This includes managing user accounts, patching, and storage. ETL & Data Strategy: Design, develop, and support robust ETL processes for extracting, transforming, and loading complex data into various data stores. More ❯

Data Analytics Engineer Location: Central London - hybrid working Rate: £500.00 per day inside IR35 Duration: 12 months We are working with a leading global player in the travel industry who are seeking a Data Analytics Engineer to join their data team. This role sits at the intersection of data analysis and data engineeringideal for someone … who enjoys building scalable data solutions while staying close to business impact. The Role As a Data Analytics Engineer , youll design, build, and maintain reliable data pipelinesprimarily using PySpark, SQL, and Python to ensure business teams (analysts, product managers, finance, operations) have access to well-modeled, actionable data. Youll work closely with stakeholders to translate business needs … into technical solutions, ensuring data is trusted, scalable, and production-grade. Unlike pure Data Engineers, youll be closer to the business, shaping analytics-ready datasets. Unlike pure Data Analysts, youll spend more time coding, managing data infrastructure, and ensuring pipeline reliability. Who Were Looking For Data Analytics : Analysts who have strong experience building and maintaining More ❯

AI Data & Python Tools Engineer We're seeking an AI Data and Python Tools Engineer to develop and deploy intelligent tools that leverage big data infrastructure and modern AI architecture. This role combines strong software engineering fundamentals with the ability to build production-ready AI applications at speed, including integration with Model Context Protocol (MCP) systems. … Responsibilities: Develop and deploy AI-powered full-stack applications using Python, React, and modern machine learning frameworks Design and streamline data pipelines, train and validate ML models, and implement robust evaluation methods Collaborate with cross-functional teams to solve complex problems and integrate scalable, cloud-based AI solutions Rapidly prototype, test, and iterate on AI tools with a strong … focus on performance, flexibility, and scalability Maintain clear technical documentation, perform code reviews, and support the full software development lifecycle Software Engineering & AI/ML Data, Tools Development Proficiency in Python, with a background in back end services and data processing Exposure to AI/ML algorithms Familiarity with ML frameworks (TensorFlow, PyTorch, scikit-learn) Understanding of LLMs More ❯

What we're all about. It isn't often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle serious criminal activity. Now, its potential is virtually limitless. Working at Quantexa isn't just intellectually stimulating. … you to join us. Opportunity Applications is an Engineering function within Quantexa's R&D department that is focused on internally building real-world applications of the Quantexa Platform. Data Engineers are focused on building the data infrastructure and processing capabilities that power Quantexa's platform and applications. This role encompasses two closely related teams working on the … foundational data layer of Quantexa's offerings: Data Engineering Accelerators Developing Quantexa's libraries for cleansing, parsing and standardising data used in entity resolution Finding efficiency/performance improvements through big data testing and building performance tooling Owning best practices in entity resolution and network building Data Feeds Building standardised and reusable code for More ❯

Job Title: Data Engineering Specialist About Us: We find strength in teamwork-a better you is a better us BLN24 is an award-winning Management Consulting Firm that supports the U.S. Federal Government in successfully achieving their mission and goals. Our service and solutions delivery start with understanding each client's end-state, and then seamlessly integrating within each … Agency's organization to improve and enhance strategic and technical operations and deployments. Job Description: BLN24 is seeking a highly skilled Data Engineering Specialist with demonstrated experience in developing data models for implementation in a data lake architecture. The ideal candidate will have a proven track record of successfully handling projects of similar size and scope. Key … Responsibilities: Design and develop data models for implementation in a data lake architecture. Collaborate with cross-functional teams to understand data requirements and translate them into effective data models. Ensure data models are optimized for performance and scalability. Implement and maintain data pipelines to support data lake architecture. Monitor and troubleshoot data More ❯

Data & Analytics Consultant HD-Tech is proud to be partnering with a leading data management and analytics consultancy that specialises in delivering transformative business insights using Microsoft technologies. With over 10 years of industry presence, our client is recognised for helping organisations optimise their use of data to drive smarter decisions and long-term value. As they … continue to scale their professional and managed services offerings, we’re now seeking a Data & Analytics Consultant to join their expanding consulting team. About the Company This organisation is deeply committed to helping businesses "predict their future" through better use of data, technology, people, and process . Their services include: Managed Data Services Database and Infrastructure Consultancy … Data Engineering & Analytics Adoption and Change Management Their reputation is built on strong consulting skills, deep expertise in Microsoft Data Services, and a highly collaborative culture. They place a premium on client engagement, commercial awareness, and internal collaboration to drive results. Role Overview As a Consultant, you will play a hands-on role in delivering client-facing analytics More ❯

Data & Analytics Consultant HD-Tech is proud to be partnering with a leading data management and analytics consultancy that specialises in delivering transformative business insights using Microsoft technologies. With over 10 years of industry presence, our client is recognised for helping organisations optimise their use of data to drive smarter decisions and long-term value. As they … continue to scale their professional and managed services offerings, we’re now seeking a Data & Analytics Consultant to join their expanding consulting team. About the Company This organisation is deeply committed to helping businesses "predict their future" through better use of data, technology, people, and process . Their services include: Managed Data Services Database and Infrastructure Consultancy … Data Engineering & Analytics Adoption and Change Management Their reputation is built on strong consulting skills, deep expertise in Microsoft Data Services, and a highly collaborative culture. They place a premium on client engagement, commercial awareness, and internal collaboration to drive results. Role Overview As a Consultant, you will play a hands-on role in delivering client-facing analytics More ❯

Lead Cloud Data Engineer – Liverpool – Hybrid - £70k A well-established professional services business that's modernising their data infrastructure and embracing cloud-first technologies are looking for a Lead Cloud Data Enigneer. Based Liverpool City Centre, they're investing significantly in their data capabilities to enhance client services, improve operational efficiency, and drive strategic decision-making … through advanced analytics and robust data management practices. The Role They're looking for an exceptional Lead Cloud Data Engineer to spearhead their data engineering initiatives and drive technical excellence across their cloud infrastructure. You'll be architecting sophisticated data solutions that power critical business operations whilst leading a talented team of engineers. This is an … outstanding opportunity for someone who's passionate about cutting-edge technology and wants to shape the future of enterprise data management. What's on offer: Up to £70k DOE Hybrid working from their Liverpool office – 3 days on site Opportunity to work with industry-leading cloud technologies Leadership role with genuine career progression prospects Collaborative environment with cross-functional More ❯

Senior Data & Analytics Consultant HD-Tech is proud to be partnering with a leading data management and analytics consultancy that specialises in delivering transformative business insights using Microsoft technologies. With over 10 years of industry presence, our client is recognised for helping organisations optimise their use of data to drive smarter decisions and long-term value. As … they continue to scale their professional and managed services offerings, we’re now seeking a Data & Analytics Consultant to join their expanding consulting team. About the Company This organisation is deeply committed to helping businesses "predict their future" through better use of data, technology, people, and process . Their services include: Managed Data Services Database and Infrastructure … Consultancy Data Engineering & Analytics Adoption and Change Management Their reputation is built on strong consulting skills, deep expertise in Microsoft Data Services, and a highly collaborative culture. They place a premium on client engagement, commercial awareness, and internal collaboration to drive results. Role Overview As a Consultant, you will play a hands-on role in delivering client-facing More ❯

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯

Manchester, Birmingham, Leeds, Blackpool 3–6 Months (with strong extension potential) We’re seeking a hands-on Test Lead to join a major public sector programme driving large-scale, data-led transformation. This role combines technical leadership with active delivery—you’ll be leading test strategy, managing a small team, and directly contributing to the testing of complex ETL … processes, data warehouses, and large-scale data systems. What You’ll Be Doing Leading and managing a test team: overseeing day-to-day activities, allocating work, and ensuring quality delivery across multiple streams. Providing mentorship and coaching to junior and mid-level testers, raising capability, and embedding best practices. Hands-on testing of Big Data, ETL … workflows, APIs, and UIs—personally executing test cases and validating data accuracy and transformations. Designing, building, and maintaining manual and automated test suites using tools like Playwright, Pytest, and Behave. Developing and managing comprehensive test plans, scripts, and reports, ensuring traceability back to requirements. Driving quality across Agile teams by reviewing user stories, defining test conditions, and ensuring both More ❯

Manchester, Birmingham, Leeds, Blackpool 3–6 Months (with strong extension potential) We’re seeking a hands-on Test Lead to join a major public sector programme driving large-scale, data-led transformation. This role combines technical leadership with active delivery—you’ll be leading test strategy, managing a small team, and directly contributing to the testing of complex ETL … processes, data warehouses, and large-scale data systems. What You’ll Be Doing Leading and managing a test team: overseeing day-to-day activities, allocating work, and ensuring quality delivery across multiple streams. Providing mentorship and coaching to junior and mid-level testers, raising capability, and embedding best practices. Hands-on testing of Big Data, ETL … workflows, APIs, and UIs—personally executing test cases and validating data accuracy and transformations. Designing, building, and maintaining manual and automated test suites using tools like Playwright, Pytest, and Behave. Developing and managing comprehensive test plans, scripts, and reports, ensuring traceability back to requirements. Driving quality across Agile teams by reviewing user stories, defining test conditions, and ensuring both More ❯

Manchester, Birmingham, Leeds, Blackpool 3–6 Months (with strong extension potential) We’re seeking a hands-on Test Lead to join a major public sector programme driving large-scale, data-led transformation. This role combines technical leadership with active delivery—you’ll be leading test strategy, managing a small team, and directly contributing to the testing of complex ETL … processes, data warehouses, and large-scale data systems. What You’ll Be Doing Leading and managing a test team: overseeing day-to-day activities, allocating work, and ensuring quality delivery across multiple streams. Providing mentorship and coaching to junior and mid-level testers, raising capability, and embedding best practices. Hands-on testing of Big Data, ETL … workflows, APIs, and UIs—personally executing test cases and validating data accuracy and transformations. Designing, building, and maintaining manual and automated test suites using tools like Playwright, Pytest, and Behave. Developing and managing comprehensive test plans, scripts, and reports, ensuring traceability back to requirements. Driving quality across Agile teams by reviewing user stories, defining test conditions, and ensuring both More ❯

Job Title: Data Pipeline Developer About Us: We find strength in teamwork-a better you is a better us BLN24 is an award-winning Management Consulting Firm that supports the U.S. Federal Government in successfully achieving their mission and goals. Our service and solutions delivery start with understanding each client's end-state, and then seamlessly integrating within each … Agency's organization to improve and enhance strategic and technical operations and deployments. Job Description: BLN24 is seeking a skilled Data Pipeline Developer with demonstrated experience in transforming and loading data into Databricks. The ideal candidate will have successfully completed at least two projects of similar size and scope. Key Responsibilities: Develop and maintain data pipelines to … transform and load data into Databricks. Collaborate with data engineers, analysts, and other stakeholders to understand data requirements and ensure seamless data integration. Optimize data pipelines for performance, scalability, and reliability. Monitor and troubleshoot data pipeline issues to ensure data integrity and availability. Implement best practices for data pipeline development and maintenance. More ❯

Senior Data Scientist Location: Bethesda MD Work Type: Onsite Remote Work: NO Job Description Are you a curious intrinsically motivated person looking to work in an entrepreneurial IC office? If so, Gridiron IT is seeking an experienced Senior Data Scientist to join our innovative analytics team. The ideal candidate will have a strong background in multi-cloud environments … machine learning, and scalable data solutions, with the ability to design and implement cutting-edge analytics capabilities. Responsibilities Design and implement data science frameworks across multi-cloud environments Develop machine learning models for data analysis and automation, including building RAG models for AWS Bedrock Automate analytic solutions and build scalable analytics capabilities Collaborate with the Mission team … to gather requirements across various teams Assess and implement new technologies and tools to enhance data capabilities Support data webforms (SQL databases) and processes for API connections, including drag-and-drop data functionality Lead complex data science projects from conception to implementation Develop real-time data processing solutions and data solutions at scale Integrate More ❯

Data Engineer (AWS) Falls Church, VA Hybrid Secret Clearance 3-Month Contract Why This Role Rocks Work on a mission-critical DoD project using AWS, Kubernetes, and big data tools. Join a fast-moving Agile DevSecOps team that builds secure, scalable data platforms-and get paid weekly. What You'll Do Build OpenAPI-compliant APIs, data … to delivery Tech You'll Touch AWS Python FastAPI Node.js React Terraform Apache Airflow Trino Spark Hadoop Kubernetes You Have Active Secret Clearance 3+ years in Agile, cloud-based data engineering Experience with API design, ORM + SQL, AWS data services Bonus: AI/ML, big data, microservices Perks & Benefits 401K w/100% match up … to 6% Generous PTO + Weekly Pay Health/Dental/Vision/Life Home office allowance Paid certifications Fitness membership Apply today and help shape secure, scalable data solutions for national defense. More ❯

Reports to: Team Leader, Analytics, Claims and Underwriting Solutions (International) Location: London/Hybrid Business Description Verisk Analytics is a multinational data and analytics risk assessment company and a leading source of information about insurance risk. To serve our clients, we draw upon our vast experience in data management and predictive modelling to offer decision analytics to the … residential and commercial property perils, motor insurance, SME business covers, travel, pet and health insurance. To feed our risk models we source many diverse datasets covering high resolution weather data, property attributes, business activities and financial data, insurance claims and policies, medical information, aerial imagery and geodemographic data. In claims solutions we support end-to-end claims handling … real-time fraud analysis and image forensics we help detect fraud at every stage of the claim and manage cases more effectively. Role Purpose Verisk are looking for a Data Scientist to support the development of various data science models to support the development of our risk management products. The International Analytics Team is a dynamic and exciting More ❯

Data Engineer - Generative AI & Secure Data Platforms Hybrid Working | UK-Based | SC Clearance Up to £60k + Paid Overtime + Bonus + Benefits Engineer the Future of Secure AI Innovation Are you ready to use your data engineering skills to build secure, intelligent platforms that power generative AI and national resilience? This is a hands-on opportunity … to join a high-impact, high-trust organisation working on next-gen data platforms. You'll be part of a collaborative international team, helping internal customers unlock the full potential of their data securely and intelligently. What You'll Be Doing Design, deploy, and maintain resilient data pipelines across on-prem and cloud environments Collaborate with internal … teams to optimise and secure sensitive data-sets Ensure compliance with strict data governance and quality standards Contribute to the technology roadmap with insights into emerging tools and platforms Work across SQL, NoSQL, Python, ETL, and big data ecosystems Support projects involving Generative AI, NLP, and OCR What You'll Bring Proven experience in on-prem More ❯

Data Engineer £45,000 - 55,000 GBP + Package Hybrid WORKING Location: Stevenage, Central London, Greater London - United Kingdom Type: Permanent Data Engineer - Generative AI Focus Location: Stevenage or Bolton (Stevenage preferred) Salary: £45,000 to £55,000 depending on experience Working Pattern: Hybrid, 2 to 3 days on-site per week Overview: A new opportunity has opened … for a Data Engineer to join a newly formed Generative AI delivery office. This role involves evaluating, designing, deploying, and supporting internal data sets, ensuring they are secure, resilient, and optimised for internal customer needs. Key Responsibilities: Build and maintain robust data pipelines and data sets Collaborate with internal stakeholders to optimise data usage and … security Ensure compliance with data governance and quality standards Contribute to the technology roadmap and deliver innovative solutions Stay current with emerging technologies in AI and data engineering Technical Skills Required: SQL technologies (e.g. MS SQL, Oracle) NoSQL technologies (e.g. MongoDB, InfluxDB, Neo4J) Data exchange and processing tools (ETL, ESB, API) Programming experience (Python or similar) Big More ❯