1 to 25 of 171 Big Data Jobs

Title: Senior Data Engineer (GCP, Big Data, Data Warehousing) Overview/Summary: We are seeking a Senior Data Engineer responsible for designing, building, and maintaining scalable data solutions, including infrastructure and pipelines, to support efficient data collection, storage, processing, and analysis of large … datasets. Key Responsibilities: Collaborate with business and technology stakeholders to understand data requirements Design, build, and maintain scalable data infrastructure for data collection, storage, transformation, and analysis Develop and maintain data pipelines, data models, and data applications for reliable workflows Design and manage data ...

frameworks. About the Role We are looking for an experienced Test Manager to lead quality assurance and testing activities within a large-scale cloud data engineering programme operating across a modern AWS-native technology ecosystem, including Apache Airflow, Amazon Athena, AWS Glue, S3, EMR, DynamoDB, and related cloud services. … hands-on technical leadership with test strategy ownership . You will be responsible for defining and driving the overall testing approach across automated pipelines, data workflows, cloud infrastructure, and release delivery while managing risks, improving testing standards, and mentoring engineering teams. The ideal candidate will have strong experience ...

Overview Shaping a smarter, more agile world! AtkinsRéalis is growing its Solution Design team and is looking for Data Architects who are curious, who want to become part of our customers' digital journey and who want to have a voice in shaping our future digital world. Is this … looking to expand our multi‐disciplinary team with people from diverse backgrounds who bring data architecture expertise to the digital transformation of our stakeholders' technology landscapes and ways of working. You may currently be a data architect, data engineer, analytics consultant, solution architect or enterprise architect seeking ...

Stackable is an innovative technology company focused on delivering cutting-edge, opensource Big Data solutions for data lakehouses, data mesh, event processing and AI. We specialise in designing, deploying, and managing scalable datainfrastructures that empower businesses to harness the power of data effectively. Our core … product, the Stackable Data Platform, enables companies of all sizes to easily integrate and manage their sovereign data platforms in their respective IT infrastructure. We are looking for a skilled Solutions Architect with a strong background in Big Data to joinour team. The ideal candidate will ...

Data Architect Department: [SBSS] Enterprise Data Management Employment Type: Permanent - Full Time Location: Bristol Compensation: Up to £88,000/year Description Somerset Bridge Group is one of the UK’s fastest‐growing insurance businesses, supporting brands such as GoSkippy and Vavista. With offices in Bristol, Newcastle … growth, we’re dedicated to making a positive impact, having planted more than 419,000 trees through our environmental partnership with Vavista. As a Data Architect at Somerset Bridge Group, you’ll play a key role in shaping how data is designed, managed and used across the business. ...

Data Architect Department: [SBSS] Enterprise Data Management Employment Type: Permanent - Full Time Location: Newcastle Compensation: Up to £88,000/year Description Somerset Bridge Group is one of the UK’s fastest‐growing insurance businesses, supporting brands such as GoSkippy and Vavista. With offices in Bristol, Newcastle … growth, we’re dedicated to making a positive impact, having planted more than 419,000 trees through our environmental partnership with Vavista. As a Data Architect at Somerset Bridge Group, you’ll play a key role in shaping how data is designed, managed and used across the business. ...

week Department: IT Type: 3-month rolling contract Outside IR35 Position: Analytics Engineer The organisation is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven … decision-making. Key Responsibilities Design and build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including ...

possibility. Our customers include leading innovators in Aerospace & Defense, Materials, Energy, Semiconductors, and Automotive. The Role PhysicsX is building a platform that enables Data Scientists and Simulation Engineers to build, train, and deploy Deep Physics Models. The platform handles massive volumes of complex simulation data and enables high … fidelity multi-physics simulation through AI inference. We're looking for a Senior Software Engineer with a strong background in building data platforms. You won't just be moving data from A to B - you'll be architecting and building the distributed systems, services, and APIs that form ...

Summary The Senior Data Architect will provide strategic and technical leadership in key areas of data management for Southern Company including: Data analysis Design and modeling Database management expertise Data quality and security management Creation/maintenance of data dictionaries and meta-data registries … Senior Data Architect should have a proven record of working with both business and technical groups as well as moving into new technology areas and quickly mastering skills and knowledge required to administer, support, configure, consult, and build solutions within the framework. This position requires 4 on-site days ...

insights for advertisers while meeting the operational and analytical needs of internal business teams. We work closely with Product Managers, Ad Sales, Ad Operations, Data Science, and multiple other software teams within the Advertising Engineering organization to deliver high‐impact solutions. Looking ahead, we are exploring AI‐driven measurement … seeking a highly skilled Senior Software Engineer with deep expertise in API Development using Spring Boot and knowledge of Apache Spark‐based Big Data pipelines using Airflow. This hybrid position bridges software engineering and data engineering, requiring the ability to design, build, and maintain scalable systems ...

insights for advertisers while meeting the operational and analytical needs of internal business teams. We work closely with Product Managers, Ad Sales, Ad Operations, Data Science, and multiple other software teams within the Advertising Engineering organization to deliver high‐impact solutions. Looking ahead, we are exploring AI‐driven measurement … seeking a highly skilled Senior Software Engineer with deep expertise in API Development using Spring Boot and knowledge of Apache Spark‐based Big Data pipelines using Airflow. This hybrid position bridges software engineering and data engineering, requiring the ability to design, build, and maintain scalable systems ...

Data Architect £Up to £90,000 GBP Bonus Hybrid WORKING Location: London; Manchester; Bristol, Central London, Greater London - United Kingdom Type: Permanent Data Architect London, Bristol or Manchester | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised as one of Fortune's World … Most Admired Companies , delivering complex transformation programmes across public and private sector environments. The focus is on helping organisations modernise their data landscape through scalable architecture, cloud platforms, and robust engineering practices. [accenture.com] , [linkedin.com] Joining as a Data Architect means taking ownership of end-to-end data ...

Data Architect £Up to £90,000 GBP Bonus Hybrid WORKING Location: London; Manchester; Bristol, Central London, Greater London - United Kingdom Type: Permanent Data Architect London, Bristol or Manchester | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised as one of Fortune's World … Most Admired Companies , delivering complex transformation programmes across public and private sector environments. The focus is on helping organisations modernise their data landscape through scalable architecture, cloud platforms, and robust engineering practices. [accenture.com] , [linkedin.com] Joining as a Data Architect means taking ownership of end-to-end data ...

Data Architect £Up to £90,000 GBP Bonus Hybrid WORKING Location: London; Manchester; Bristol, Central London, Greater London - United Kingdom Type: Permanent Data Architect London, Bristol or Manchester | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised as one of Fortune's World … Most Admired Companies , delivering complex transformation programmes across public and private sector environments. The focus is on helping organisations modernise their data landscape through scalable architecture, cloud platforms, and robust engineering practices. [accenture.com] , [linkedin.com] Joining as a Data Architect means taking ownership of end-to-end data ...

Titel: Data Engineer Location: Berkeley Heights, NJ Job Description: We are seeking a highly skilled resource to design and implement high-performance, event-driven data pipelines, ensuring low-latency data processing and high availability system for the large credit card processing system. The ideal candidate will work … with the Ab Initio ecosystem (GDE, EME, Conduct>It) to build stateful services that ingest, filter, and transform data from sources like Kafka or message queues, pushing updates to dashboards or downstream databases in near-real-time. Key Responsibilities: Create complex Ab Initio continuous flow graphs, including stateful joins ...

Hiring on behalf of a multi-strategy, multi-manager hedge fund is looking for a Data Architecture Lead to join their team. The firm trades globally across multiple asset classes and investment approaches. The primary focus of this role will be on the buildout and operations of a next … generation security master system. In addition to designing and implementing robust data architectures. The successful candidate will lead the security master development team, overseeing the quality, performance, and scalability of the teams’ deliverables. Key Responsibilities – Data Architecture and Design: Lead the design and implementation of the enterprise data ...

resilient services used by millions across the UK. The Driver and Vehicle Licensing Agency (DVLA), in partnership with Inspire People, is hiring a Lead Data Engineer with strong SQL and Python expertise, experience across modern cloud data platforms including Databricks, Apache Spark and lakehouse architectures, and a proven … ability to design, build and lead delivery of reliable data products. This is a permanent role based in Swansea, working in a hybrid model (minimum 60% office-based in Swansea), with a salary of £57,515 - £82,430 plus 29% employer pension contribution and excellent Civil Service benefits. Shape ...

powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Data Engineer Senior Consultant – Job Specification Location: Belfast or Derry/Londonderry Position Overview We are seeking a highly skilled Data Engineer Senior Consultant … with hands-on experience designing, building, and optimizing data solutions that enable advanced analytics and AI-driven business transformation. This role requires expertise in modern data engineering practices, cloud platforms, and the ability to deliver robust, scalable data pipelines for diverse business domains such as finance, supply ...

Data & AI Engineer - Up to £50,000 Location: Newcastle - Hybrid Security Clearance: UK SC eligibility required The Opportunity We are supporting a leading organisation within the Technology and Data space that deliver technology-enabled transformations. This team specialises in building modern, data-driven solutions that enable better … decision-making, automation, and innovation. This role is ideal for a Data Engineer or AI Engineer who enjoys working across the full data lifecycle and wants to build practical, scalable solutions using modern data and AI technologies. The Role As a Data & AI Engineer, you will ...

Data & AI Engineer - Up to £40,000 Location: Belfast (Hybrid Working) Security Clearance: UK SC eligibility required The Opportunity We are supporting a leading organisation within the Technology and Data space that deliver large-scale, technology-enabled transformations. This team specialises in building modern, data-driven solutions … that enable better decision-making, automation, and innovation. This role is ideal for a Data Engineer or AI Engineer who enjoys working across the full data lifecycle and wants to build practical, scalable solutions using modern data and AI technologies. The Role As a Data ...

Data & AI Engineer - Up to £50,000 Location: Newcastle or Manchester - Hybrid Security Clearance: UK SC eligibility required The Opportunity We are supporting a leading organisation within the Technology and Data space that deliver large-scale, technology-enabled transformations. This team specialises in building modern, data-driven … solutions that enable better decision-making, automation, and innovation. This role is ideal for a Data Engineer or AI Engineer who enjoys working across the full data lifecycle and wants to build practical, scalable solutions using modern data and AI technologies. The Role As a Data ...

identity trust infrastructure for the digital economy — verifying 100% of good identities in real time and stopping fraud before it starts. The mission is big, the problems are complex, and the impact is felt by businesses, governments, and millions of people every day. We hire people who want that … want to help build the future of identity with a team that holds a high bar for itself — keep reading. About the Role The Big Data R&D team develops cutting‐edge big data and graph‐based solutions for entity search, entity resolution, and identity matching ...

Role: Data & ML Architect Location: Newcastle Upon Tyne Levels: Associate Manager Please Note: Due to the nature of client work you will be undertaking, you will need to be willing to go through a Security Clearance (Including BPSS) process as part of this role, which requires 5+ years … with cutting-edge technologies and will have the opportunity to develop a wide range of new skills on the job. Role Overview As a Data & ML Architect, you will lead the design and architecture of scalable, enterprise-grade data platforms and advanced machine learning solutions. You will define ...

Data & AI Engineer - Up to £50,000 Location: Newcastle or Manchester - Hybrid Security Clearance: UK SC eligibility required The Opportunity We are supporting a leading organisation within the Technology and Data space that deliver large-scale, technology-enabled transformations. This team specialises in building modern, data-driven … solutions that enable better decision-making, automation, and innovation. This role is ideal for a Data Engineer or AI Engineer who enjoys working across the full data lifecycle and wants to build practical, scalable solutions using modern data and AI technologies. The Role As a Data ...

Data & AI Engineer - Up to £50,000 Location: Newcastle or Manchester - Hybrid Security Clearance: UK SC eligibility required The Opportunity We are supporting a leading organisation within the Technology and Data space that deliver large-scale, technology-enabled transformations. This team specialises in building modern, data-driven … solutions that enable better decision-making, automation, and innovation. This role is ideal for a Data Engineer or AI Engineer who enjoys working across the full data lifecycle and wants to build practical, scalable solutions using modern data and AI technologies. The Role As a Data ...