1 to 25 of 364 Big Data Jobs

TO CORP) WITH 3RD PARTY WORK AUTHORIZATION: US CITZ or GC,GC - EAD,H4 & L2 EAD, NO H1B & OPT/CPT ACCEPTED BY CLIENT RATE: $OPEN - DOE JOB TITLE: Data Engineer Big Data Hadoop JOB DESCR: Candidates will start out REMOTE WORK and then will eventually be sitting in Frt. Lauderdale, FL. Candidates should be senior Data Engineers with big data tools (Hadoop, Spark, Kafka) as well as AWS (cloud services: EC2, EMR, RDS, Redshift) and NOSQL. This is a phone and Skype to hire. Candidates in Florida with a LinkedIn profile preferred but not required. Essential Duties and Responsibilities: • Past experience in executing and delivering solutions in an Agile scrum development environment is … preferred • Produce deliverables with little oversight or management assistance • Assemble large, complex data sets that meet functional/non-functional business requirements • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide More ❯

BIG DATA ENGINEER - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A BIG DATA ENGINEER WITH DV CLEARANCE Permanent job opportunity for a Big Data Engineer Leading National Security & Defence SME Salary up to £80,000 plus clearance bonus London based organisation in an easily accessible location To … apply please call or email WHO WE ARE? We are recruiting multiple Big Data Engineers to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold DV or enhanced DV Security Clearance. WHAT WILL THE BIG DATA ENGINEER BE DOING? You will be joining a leading SME who … is working hard to support National Security projects within UK Govt. Departments in London. As part of a team, you will be responsible for implementing Big Data Solutions in Mission-Critical areas. WE NEED THE BIG DATA ENGINEER TO HAVE.... Current DV clearance - Standard or Enhanced Must have experience with big data tools such More ❯

Move to Skip to Content Link Select how often (in days) to receive an alert: Select how often (in days) to receive an alert: FS Technology Consulting - AI and Data - Data Architect - Manager - Dublin Location: Dublin 2 Other locations: Primary Location Only Date: Sep 16, 2025 Requisition ID: At EY, we're all in to shape your future … powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. FS Technology Consulting - AI and Data - Data Architect - Manager - Dublin General Information Location: Dublin Available for VISA Sponsorship: Yes Business Area: Data & Analytics Contract Type: Full Time - Permanent EY is the only major … deliver long-term value to clients, people, and society. It is inspired by the way innovations spread through society. We are actively recruiting high achieving individuals with AI and Data expertise in data-enabled transformation projects/programmes within Financial Services: Banking, Insurance and Wealth and Asset management. We are looking for people with strong Data related More ❯

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working … with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules More ❯

We have an exciting job opportunity for role Senior Data Engineer based in London, UK (Hybrid) Job Type : Contract (Inside IR 35) Note: Active SC Clearence needed Job Description: Job Summary: We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure … Databricks platform for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud … computing (specifically Azure), and experience working with large datasets . Key Responsibilities: Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement More ❯

CONTRACT DATA ENGINEER - eDV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Data Engineer National Security client Palantir Foundry Outside IR35 Central London based organisation in an easily accessible location To apply please call/or email WHO WE ARE … We are recruiting a contract Data Engineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATA ENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Experience With Palantir … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply by More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or email WHO WE … ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security projects within UK Govt. Departments … in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience of achieving data interoperability between More ❯

Data Architect - Zurich Insurance Locations: Fareham, Swindon, Farnbrough or London. Working hours: Part time, job share or full time. Salary: Attractive salary and benefits package. Closing date for applications: 17th November 2025. Opportunity As an insurance company, Zurich understands that data is the biggest asset we have. It is our passion to build innovative, comprehensive data solutions … across the organisation. The central Data Architecture team sits at the heart of the business, delivering end to end data lifecycles and strategic data direction. We are looking for a motivated Data Architect who can translate business requirements into scalable, secure data solutions. Responsibilities Model best practice for data across the organisation. Embed a … data led culture at the heart of the business. Operate as a Data Solutions Architect, driving design and implementation of data strategies. Build and maintain strong relationships across the UK and Group to learn and influence. Translate business needs into robust, effective solutions across domains and teams. Develop and maintain reference architecture to optimise ingestion, storage, processing More ❯

of the largest geospatial businesses in the UK. The new division provides a compelling capability that covers the full geospatial lifecycle, from strategy and consultancy to powerful software and data as a service. Geospatial data significantly underpins the division’s current and future revenues. Within the Division’s Data & Research Team, the Data Engineer role is … responsible for designing, building and optimising our data pipelines and infrastructure, ensuring that the curation, delivery and value added use of our geospatial data catalogue is undertaken to a high quality. Working with the 3 sub teams of Research & Innovation, Data Delivery and Data Management you will ensure we provide quality assured data products and … services to our customers, maximising the potential for automation of our data pipelines, contributing to the development of new and existing data products and services and supporting our research and innovation projects. Continuous improvement is key to our success and you will directly contribute to the enhancement of our systems and processes as well as the adoption of More ❯

Product Manager – Data & Data Science Remote (UK) Up to £90,000 + Benefits About the Company Our client is an award-winning search intelligence platform that helps global brands, marketers, and agencies gain an unparalleled understanding of the paid search landscape. Powered by patented AI technology, they enable clients to optimise spend, increase ROI, and stay ahead of … partner, they’ve been redefining search intelligence for over a decade. In 2024, they secured multiple industry awards including Best AI Search Software Solution , Best Use of AI for Data , and Best PPC Management Software Suite . You’ll be joining a business that combines the maturity and stability of an established company with the agility, autonomy, and growth … on a strong, people-first culture with a 93% approval rating and high employee satisfaction. About the Role You’ll join the Product function, working alongside leading AI and data specialists. The team is focused on delivering innovative, data-driven products that make a measurable difference to customers and the business. As the Product Manager for the Data More ❯

Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead … Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are … seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge technologies, architecting big data solutions and developing More ❯

The Global Director of Data and Information will be responsible for developing and executing a comprehensive data and information strategy that aligns with the organisation’s business goals. You will; help the organisation gain the benefit from the data within our business systems. identify and exploit opportunities to integrate operational and telemetry data into our Business … Intelligence ensure the organisation adheres to the key principles of information management, particularly Accountability, Integrity, Compliance and Usability. This role involves leading data governance, analytics, and data management initiatives, ensuring that data is effectively utilized to drive strategic decision-making across the organisation. The ideal candidate will possess strong leadership skills, a deep understanding of data architecture, and a proven ability to leverage data for business insights. Key Responsibilities: Strategy Development : Define and implement a global andData and Information strategy that aligns with the organisation’s overall objectives and priorities, considering and anticipating future scalability and compliance requirements. Team Management : Recruit, mentor, and develop a high-performing data team, promoting a culture of More ❯

The Global Director of Data and Information will be responsible for developing and executing a comprehensive data and information strategy that aligns with the organisation’s business goals. You will; help the organisation gain the benefit from the data within our business systems. identify and exploit opportunities to integrate operational and telemetry data into our Business … Intelligence ensure the organisation adheres to the key principles of information management, particularly Accountability, Integrity, Compliance and Usability. This role involves leading data governance, analytics, and data management initiatives, ensuring that data is effectively utilized to drive strategic decision-making across the organisation. The ideal candidate will possess strong leadership skills, a deep understanding of data architecture, and a proven ability to leverage data for business insights. Key Responsibilities: Strategy Development : Define and implement a global andData and Information strategy that aligns with the organisation’s overall objectives and priorities, considering and anticipating future scalability and compliance requirements. Team Management : Recruit, mentor, and develop a high-performing data team, promoting a culture of More ❯

Job title Data Governance Analyst Ref 39460 Division Digital Location Hybrid - Clearwater Court - RG1 8DB Contract type Permanent Full/Part-time Full-time Hours 36 Hours per week. Salary Competitive salary between £47,000 and £71,000 per annum, depending on experience. Job grade B Closing date 11/11/2025 As a Data Governance Analyst … you will support the Data Governance Manager in implementing and maintaining the organisation's data governance framework. Your role will involve ensuring data quality, consistency, and compliance across various data domains. You will work closely with data owners, data stewards, the Records & Retention Officer, and IT teams to enforce data governance policies and … procedures and support Master Data Management (MDM) and Records Management initiatives. What you'll be doing as a Data Governance Analyst Assist in developing and articulating the organisation's data governance vision, strategy, and roadmap. Support the activation and enforcement of the data governance program vision. Collaborate with various stakeholders, including IT teams, business units, data More ❯

For this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer requirements Previous experience with the preparation of high-quality engaging … the offer solution team, solution definition, effort and cost estimation, Past experience in dealing with partners, tools vendors, etc. Business Domain Knowledge More than 5 years of experience in Big Data implementation projects Experience in the definition of Big Data architecture with different tools and environments: Cloud (AWS, Azure and GCP), Cloudera, No-sql databases (Cassandra … Mongo DB), ELK, Kafka, Snowflake, etc. Past experience in Data Engineering and data quality tools (Informatica, Talend, etc.) Previous involvement in working in a Multilanguage and multicultural environment Proactive, tech passionate and highly motivated Desirable requirements: Experience in Data analysis and visualization solutions: Microstrategy, Qlik, PowerBI, Tableau, Looker,... Background in Data Governance and Data More ❯

Overview stackable - who are we? Stackable is an innovative technology company focused on delivering cutting-edge, opensource Big Data solutions for data lakehouses, data mesh, event processing and AI. We specialise in designing, deploying, and managing scalable datainfrastructures that empower businesses to harness the power of data effectively. Our core product, the Stackable Data Platform, enables companies of all sizes to easily integrate and manage their sovereign data platforms in their respective IT infrastructure. Your mission at stackable: We are looking for a skilled Solutions Architect with a strong background in Big Data to join our team. The ideal candidate will have expertise in open source Big Data technologies and Kubernetes and DevOps practices . This role will be instrumental in designing, implementing, and optimizing cloud-based and on-premise data solutions for our clients. Responsibilities You will architect and implement Stackable Data Platform solutions , ensuring scalability, reliability, and security. You will develop and maintain Kubernetes-based infrastructures to support data processing and analytics More ❯

dynamic organization allows you to work across functional business pillars, contributing your ideas, experiences, diverse thinking, and a strong mindset. Are you ready? About your team Join our growing Data & Analytics practice and make a difference. In this practice you will be utilizing the most innovative technological solutions in modern data ecosystem. In this role you'll be … able to see your own ideas transform into breakthrough results in the areas of Data & Analytics strategy, Management & Governance, Data Integration & engineering, Analytics & Data science. About your role The ideal candidate will have extensive experience in designing and implementing data architectures, with a strong understanding of database management, data modelling, and data governance. This … thinker with strong analytical and problem-solving skills and the ability to work collaboratively with clients and cross-functional teams. Have experience in gathering, validating, synthesizing, documenting, and communicating data and information for a range of audiences, particularly audiences that are not technical. Design and implement robust scalable, secure, optimised data solutions that support business requirements and strategic More ❯

Position: Analytics Engineer Location: London (hybrid 3 times a week)Department: ITType: 3 months rolling contractOutside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. Key Responsibilities Design and … build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high experience … within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and supporting architects and engineers. To work independently and to manage multiple data More ❯

Analytics Engineer Location: London (hybrid 3 times a week) Department: IT Type: 3 months rolling contract Outside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. Key Responsibilities Design … and build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high … experience within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and supporting architects and engineers. To work independently and to manage multiple data More ❯

We are looking for an experienced Data Engineer with broad technical skills and ability to work with large amounts of data. You will collaborate with the Game and Product[1] teams to implement data strategies and develop complex ETL pipelines that support dashboards for promoting deeper understanding of our games. You will have experience developing and establishing scalable … efficient, automated processes for large-scale data analyses. You will also stay informed of the latest trends and research on all aspects of data engineering and analytics. You will work with leaders from an internal Game Studio, providing them with data for understanding game and player insights and report to the Technical Lead for this group. This … is a hybrid role based in our Southam office. Key Responsibilities: ● As a Data Engineer you will be involved in the entire development life cycle, from brainstorming ideas to implementing elegant solutions to obtain data insights. ● You will gather requirements, model and design solutions to support product analytics, business analytics and advance data science ● Design efficient and More ❯

We are looking for an experienced Data Engineer with broad technical skills and ability to work with large amounts of data. You will collaborate with the Game and Product[1] teams to implement data strategies and develop complex ETL pipelines that support dashboards for promoting deeper understanding of our games. You will have experience developing and establishing scalable … efficient, automated processes for large-scale data analyses. You will also stay informed of the latest trends and research on all aspects of data engineering and analytics. You will work with leaders from an internal Game Studio, providing them with data for understanding game and player insights and report to the Technical Lead for this group. This … is a hybrid role based in our Southam office. Key Responsibilities: ● As a Data Engineer you will be involved in the entire development life cycle, from brainstorming ideas to implementing elegant solutions to obtain data insights. ● You will gather requirements, model and design solutions to support product analytics, business analytics and advance data science ● Design efficient and More ❯

business pillars, contributing your ideas, experiences, diverse thinking, and a strong mindset. Are you ready? About your role The ideal candidate will have extensive experience in designing and implementing data architectures, with a strong understanding of database management, data modelling, and data governance. This role requires a strategic thinker with strong analytical and problem-solving skills and … with clients and cross-functional teams. You Have a broad business skill set including stakeholder management, problem-solving, and resilience Have experience in gathering, validating, synthesizing, documenting, and communicating data and information for a range of audiences, particularly audiences that are not technical. Are willing to travel forproject-related work. Design and implement robust scalable, secure, optimised data solutions that support business requirements and strategic goals. Evaluate the client's existing data estate, can diagnose underlying issues, and propose potential solutions. Collaborate with clients to understand their data needs and provide expert advice on data management and architecture. Develop data models, data flow diagrams, and data dictionaries. Oversee the ingestion and More ❯

Data/AI Enterprise Architect Washington, DC - 100% ONSITE US citizenship required per government contract Must be able to obtain Public Trust ALTA IT Services is in search of a candidate who has deep knowledge of enterprise architecture principles, AI technologies, and data management practices to guide decision-making and ensure that the architecture supports business objectives and … enhances operational capabilities. Key Responsibilities: • Design and develop end-to-end AI and data architectures that support business goals, ensuring scalability, performance, security, and maintainability. • Create architectural blueprints and roadmaps that guide the integration of AI and data solutions across the organization. • Lead the development and implementation of data platforms and AI-driven systems that facilitate advanced … units, ensuring alignment with business objectives. • Oversee the deployment and integration of AI models, tools, and technologies into production systems. • Design and implement scalable cloud-based and on-premises data architectures using platforms like Azure, AWS, or Google Cloud. • Work with big data technologies (e.g., Hadoop, Spark) and data lake architectures to ensure the organization's More ❯

Job Title: Data Engineer Location: Plano TxExperience: 12-15MOH : W2 Note onl w2 Job Summary: We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will work closely with data analysts, data scientists, and business teams to ensure data is reliable, accessible, and … optimized for analytics and reporting. Key Responsibilities: Design, develop, and maintain ETL/ELT data pipelines for large-scale data processing. Build and manage data models, data warehouses, and data lakesIntegrate data from multiple sources (databases, APIs, streaming platformsEnsure data quality, consistency, and reliability across all systems.Collaborate with analytics and engineering teams to … optimize data workflows. Monitor and improve data pipeline performance and scalability.Maintain documentation for data architecture and workflows. Required Skills & Qualifications: Bachelors degree in Computer Science, Information Technology, or related fieldStrong proficiency in SQL and data modeling concepts.Experience with ETL tools (Informatica, Talend, Apache Airflow, or similar)Hands-on experience with Python or Scala for data More ❯

This is a full-time hybrid role for a Data Architect in our Data & AI Practice at OpenSky Data Systems in Naas. You will be working on the latest Microsoft Data & AI technologies at the forefront of technological development (Fabric, Azure OpenAI, AI Studio & Cognitive Services, etc). We are working closely with our colleagues in … offer clear career progression paths, ensuring our team members have opportunities to advance their careers, develop new skills, and grow into leadership roles. Whether it's honing expertise in Data & AI technologies, or taking on strategic responsibilities, we help you shape your career in the way that aligns with your aspirations. Our Data & AI Practice OpenSky Data … customers across Ireland, UK, Europe, and the United States. We have multi-disciplinary teams working across our 3 Centres of Excellence, Modern Applications (.NET), Microsoft Cloud (Power Platform), and Data & AI. We deliver projects that matter, whether it is working to reduce HPV cancer in Europe or reducing homelessness in Ireland, our projects create a positive impact on others. More ❯