1 to 25 of 580 Big Data Jobs

TO CORP) WITH 3RD PARTY WORK AUTHORIZATION: US CITZ or GC,GC - EAD,H4 & L2 EAD, NO H1B & OPT/CPT ACCEPTED BY CLIENT RATE: $OPEN - DOE JOB TITLE: Data Engineer Big Data Hadoop JOB DESCR: Candidates will start out REMOTE WORK and then will eventually be sitting in Frt. Lauderdale, FL. Candidates should be senior Data Engineers with big data tools (Hadoop, Spark, Kafka) as well as AWS (cloud services: EC2, EMR, RDS, Redshift) and NOSQL. This is a phone and Skype to hire. Candidates in Florida with a LinkedIn profile preferred but not required. Essential Duties and Responsibilities: • Past experience in executing and delivering solutions in an Agile scrum development environment is … preferred • Produce deliverables with little oversight or management assistance • Assemble large, complex data sets that meet functional/non-functional business requirements • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide More ❯

BIG DATA ENGINEER - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A BIG DATA ENGINEER WITH DV CLEARANCE Permanent job opportunity for a Big Data Engineer Leading National Security & Defence SME Salary up to £80,000 plus clearance bonus London based organisation in an easily accessible location To … apply please call or email WHO WE ARE? We are recruiting multiple Big Data Engineers to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold DV or enhanced DV Security Clearance. WHAT WILL THE BIG DATA ENGINEER BE DOING? You will be joining a leading SME who … is working hard to support National Security projects within UK Govt. Departments in London. As part of a team, you will be responsible for implementing Big Data Solutions in Mission-Critical areas. WE NEED THE BIG DATA ENGINEER TO HAVE.... Current DV clearance - Standard or Enhanced Must have experience with big data tools such More ❯

Junior Big Data Developer (Python & SQL Focus) 📊 !!! URGENT HIRING !!! Looking for London based Citizens/Dependents ***We DO NOT provide SPONSORSHIP*** We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data processing, strong proficiency in Python , and expert skills in SQL . You'll focus on building, testing, and maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to integrate data from … various sources into our data warehouse or data lake. Data Transformation with Python: Write, optimize, and maintain production-grade Python scripts to clean, transform, aggregate, and process large volumes of data. Database Interaction (SQL): Develop complex, high-performance SQL queries (DDL/DML) for data extraction, manipulation, and validation within relational and data warehousing environments. More ❯

Junior Big Data Developer (Python & SQL Focus) 📊 !!! URGENT HIRING !!! Looking for London based Citizens/Dependents ***We DO NOT provide SPONSORSHIP*** We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data processing, strong proficiency in Python , and expert skills in SQL . You'll focus on building, testing, and maintaining data pipelines and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to integrate data from … various sources into our data warehouse or data lake. Data Transformation with Python: Write, optimize, and maintain production-grade Python scripts to clean, transform, aggregate, and process large volumes of data. Database Interaction (SQL): Develop complex, high-performance SQL queries (DDL/DML) for data extraction, manipulation, and validation within relational and data warehousing environments. More ❯

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working … with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules More ❯

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working … with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules More ❯

CONTRACT DATA ENGINEER - eDV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Data Engineer National Security client Palantir Foundry Outside IR35 Central London based organisation in an easily accessible location To apply please call/or email WHO WE ARE … We are recruiting a contract Data Engineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATA ENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Experience With Palantir … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply by More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or email WHO WE … ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security projects within UK Govt. Departments … in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience of achieving data interoperability between More ❯

of the largest geospatial businesses in the UK. The new division provides a compelling capability that covers the full geospatial lifecycle, from strategy and consultancy to powerful software and data as a service. Geospatial data significantly underpins the division’s current and future revenues. Within the Division’s Data & Research Team, the Data Engineer role is … responsible for designing, building and optimising our data pipelines and infrastructure, ensuring that the curation, delivery and value added use of our geospatial data catalogue is undertaken to a high quality. Working with the 3 sub teams of Research & Innovation, Data Delivery and Data Management you will ensure we provide quality assured data products and … services to our customers, maximising the potential for automation of our data pipelines, contributing to the development of new and existing data products and services and supporting our research and innovation projects. Continuous improvement is key to our success and you will directly contribute to the enhancement of our systems and processes as well as the adoption of More ❯

Product Manager – Data & Data Science Remote (UK) Up to £90,000 + Benefits About the Company Our client is an award-winning search intelligence platform that helps global brands, marketers, and agencies gain an unparalleled understanding of the paid search landscape. Powered by patented AI technology, they enable clients to optimise spend, increase ROI, and stay ahead of … partner, they’ve been redefining search intelligence for over a decade. In 2024, they secured multiple industry awards including Best AI Search Software Solution , Best Use of AI for Data , and Best PPC Management Software Suite . You’ll be joining a business that combines the maturity and stability of an established company with the agility, autonomy, and growth … on a strong, people-first culture with a 93% approval rating and high employee satisfaction. About the Role You’ll join the Product function, working alongside leading AI and data specialists. The team is focused on delivering innovative, data-driven products that make a measurable difference to customers and the business. As the Product Manager for the Data More ❯

Job title Data Governance Analyst Ref 39460 Division Digital Location Hybrid - Clearwater Court - RG1 8DB Contract type Permanent Full/Part-time Full-time Hours 36 Hours per week. Salary Competitive salary between £47,000 and £71,000 per annum, depending on experience. Job grade B Closing date 11/11/2025 As a Data Governance Analyst … you will support the Data Governance Manager in implementing and maintaining the organisation's data governance framework. Your role will involve ensuring data quality, consistency, and compliance across various data domains. You will work closely with data owners, data stewards, the Records & Retention Officer, and IT teams to enforce data governance policies and … procedures and support Master Data Management (MDM) and Records Management initiatives. What you'll be doing as a Data Governance Analyst Assist in developing and articulating the organisation's data governance vision, strategy, and roadmap. Support the activation and enforcement of the data governance program vision. Collaborate with various stakeholders, including IT teams, business units, data More ❯

For this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer requirements Previous experience with the preparation of high-quality engaging … the offer solution team, solution definition, effort and cost estimation, Past experience in dealing with partners, tools vendors, etc. Business Domain Knowledge More than 5 years of experience in Big Data implementation projects Experience in the definition of Big Data architecture with different tools and environments: Cloud (AWS, Azure and GCP), Cloudera, No-sql databases (Cassandra … Mongo DB), ELK, Kafka, Snowflake, etc. Past experience in Data Engineering and data quality tools (Informatica, Talend, etc.) Previous involvement in working in a Multilanguage and multicultural environment Proactive, tech passionate and highly motivated Desirable requirements: Experience in Data analysis and visualization solutions: Microstrategy, Qlik, PowerBI, Tableau, Looker,... Background in Data Governance and Data More ❯

Overview stackable - who are we? Stackable is an innovative technology company focused on delivering cutting-edge, opensource Big Data solutions for data lakehouses, data mesh, event processing and AI. We specialise in designing, deploying, and managing scalable datainfrastructures that empower businesses to harness the power of data effectively. Our core product, the Stackable Data Platform, enables companies of all sizes to easily integrate and manage their sovereign data platforms in their respective IT infrastructure. Your mission at stackable: We are looking for a skilled Solutions Architect with a strong background in Big Data to join our team. The ideal candidate will have expertise in open source Big Data technologies and Kubernetes and DevOps practices . This role will be instrumental in designing, implementing, and optimizing cloud-based and on-premise data solutions for our clients. Responsibilities You will architect and implement Stackable Data Platform solutions , ensuring scalability, reliability, and security. You will develop and maintain Kubernetes-based infrastructures to support data processing and analytics More ❯

dynamic organization allows you to work across functional business pillars, contributing your ideas, experiences, diverse thinking, and a strong mindset. Are you ready? About your team Join our growing Data & Analytics practice and make a difference. In this practice you will be utilizing the most innovative technological solutions in modern data ecosystem. In this role you'll be … able to see your own ideas transform into breakthrough results in the areas of Data & Analytics strategy, Management & Governance, Data Integration & engineering, Analytics & Data science. About your role The ideal candidate will have extensive experience in designing and implementing data architectures, with a strong understanding of database management, data modelling, and data governance. This … thinker with strong analytical and problem-solving skills and the ability to work collaboratively with clients and cross-functional teams. Have experience in gathering, validating, synthesizing, documenting, and communicating data and information for a range of audiences, particularly audiences that are not technical. Design and implement robust scalable, secure, optimised data solutions that support business requirements and strategic More ❯

Position: Analytics Engineer Location: London (hybrid 3 times a week)Department: ITType: 3 months rolling contractOutside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. Key Responsibilities Design and … build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high experience … within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and supporting architects and engineers. To work independently and to manage multiple data More ❯

Analytics Engineer Location: London (hybrid 3 times a week) Department: IT Type: 3 months rolling contract Outside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. Key Responsibilities Design … and build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high … experience within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and supporting architects and engineers. To work independently and to manage multiple data More ❯

We are looking for an experienced Data Engineer with broad technical skills and ability to work with large amounts of data. You will collaborate with the Game and Product[1] teams to implement data strategies and develop complex ETL pipelines that support dashboards for promoting deeper understanding of our games. You will have experience developing and establishing scalable … efficient, automated processes for large-scale data analyses. You will also stay informed of the latest trends and research on all aspects of data engineering and analytics. You will work with leaders from an internal Game Studio, providing them with data for understanding game and player insights and report to the Technical Lead for this group. This … is a hybrid role based in our Southam office. Key Responsibilities: ● As a Data Engineer you will be involved in the entire development life cycle, from brainstorming ideas to implementing elegant solutions to obtain data insights. ● You will gather requirements, model and design solutions to support product analytics, business analytics and advance data science ● Design efficient and More ❯

We are looking for an experienced Data Engineer with broad technical skills and ability to work with large amounts of data. You will collaborate with the Game and Product[1] teams to implement data strategies and develop complex ETL pipelines that support dashboards for promoting deeper understanding of our games. You will have experience developing and establishing scalable … efficient, automated processes for large-scale data analyses. You will also stay informed of the latest trends and research on all aspects of data engineering and analytics. You will work with leaders from an internal Game Studio, providing them with data for understanding game and player insights and report to the Technical Lead for this group. This … is a hybrid role based in our Southam office. Key Responsibilities: ● As a Data Engineer you will be involved in the entire development life cycle, from brainstorming ideas to implementing elegant solutions to obtain data insights. ● You will gather requirements, model and design solutions to support product analytics, business analytics and advance data science ● Design efficient and More ❯

Principal Data Modeller & Data Architect (Management Level) 📍 Location: London (Hybrid) | Practice Area: Data & Analytics | Type: Permanent We’re looking for a Principal Data Architect & Data Modelling Consultant to lead the design, development, and delivery of enterprise-grade data solutions across large-scale transformation programmes. In these strategic and hands-on roles, you’ll shape … data architecture strategies, design best-practice data models, and enable modern, cloud-based ecosystems that unlock business insight and value. You’ll collaborate with senior stakeholders, guide delivery teams, and play a pivotal role in advancing our clients’ data maturity and innovation. What You’ll Do Lead agile consulting engagements focused on data architecture, modelling, and … cloud transformation Define and implement scalable enterprise data strategies and modern platform designs Design and deliver conceptual, logical, and physical data models that drive alignment between technology and business vision Partner with engineers, domain experts, and business teams to translate requirements into intelligent data solutions Support data governance, metadata management , and standards enforcement across programmes Act More ❯

business pillars, contributing your ideas, experiences, diverse thinking, and a strong mindset. Are you ready? About your role The ideal candidate will have extensive experience in designing and implementing data architectures, with a strong understanding of database management, data modelling, and data governance. This role requires a strategic thinker with strong analytical and problem-solving skills and … with clients and cross-functional teams. You Have a broad business skill set including stakeholder management, problem-solving, and resilience Have experience in gathering, validating, synthesizing, documenting, and communicating data and information for a range of audiences, particularly audiences that are not technical. Are willing to travel forproject-related work. Design and implement robust scalable, secure, optimised data solutions that support business requirements and strategic goals. Evaluate the client's existing data estate, can diagnose underlying issues, and propose potential solutions. Collaborate with clients to understand their data needs and provide expert advice on data management and architecture. Develop data models, data flow diagrams, and data dictionaries. Oversee the ingestion and More ❯

Data/AI Enterprise Architect Washington, DC - 100% ONSITE US citizenship required per government contract Must be able to obtain Public Trust ALTA IT Services is in search of a candidate who has deep knowledge of enterprise architecture principles, AI technologies, and data management practices to guide decision-making and ensure that the architecture supports business objectives and … enhances operational capabilities. Key Responsibilities: • Design and develop end-to-end AI and data architectures that support business goals, ensuring scalability, performance, security, and maintainability. • Create architectural blueprints and roadmaps that guide the integration of AI and data solutions across the organization. • Lead the development and implementation of data platforms and AI-driven systems that facilitate advanced … units, ensuring alignment with business objectives. • Oversee the deployment and integration of AI models, tools, and technologies into production systems. • Design and implement scalable cloud-based and on-premises data architectures using platforms like Azure, AWS, or Google Cloud. • Work with big data technologies (e.g., Hadoop, Spark) and data lake architectures to ensure the organization's More ❯

This is a full-time hybrid role for a Data Architect in our Data & AI Practice at OpenSky Data Systems in Naas. You will be working on the latest Microsoft Data & AI technologies at the forefront of technological development (Fabric, Azure OpenAI, AI Studio & Cognitive Services, etc). We are working closely with our colleagues in … offer clear career progression paths, ensuring our team members have opportunities to advance their careers, develop new skills, and grow into leadership roles. Whether it's honing expertise in Data & AI technologies, or taking on strategic responsibilities, we help you shape your career in the way that aligns with your aspirations. Our Data & AI Practice OpenSky Data … customers across Ireland, UK, Europe, and the United States. We have multi-disciplinary teams working across our 3 Centres of Excellence, Modern Applications (.NET), Microsoft Cloud (Power Platform), and Data & AI. We deliver projects that matter, whether it is working to reduce HPV cancer in Europe or reducing homelessness in Ireland, our projects create a positive impact on others. More ❯

Head of Data Engineering - Preston A Head of Data Engineering/Data Engineering Manager to lead the design, development, and enhancement of the data infrastructure and pipelines is required by a leading company based in Preston. The role offers Hybrid working, so 2 - 3 days in the office a week. You must have the following: Proven … experience as a lead data engineer/Data Engineering Manager with some management experience Experience handling large datasets, complex data pipelines, big data processing frameworks and technologies Experience with data modelling, data integration ETL processes and designing efficient data structures Strong programming skills in Python, Java, or Scala Data warehousing concepts … and dimensional modelling experience Any data engineering skills in Azure Databricks and Microsoft Fabric would be a bonus This new role involves building & managing a team of data engineers, fostering a culture of technical excellence and continuous improvement. Collaboration with cross-functional teams is essential to ensure robust, scalable, and aligned data solutions for delivering high-quality More ❯

Director, Data Engineering Capital One is seeking a Director of Data Engineering to work in our Card Data Engineering and Analytics organization. This individual will be accountable to drive a cohesive datamart/aggregation strategy across our org in collaboration with multiple enterprise partners. This individual was also lead creation of modern scalable innovative solutions that simplify … our analysts lives and create a self-serve experience. This role will build teams to deliver highly performant and scalable data products and platforms to drive consumption of data from our enterprise data ecosystem, while driving data engineering best practices. This leader must have the ability to attract and recruit the industry's best talent, and … that we build compelling, customer-oriented solutions in an iterative methodology. Success in the role requires an innovative mind, a proven track record of delivering next generation software and data products, rigorous analytical skills, and a passion for delivering customer value through automation, machine learning and predictive analytic s. This leader must have the ability to attract and recruit More ❯

Director, Data Engineering Capital One is seeking a Director of Data Engineering to work in our Card Data Engineering and Analytics organization. This individual will be accountable to drive a cohesive datamart/aggregation strategy across our org in collaboration with multiple enterprise partners. This individual was also lead creation of modern scalable innovative solutions that simplify … our analysts lives and create a self-serve experience. This role will build teams to deliver highly performant and scalable data products and platforms to drive consumption of data from our enterprise data ecosystem, while driving data engineering best practices. This leader must have the ability to attract and recruit the industry's best talent, and … that we build compelling, customer-oriented solutions in an iterative methodology. Success in the role requires an innovative mind, a proven track record of delivering next generation software and data products, rigorous analytical skills, and a passion for delivering customer value through automation, machine learning and predictive analytic s. This leader must have the ability to attract and recruit More ❯