1 to 25 of 117 Big Data Jobs

BIG DATA ENGINEER - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A BIG DATA ENGINEER WITH DV CLEARANCE Permanent job opportunity for a Big Data Engineer Leading National Security & Defence SME Salary up to £80,000 plus clearance bonus London based organisation in an easily accessible location To … apply please call or email WHO WE ARE? We are recruiting multiple Big Data Engineers to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold DV or enhanced DV Security Clearance. WHAT WILL THE BIG DATA ENGINEER BE DOING? You will be joining a leading SME who … is working hard to support National Security projects within UK Govt. Departments in London. As part of a team, you will be responsible for implementing Big Data Solutions in Mission-Critical areas. WE NEED THE BIG DATA ENGINEER TO HAVE.... Current DV clearance - Standard or Enhanced Must have experience with big data tools such More ❯

CONTRACT DATA ENGINEER - eDV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Data Engineer National Security client Palantir Foundry Outside IR35 Central London based organisation in an easily accessible location To apply please call/or email WHO WE ARE … We are recruiting a contract Data Engineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATA ENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Experience With Palantir … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply by More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or email WHO WE … ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security projects within UK Govt. Departments … in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience of achieving data interoperability between More ❯

We are currently recruiting a Microsoft Fabric Data Engineer for a 6-month on-site contract. This is a hybrid position. Position offers a competitive pay rate. 8+ Years of Experience: Data Management and Storage: Design and implement data storage systems using Azure services like Azure SQL Database, Azure Data Lake Storage, and Azure Synapse. Ensure … scalability, performance, and cost-effectiveness. Data Integration and ETL (Extract, Transform, Load): Develop and implement data integration processes using Azure Data Factory. Extract data from various sources, transform it, and load it into data warehouses or data lakes. Big Data and Analytics: Utilize big data technologies such as Apache Spark. … Create data processing workflows and pipelines to support data analytics and machine learning applications. Build and maintain new and existing applications in preparation for a large-scale architectural migration within an Agile function. Monitor and optimize data pipelines and database performance to ensure data processing efficiency. Build interfaces for supporting evolving and new applications and accommodating More ❯

Job Title: Senior Data Engineer Location: Cary, NC Experience: 12+ Years About the Role We are looking for an experienced Senior Data Engineer who will lead the design and development of modern data platforms and scalable data pipelines. The ideal candidate has strong hands-on expertise in cloud data engineering, big data technologies … ELT/ETL architecture, and data modeling, along with the ability to mentor teams and work closely with business stakeholders to deliver high-quality data solutions. Key Responsibilities Architect, design, and implement large-scale data pipelines and data integration workflows across structured and unstructured datasets. Build, optimize, and maintain robust ETL/ELT processes for ingestion … transformation, and delivery of data across enterprise systems. Develop and manage data lakes, data warehouses, and analytics platforms using cloud technologies. Work closely with data scientists, analysts, and business teams to understand data requirements and deliver reliable data for reporting and analytics. Define best practices for data quality, lineage, governance, security, and performance More ❯

dynamic organization allows you to work across functional business pillars, contributing your ideas, experiences, diverse thinking, and a strong mindset. Are you ready? About your team Join our growing Data & Analytics practice and make a difference. In this practice you will be utilizing the most innovative technological solutions in modern data ecosystem. In this role you'll be … able to see your own ideas transform into breakthrough results in the areas of Data & Analytics strategy, Management & Governance, Data Integration & engineering, Analytics & Data science. About your role The ideal candidate will have extensive experience in designing and implementing data architectures, with a strong understanding of database management, data modelling, and data governance. This … with strong analytical and problem-solving skills and the ability to work collaboratively with clients and cross-functional teams. Requirements · Have experience in gathering, validating, synthesizing, documenting, and communicating data and information for a range of audiences, particularly audiences that are not technical. · Design and implement robust scalable, secure, optimised data solutions that support business requirements and strategic More ❯

Position: Analytics Engineer Location: London (hybrid 3 times a week)Department: ITType: 3 months rolling contractOutside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. Key Responsibilities Design and … build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high experience … within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and supporting architects and engineers. To work independently and to manage multiple data More ❯

Analytics Engineer Location: London (hybrid 3 times a week) Department: IT Type: 3 months rolling contract Outside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. Key Responsibilities Design … and build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high … experience within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and supporting architects and engineers. To work independently and to manage multiple data More ❯

Head of Data Engineering - Preston A Head of Data Engineering/Data Engineering Manager to lead the design, development, and enhancement of the data infrastructure and pipelines is required by a leading company based in Preston. The role offers Hybrid working, so 2 - 3 days in the office a week. You must have the following: Proven … experience as a lead data engineer/Data Engineering Manager with some management experience Experience handling large datasets, complex data pipelines, big data processing frameworks and technologies Experience with data modelling, Databricks, data integration ETL processes and designing efficient data structures Strong programming skills in Python, Java, or Scala Data warehousing … concepts and dimensional modelling experience Any data engineering skills in Azure Databricks and Microsoft Fabric would be a bonus This new role involves building & managing a team of data engineers, fostering a culture of technical excellence and continuous improvement. Collaboration with cross-functional teams is essential to ensure robust, scalable, and aligned data solutions for delivering high More ❯

to work in a successful IT company? Then take advantage of your chance: JOB WORLD GmbH is a partner of the leading IT companies in Austria. We offer dedicated Big Data Administrators (Apache Hadoop/Cloudera) top access to interesting IT jobs. We are looking for DIRECT EMPLOYMENT for a renowned IT company Big Data Administrator … Apache Hadoop/Cloudera) (all genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists on the selection of … level support through troubleshooting and error analysis Support workload optimization (eg. query optimization) Evaluation and implementation of Cloud Native Services Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Technical education (computer science studies, etc.) At least 5 years experience in Apache Hadoop Cloudera environments. Migration to AWS Experience in system administration of Linux systems (RedHat More ❯

to work in a successful IT company? Then take advantage of your chance: JOB WORLD GmbH is a partner of the leading IT companies in Austria. We offer dedicated Big Data Administrators (Apache Hadoop/Cloudera) top access to interesting IT jobs. We are looking for DIRECT EMPLOYMENT for a renowned IT company Big Data Administrator … Apache Hadoop/Cloudera) (all genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists on the selection of … level support through troubleshooting and error analysis Support workload optimization (eg. query optimization) Evaluation and implementation of Cloud Native Services Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Technical education (computer science studies, etc.) At least 5 years experience in Apache Hadoop Cloudera environments. Migration to AWS Experience in system administration of Linux systems (RedHat More ❯

to work in a successful IT company? Then take advantage of your chance: JOB WORLD GmbH is a partner of the leading IT companies in Austria. We offer dedicated Big Data Administrators (Apache Hadoop/Cloudera) top access to interesting IT jobs. We are looking for DIRECT EMPLOYMENT for a renowned IT company Big Data Administrator … Apache Hadoop/Cloudera) (all genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists on the selection of … level support through troubleshooting and error analysis Support workload optimization (eg. query optimization) Evaluation and implementation of Cloud Native Services Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Technical education (computer science studies, etc.) At least 5 years experience in Apache Hadoop Cloudera environments. Migration to AWS Experience in system administration of Linux systems (RedHat More ❯

to work in a successful IT company? Then take advantage of your chance: JOB WORLD GmbH is a partner of the leading IT companies in Austria. We offer dedicated Big Data Administrators (Apache Hadoop/Cloudera) top access to interesting IT jobs. We are looking for DIRECT EMPLOYMENT for a renowned IT company Big Data Administrator … Apache Hadoop/Cloudera) (all genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists on the selection of … level support through troubleshooting and error analysis Support workload optimization (eg. query optimization) Evaluation and implementation of Cloud Native Services Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Technical education (computer science studies, etc.) At least 5 years experience in Apache Hadoop Cloudera environments. Migration to AWS Experience in system administration of Linux systems (RedHat More ❯

to work in a successful IT company? Then take advantage of your chance: JOB WORLD GmbH is a partner of the leading IT companies in Austria. We offer dedicated Big Data Administrators (Apache Hadoop/Cloudera) top access to interesting IT jobs. We are looking for DIRECT EMPLOYMENT for a renowned IT company Big Data Administrator … Apache Hadoop/Cloudera) (all genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists on the selection of … level support through troubleshooting and error analysis Support workload optimization (eg. query optimization) Evaluation and implementation of Cloud Native Services Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Technical education (computer science studies, etc.) At least 5 years experience in Apache Hadoop Cloudera environments. Migration to AWS Experience in system administration of Linux systems (RedHat More ❯

to work in a successful IT company? Then take advantage of your chance: JOB WORLD GmbH is a partner of the leading IT companies in Austria. We offer dedicated Big Data Administrators (Apache Hadoop/Cloudera) top access to interesting IT jobs. We are looking for DIRECT EMPLOYMENT for a renowned IT company Big Data Administrator … Apache Hadoop/Cloudera) (all genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists on the selection of … level support through troubleshooting and error analysis Support workload optimization (eg. query optimization) Evaluation and implementation of Cloud Native Services Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Technical education (computer science studies, etc.) At least 5 years experience in Apache Hadoop Cloudera environments. Migration to AWS Experience in system administration of Linux systems (RedHat More ❯

Description This position will play a critical role in the success of the Firm's Data Strategy program As a Vice President on the Data Governance team within the firmwide CDO, you will be responsible for working with stakeholders to define governance and tooling requirements and building out the Firmwide Data Lineage framework. The firmwide team also … to deliver this governance framework. In addition, you will be responsible for driving the adoption of the firmwide CDO framework by the LOBs and Corporate Functions CDOs. The Chief Data & Analytics Office (CDAO) at JPMorgan Chase is responsible for accelerating the firm's data and analytics journey. This includes ensuring the quality, integrity, and security of the company … s data, as well as leveraging this data to generate insights and drive decision-making. The CDAO is also responsible for developing and implementing solutions that support the firm's commercial goals by harnessing artificial intelligence and machine learning technologies to develop new products, improve productivity, and enhance risk management effectively and responsibly. Job Responsibilities Partners with CDO More ❯

Lead Data Engineer - Preston A Lead Data Engineer to lead the design, development, and enhancement of the data infrastructure and pipelines is required by a leading company based in Preston. The role offers Hybrid working, so 2 - 3 days in the office a week. You must have the following: Proven experience as a Senior or Lead data engineer Experience handling large datasets, complex data pipelines, big data processing frameworks and technologies AWS or Azure cloud experience Experience with data modelling, data integration ETL processes and designing efficient data structures Strong programming skills in Python, Java, or Scala Data warehousing concepts and dimensional modelling experience Any data engineering skills … in Azure Databricks and Microsoft Fabric would be a bonus This new role involves leading a data team, fostering a culture of technical excellence and continuous improvement. Collaboration with cross-functional teams is essential to ensure robust, scalable, and aligned data solutions for delivering high-quality care. The ideal candidate will lead the design and execution of cloud More ❯

Azure Data Engineer VIQU has partnered with a leading Telecommunications organisation seeking an experienced Azure Data Engineer to design, develop, and manage scalable data solutions on the Microsoft Azure platform. You’ll play a key role in architecting and implementing robust data integration solutions, as well as building ETL pipelines to support data ingestion, transformation … and loading. The Role:As an Azure data engineer, you’ll collaborate with cross-functional teams in an agile environment — contributing to sprint planning, daily stand-ups, and other agile ceremonies. Strong communication skills are essential, as you’ll often translate complex data concepts into clear insights for non-technical stakeholders. Key Responsibilities: Architect, design, and implement scalable … Azure-based data solutions. Develop and maintain ETL processes for data ingestion, transformation, and loading. Ensure data governance, integrity, and quality throughout the data lifecycle. Implement robust data security, compliance, and privacy standards. Document data architectures, data flows, and processes for knowledge sharing and audit readiness. Continuously enhance workflows using Agile best practices More ❯

Our client, a leading organization in the technology and data industry, is seeking a Data Engineer to join their team. As a Data Engineer, you will be part of the Data Engineering Department supporting the Data Team. The ideal candidate will have strong problem-solving skills, excellent communication abilities, and a proactive mindset, which will … align successfully in the organization. Job Title: Data Engineer Location: Denver, Colorado Pay Range: $70-90/hour based on experience No 3rd Parties/Corp-to-Corp Allowed What's the Job? Independently design, build, and launch new data extraction, transformation, and loading processes in production. Identify the data needed for business problems and implement logging … to ensure data availability, working with data infrastructure to troubleshoot issues and resolve them. Build data expertise and leverage data controls to ensure privacy, security, compliance, data quality, and operational efficiency. Design, build, and launch new data models to support evolving business needs. Support existing processes running in production and implement optimized solutions with More ❯

Are you passionate about data and eager to kickstart your career in data engineering? We’re looking for a motivated Junior Data Engineer to join our Service Operations team. This role offers an exciting opportunity to learn, contribute to, and grow within the critical areas of data pipeline development, maintenance, and optimisation for our client-facing … products and services. Working closely with experienced developers, data analysts, data scientists, and other stakeholders, you will be instrumental in ensuring the efficient and reliable flow of data, building foundational skills in a supportive environment. Key Responsibilities Data Pipeline Development • Contribute to the design, building, and maintenance of scalable data pipelines • Implement ETL (Extract, Transform … Load) processes to ingest data from various sources • Ensure data quality, integrity, and reliability through thorough testing and validation Database Management • Help manage and optimise data storage solutions (e.g., SQL and NoSQL databases, data lakes) • Monitor and assist in maintaining database performance and security Data Integration: • Collaborate with data analysts and scientists to integrate More ❯

Azure/Databricks Data Engineer x2 - UK Wide (Hybrid Working) £72,000-£80,000 Duties As a Databricks Data Engineer with an Azure focus, you will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement … data warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations. Skills/Experience Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. Develop and maintain secure data warehouses and data lakehouses: Implement data models, data quality checks, and governance practices to ensure reliable and accurate data. Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ML and Azure ML to develop predictive models and drive business insights. Monitor and optimize data pipelines and infrastructure: Analyze performance metrics, identify bottlenecks More ❯

comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. You understand and align with Solirius Reply Values. The Role: We are looking for an experienced Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a fantastic team of technology experts. … You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. Requirements Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models … schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the client and cross-functional teams to identify and address data More ❯

Senior Azure Data Engineer (Databricks, Delta Live Tables, Unity Catalog) 3 - 6 months Remote (UK Candidates Only) £550 - £600 per day Outside IR35 We are currently recruiting for an experienced Data Engineer skilled in Microsoft Azure and cloud computing concepts. As the Azure Data Engineer, you will work closely with a Microsoft & Databricks partner with responsibilities of … end-to-end design, build and deployment of industry-leading big data and AI applications. Your work will be varied and your responsibilities will include: Designing, developing, and managing end-to-end data pipelines Data processing and transformation using Spark Providing technical governance to enhance ways of working Champion DevOps and CI/CD methodologies to … ensure agile collaboration and robust data solutions Engineer and orchestrate data models and pipelines Lead development activities using Python, PySpark and other technologies Write high-quality code that contributes to a scalable and maintainable data platform To be successful in this role, you will need to have the following qualifications: Experience with Big Data Technologies More ❯

AZURE DATA ENGINEER Preferred locations: ATL or NYC, but open to all U.S. location No sponsorship available , USC or Green Card JOB DETAILS This section provides the details of the job role and the requirements for a candidate for the Azure Data Engineer position. OVERVIEW This role supports an individual with an interest and passion in designing and … implementing data management, querying, and storage, with a particular focus on Big Data solutions and large-scale processing. The qualified candidate will have experience with database systems, Azure cloud storage, and significant exposure to or experience with modern big data processing tools (such as Spark, Hadoop, and Databricks). Candidates will be expected to be … able to design and implement data solutions that use the following Azure services: Azure Cosmos DB, Azure SQL Database, Azure SQL Data Warehouse, Azure Data Lake Storage, Azure Data Factory, Azure Stream Analytics, Azure Databricks, and Azure Blob storage. This is a Senior to Expert level role with corresponding skill level in Azure Data Engineering. More ❯

Inteletech Global Inc, is one of the largest staffing organisation has an opening for Big Data Architect with one of ours Direct Client, a fortune 500 company. The position is based out of multiple locations with max 70% of travel within US. This position is FTE (Full Time Employee) position with the client. The brief job description is … as given below Role/Position: Big Data Architect Locations: Delaware/Pennsylvania/New Jersey/New York/Massachusetts ( 70% travel ) Hiring Mode: FTE - Full Time Employee, ( US Citizens & Green Card Holder ) Required Skill/Responsibility/Role Hands on Design and development experience in Kafka, Spark Streaming, Scala, Hive, SQL. Shell Scripting, Java Programming Involve … in planning, designing and strategizing the roadmap around On-premise and cloud solutions. Experience in designing and developing real time data processing pipelines Expertise in working with Hadoop data platforms and technologies like Kafka, Spark, Impala, Hive and HDFS in multi-tenant environments Expert in Java programming ,SQL and shell script, DevOps Good understanding of current industry landscape More ❯