1 to 25 of 777 Big Data Jobs

TO CORP) WITH 3RD PARTY WORK AUTHORIZATION: US CITZ or GC,GC - EAD,H4 & L2 EAD, NO H1B & OPT/CPT ACCEPTED BY CLIENT RATE: $OPEN - DOE JOB TITLE: Data Engineer Big Data Hadoop JOB DESCR: Candidates will start out REMOTE WORK and then will eventually be sitting in Frt. Lauderdale, FL. Candidates should be senior Data Engineers with big data tools (Hadoop, Spark, Kafka) as well as AWS (cloud services: EC2, EMR, RDS, Redshift) and NOSQL. This is a phone and Skype to hire. Candidates in Florida with a LinkedIn profile preferred but not required. Essential Duties and Responsibilities: • Past experience in executing and delivering solutions in an Agile scrum development environment is … preferred • Produce deliverables with little oversight or management assistance • Assemble large, complex data sets that meet functional/non-functional business requirements • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide More ❯

BIG DATA ENGINEER - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A BIG DATA ENGINEER WITH DV CLEARANCE Permanent job opportunity for a Big Data Engineer Leading National Security & Defence SME Salary up to £80,000 plus clearance bonus London based organisation in an easily accessible location To … apply please call or email WHO WE ARE? We are recruiting multiple Big Data Engineers to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold DV or enhanced DV Security Clearance. WHAT WILL THE BIG DATA ENGINEER BE DOING? You will be joining a leading SME who … is working hard to support National Security projects within UK Govt. Departments in London. As part of a team, you will be responsible for implementing Big Data Solutions in Mission-Critical areas. WE NEED THE BIG DATA ENGINEER TO HAVE.... Current DV clearance - Standard or Enhanced Must have experience with big data tools such More ❯

CONTRACT DATA ENGINEER - eDV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Data Engineer National Security client Palantir Foundry Outside IR35 Central London based organisation in an easily accessible location To apply please call/or email WHO WE ARE … We are recruiting a contract Data Engineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATA ENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Experience With Palantir … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply by More ❯

Senior Data Engineer (Platforms) Simple Machines is a leading independent boutique technology firm with a global presence, including teams in London, , Poland, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine learning, data engineering, and software engineering. Our mission is to help enterprises, technology companies, and governments … better connect with and understand their organisations, their people, their customers, and citizens. We are a team of creative engineers and technologists dedicated to unleashing the potential of data in new and impactful ways. We design and build bespoke data platforms and unique software products, create and deploy intelligent systems, and bring engineering expertise to life by transforming … data into actionable insights and tangible outcomes. We engineer data to life. Requirements The Role: The Senior Data Engineer at Simple Machines is a dynamic, hands-on role focused on building real-time data pipelines and implementing data mesh architectures to enhance client data interactions. This position blends deep technical expertise in modern data More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or email WHO WE … ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security projects within UK Govt. Departments … in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience of achieving data interoperability between More ❯

Position Summary The Data Engineer will play a crucial role in developing and fine-tuning data specifically for our LLMs and machine learning models. This individual will be responsible for the entire data lifecycle, including gathering, cleaning, structuring, and optimizing large, diverse healthcare datasets. The ideal candidate will have a strong background in data engineering principles … experience with big data technologies, and a keen understanding of the unique challenges and requirements of healthcare data. You will design, build, and maintain scalable data pipelines that source, preprocess, and deliver high-quality, high-volume datasets to our machine learning engineers. This role requires a deep understanding of data engineering best practices coupled with specific … knowledge of the data requirements for LLM training and refinement Key Responsibilities Collaborate with data scientists and machine learning engineers to understand data requirements for LLM and machine learning model fine-tuning. Design, build, and maintain scalable data pipelines to ingest, process, and store massive and diverse healthcare datasets. Implement robust data validation and monitoring More ❯

We are currently recruiting a Microsoft Fabric Data Engineer for a 6-month on-site contract. This is a hybrid position. Position offers a competitive pay rate. 8+ Years of Experience: Data Management and Storage: Design and implement data storage systems using Azure services like Azure SQL Database, Azure Data Lake Storage, and Azure Synapse. Ensure … scalability, performance, and cost-effectiveness. Data Integration and ETL (Extract, Transform, Load): Develop and implement data integration processes using Azure Data Factory. Extract data from various sources, transform it, and load it into data warehouses or data lakes. Big Data and Analytics: Utilize big data technologies such as Apache Spark. … Create data processing workflows and pipelines to support data analytics and machine learning applications. Build and maintain new and existing applications in preparation for a large-scale architectural migration within an Agile function. Monitor and optimize data pipelines and database performance to ensure data processing efficiency. Build interfaces for supporting evolving and new applications and accommodating More ❯

Job Title: Senior Data Engineer Location: Cary, NC Experience: 12+ Years About the Role We are looking for an experienced Senior Data Engineer who will lead the design and development of modern data platforms and scalable data pipelines. The ideal candidate has strong hands-on expertise in cloud data engineering, big data technologies … ELT/ETL architecture, and data modeling, along with the ability to mentor teams and work closely with business stakeholders to deliver high-quality data solutions. Key Responsibilities Architect, design, and implement large-scale data pipelines and data integration workflows across structured and unstructured datasets. Build, optimize, and maintain robust ETL/ELT processes for ingestion … transformation, and delivery of data across enterprise systems. Develop and manage data lakes, data warehouses, and analytics platforms using cloud technologies. Work closely with data scientists, analysts, and business teams to understand data requirements and deliver reliable data for reporting and analytics. Define best practices for data quality, lineage, governance, security, and performance More ❯

dynamic organization allows you to work across functional business pillars, contributing your ideas, experiences, diverse thinking, and a strong mindset. Are you ready? About your team Join our growing Data & Analytics practice and make a difference. In this practice you will be utilizing the most innovative technological solutions in modern data ecosystem. In this role you'll be … able to see your own ideas transform into breakthrough results in the areas of Data & Analytics strategy, Management & Governance, Data Integration & engineering, Analytics & Data science. About your role The ideal candidate will have extensive experience in designing and implementing data architectures, with a strong understanding of database management, data modelling, and data governance. This … with strong analytical and problem-solving skills and the ability to work collaboratively with clients and cross-functional teams. Requirements · Have experience in gathering, validating, synthesizing, documenting, and communicating data and information for a range of audiences, particularly audiences that are not technical. · Design and implement robust scalable, secure, optimised data solutions that support business requirements and strategic More ❯

Data Engineer Position Summary The Data Engineer is responsible for building and maintaining scalable data pipelines, data warehousing solutions, and data platforms that support analytics, machine learning, and business intelligence. This role focuses on data integration, ETL/ELT workflows, and ensuring data quality and availability. Key Responsibilities Develop, maintain, and optimize data pipelines (batch and streamingBuild and manage data lakes, data warehouses, and analytics platforms.Design ETL/ELT workflows and automate data ingestion from multiple sources.Work with big data tools and distributed processing frameworks.Ensure data quality, validation, governance, and lineage.Collaborate with data scientists, analysts, and product teams.Optimize data storage, query performance, and processing … efficiency.Develop APIs, dashboards, or interfaces for data access.Manage cloud-based data infrastructure (AWS, Azure, GCPDocument architecture, workflows, and data models. Required Skills & Experience Strong experience with SQL, relational databases, and NoSQL systems.Proficiency in Python, Scala, or Java for data engineering tasks.Experience with big data tools (Spark, Hadoop, Kafka, FlinkKnowledge of ETL/ELT tools More ❯

Data/AI Enterprise Architect Washington, DC - 100% ONSITE US citizenship required per government contract Must be able to obtain Public Trust ALTA IT Services is in search of a candidate who has deep knowledge of enterprise architecture principles, AI technologies, and data management practices to guide decision-making and ensure that the architecture supports business objectives and … enhances operational capabilities. Key Responsibilities: • Design and develop end-to-end AI and data architectures that support business goals, ensuring scalability, performance, security, and maintainability. • Create architectural blueprints and roadmaps that guide the integration of AI and data solutions across the organization. • Lead the development and implementation of data platforms and AI-driven systems that facilitate advanced … units, ensuring alignment with business objectives. • Oversee the deployment and integration of AI models, tools, and technologies into production systems. • Design and implement scalable cloud-based and on-premises data architectures using platforms like Azure, AWS, or Google Cloud. • Work with big data technologies (e.g., Hadoop, Spark) and data lake architectures to ensure the organization's More ❯

Director, Data Engineering Capital One is seeking a Director of Data Engineering to work in our Card Data Engineering and Analytics organization. This individual will be accountable to drive a cohesive datamart/aggregation strategy across our org in collaboration with multiple enterprise partners. This individual was also lead creation of modern scalable innovative solutions that simplify … our analysts lives and create a self-serve experience. This role will build teams to deliver highly performant and scalable data products and platforms to drive consumption of data from our enterprise data ecosystem, while driving data engineering best practices. This leader must have the ability to attract and recruit the industry's best talent, and … that we build compelling, customer-oriented solutions in an iterative methodology. Success in the role requires an innovative mind, a proven track record of delivering next generation software and data products, rigorous analytical skills, and a passion for delivering customer value through automation, machine learning and predictive analytic s. This leader must have the ability to attract and recruit More ❯

to work in a successful IT company? Then take advantage of your chance: JOB WORLD GmbH is a partner of the leading IT companies in Austria. We offer dedicated Big Data Administrators (Apache Hadoop/Cloudera) top access to interesting IT jobs. We are looking for DIRECT EMPLOYMENT for a renowned IT company Big Data Administrator … Apache Hadoop/Cloudera) (all genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists on the selection of … level support through troubleshooting and error analysis Support workload optimization (eg. query optimization) Evaluation and implementation of Cloud Native Services Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Technical education (computer science studies, etc.) At least 5 years experience in Apache Hadoop Cloudera environments. Migration to AWS Experience in system administration of Linux systems (RedHat More ❯

to work in a successful IT company? Then take advantage of your chance: JOB WORLD GmbH is a partner of the leading IT companies in Austria. We offer dedicated Big Data Administrators (Apache Hadoop/Cloudera) top access to interesting IT jobs. We are looking for DIRECT EMPLOYMENT for a renowned IT company Big Data Administrator … Apache Hadoop/Cloudera) (all genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists on the selection of … level support through troubleshooting and error analysis Support workload optimization (eg. query optimization) Evaluation and implementation of Cloud Native Services Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Technical education (computer science studies, etc.) At least 5 years experience in Apache Hadoop Cloudera environments. Migration to AWS Experience in system administration of Linux systems (RedHat More ❯

to work in a successful IT company? Then take advantage of your chance: JOB WORLD GmbH is a partner of the leading IT companies in Austria. We offer dedicated Big Data Administrators (Apache Hadoop/Cloudera) top access to interesting IT jobs. We are looking for DIRECT EMPLOYMENT for a renowned IT company Big Data Administrator … Apache Hadoop/Cloudera) (all genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists on the selection of … level support through troubleshooting and error analysis Support workload optimization (eg. query optimization) Evaluation and implementation of Cloud Native Services Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Technical education (computer science studies, etc.) At least 5 years experience in Apache Hadoop Cloudera environments. Migration to AWS Experience in system administration of Linux systems (RedHat More ❯

to work in a successful IT company? Then take advantage of your chance: JOB WORLD GmbH is a partner of the leading IT companies in Austria. We offer dedicated Big Data Administrators (Apache Hadoop/Cloudera) top access to interesting IT jobs. We are looking for DIRECT EMPLOYMENT for a renowned IT company Big Data Administrator … Apache Hadoop/Cloudera) (all genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists on the selection of … level support through troubleshooting and error analysis Support workload optimization (eg. query optimization) Evaluation and implementation of Cloud Native Services Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Technical education (computer science studies, etc.) At least 5 years experience in Apache Hadoop Cloudera environments. Migration to AWS Experience in system administration of Linux systems (RedHat More ❯

to work in a successful IT company? Then take advantage of your chance: JOB WORLD GmbH is a partner of the leading IT companies in Austria. We offer dedicated Big Data Administrators (Apache Hadoop/Cloudera) top access to interesting IT jobs. We are looking for DIRECT EMPLOYMENT for a renowned IT company Big Data Administrator … Apache Hadoop/Cloudera) (all genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists on the selection of … level support through troubleshooting and error analysis Support workload optimization (eg. query optimization) Evaluation and implementation of Cloud Native Services Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Technical education (computer science studies, etc.) At least 5 years experience in Apache Hadoop Cloudera environments. Migration to AWS Experience in system administration of Linux systems (RedHat More ❯

to work in a successful IT company? Then take advantage of your chance: JOB WORLD GmbH is a partner of the leading IT companies in Austria. We offer dedicated Big Data Administrators (Apache Hadoop/Cloudera) top access to interesting IT jobs. We are looking for DIRECT EMPLOYMENT for a renowned IT company Big Data Administrator … Apache Hadoop/Cloudera) (all genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists on the selection of … level support through troubleshooting and error analysis Support workload optimization (eg. query optimization) Evaluation and implementation of Cloud Native Services Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Technical education (computer science studies, etc.) At least 5 years experience in Apache Hadoop Cloudera environments. Migration to AWS Experience in system administration of Linux systems (RedHat More ❯

to work in a successful IT company? Then take advantage of your chance: JOB WORLD GmbH is a partner of the leading IT companies in Austria. We offer dedicated Big Data Administrators (Apache Hadoop/Cloudera) top access to interesting IT jobs. We are looking for DIRECT EMPLOYMENT for a renowned IT company Big Data Administrator … Apache Hadoop/Cloudera) (all genders) Aufgaben Administrate, monitor and optimize our Big Data environment based on Apache Hadoop from Cloudera (AWS-Cloud) Manage and maintain services like Kafka, Flink, NiFi, DynamoDB and Iceberg Tables IaaC deployment via Terraform Plan and execute updates/upgrades Advise our Data Engineers and Data Scientists on the selection of … level support through troubleshooting and error analysis Support workload optimization (eg. query optimization) Evaluation and implementation of Cloud Native Services Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Technical education (computer science studies, etc.) At least 5 years experience in Apache Hadoop Cloudera environments. Migration to AWS Experience in system administration of Linux systems (RedHat More ❯

Role: Senior Big Data & DevOps EngineerBill Rate: $78/hour C2CLocation: Dallas, TXDuration: 12+ months/long-term Interview Criteria: Telephonic + ZoomDirect Client Requirement We are seeking a highly experienced Senior Big Data & DevOps Engineer to manage end-to-end data operations for enterprise-scale platforms. The ideal candidate will have8+ years of experience … in Big Data technologies, ETL development, and DevOps automation, with hands-on expertise inHDFS, Hive, Impala, PySpark, Python, Jenkins, and uDeploy. This role is critical in ensuring thestability, scalability, and efficiency of data platforms while enabling smooth development-to-production workflows. Required Qualifications Bachelor s degree in Computer Science, IT, or related field. 8+ years of experience … inBig Data engineering and DevOps practices. Advanced proficiency in HDFS, Hive, Impala, PySpark, Python, and Linux. Hands-on experience with CI/CD tools such as Jenkins anduDeploy. Strong understanding of ETL development, orchestration, and performance optimization. Experience with ServiceNow for incident/change/problem management. Excellent analytical, troubleshooting, and communication skills. Nice to Have Exposure to cloud More ❯

We are seeking a Sr. Lead Data Engineer for a hybrid for a W2 position (Must work on our W2 and commute to Huntsville, Texas when required). Will lead the design, implementation, and management of end-to-end, enterprise-grade data solutions for our Huntsville, Texas, client. This role requires expertise in building and optimizing data warehouses, data lakes, and lake house platforms, with a strong emphasis on data engineering, data science, and machine learning. You will work closely with cross-functional teams to create scalable and robust architectures that support advanced analytics and machine learning use cases, while adhering to industry standards and best practices. Responsibilities Include: Architect, design, and manage … the entire data lifecycle from data ingestion, transformation, storage, and processing to advanced analytics and machine learning databases and large-scale processing systems. Implement robust data governance frameworks, including metadata management, lineage tracking, security, compliance, and business glossary development. Identify, design, and implement internal process improvements, including redesigning infrastructure for greater scalability, optimizing data delivery, and More ❯

Description This position will play a critical role in the success of the Firm's Data Strategy program As a Vice President on the Data Governance team within the firmwide CDO, you will be responsible for working with stakeholders to define governance and tooling requirements and building out the Firmwide Data Lineage framework. The firmwide team also … to deliver this governance framework. In addition, you will be responsible for driving the adoption of the firmwide CDO framework by the LOBs and Corporate Functions CDOs. The Chief Data & Analytics Office (CDAO) at JPMorgan Chase is responsible for accelerating the firm's data and analytics journey. This includes ensuring the quality, integrity, and security of the company … s data, as well as leveraging this data to generate insights and drive decision-making. The CDAO is also responsible for developing and implementing solutions that support the firm's commercial goals by harnessing artificial intelligence and machine learning technologies to develop new products, improve productivity, and enhance risk management effectively and responsibly. Job Responsibilities Partners with CDO More ❯

Lead Data Engineer - Preston A Lead Data Engineer to lead the design, development, and enhancement of the data infrastructure and pipelines is required by a leading company based in Preston. The role offers Hybrid working, so 2 - 3 days in the office a week. You must have the following: Proven experience as a Senior or Lead data engineer Experience handling large datasets, complex data pipelines, big data processing frameworks and technologies AWS or Azure cloud experience Experience with data modelling, data integration ETL processes and designing efficient data structures Strong programming skills in Python, Java, or Scala Data warehousing concepts and dimensional modelling experience Any data engineering skills … in Azure Databricks and Microsoft Fabric would be a bonus This new role involves leading a data team, fostering a culture of technical excellence and continuous improvement. Collaboration with cross-functional teams is essential to ensure robust, scalable, and aligned data solutions for delivering high-quality care. The ideal candidate will lead the design and execution of cloud More ❯

We are seeking an IT consulting firm specializing in Big Data Engineers. Currently, we are in pursuit of a highly proficient Big Data Engineer. Requirements Strong experience with big data technologies such as Hadoop, Spark, and Kafka. Experience building and optimizing data pipelines, architectures, and data sets. Proficiency in programming languages such … as Java, Scala, or Python. In-depth knowledge of distributed file systems (e.g., HDFS, S3) and NoSQL databases (e.g., Cassandra, MongoDB). Experience with data warehouse solutions and data modeling. Strong problem-solving skills and ability to work in an agile, collaborative environment. Excellent verbal and written communication skills. Bachelor's degree in Computer Science, Engineering, or a More ❯

Head of Data - Preston A Head of Data/Head of Business Intelligence to lead the design, development, and enhancement of the data infrastructure and pipelines is required by a leading company based in Preston. The role offers Hybrid working, so 2 - 3 days in the office a week. You must have the following: Proven experience as … Head of Data/Head of Business Intelligence with some management experience Experience handling large datasets, complex data pipelines, big data processing frameworks and technologies Experience with data modelling, Databricks, data integration ETL processes and designing efficient data structures Strong programming skills in Python, Java, or Scala Data warehousing concepts and dimensional … modelling experience Any data engineering skills in Azure Databricks and Microsoft Fabric would be a bonus This new role involves building & managing a team of data engineers, fostering a culture of technical excellence and continuous improvement. Collaboration with cross-functional teams is essential to ensure robust, scalable, and aligned data solutions for delivering high-quality care. The More ❯