51 to 75 of 1,437 Big Data Jobs

make a difference in National Security! Job Description We have an IMMEDIATE NEED for an ETL developer to play a pivotal role in shaping, leading, and implementing cutting-edge data flow solutions centered around Apache NiFi. The candidate will provide technical expertise and support in the design, development, implementation and testing of customer tools and applications in support of … Extracting, Transforming and Loading (ETL) of data into an enterprise Data Lake. The candidate will be responsible for defining architectural best practices, optimizing performance in large-scale environments, and mentoring junior developers, ensuring the delivery of robust, scalable, and secure data flow solutions that drive critical customer needs. Based in a DevOps framework, the ETL Developer participates … in and directs major deliverables of projects through all aspects of the software development lifecycle. Primary Responsibilities: Architecting and leading complex NiFi data pipeline design: Design and develop enterprise-level ETL architectures and implement NiFi data pipelines for large-scale data ingestion, transformation, and processing from diverse sources. Performance optimization and tuning: Lead the optimization of NiFi More ❯

Description Our Digital Modernization and Experience (DMX) Group is growing, and we are looking for a motivated, experienced Senior Databricks SME who is passionate about turning complex data into actionable solutions that improve public systems and services. This role supports an enterprise initiative focused on platform infrastructure and analytics modernization for a federal customer. You'll be joining a … cross-functional team of full stack developers, data engineers, and data analysts working within a modular, cloud-native platform supporting the emergency management sector. Your work will help ensure disaster management and mitigation decision-makers have access to accurate, timely, and meaningful data and data products to drive effective service delivery and measurable mission outcomes. If … you thrive in a collaborative environment, enjoy working independently to solve real-world challenges through data, we want to hear from you. Job Location: This position is fully remote with up to 10% travel to the DC Metropolitan area for client meetings. This person must be able to interview in person in Raleigh/Durham, NC, Reston, Virginia; Atlanta More ❯

Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They work on the latest big data tools, frameworks and offerings (data mesh, etc.), while also being involved in enabling credible and collaborative problem solving to execute on a strategy. Job responsibilities You will develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions You will develop intricate data processing pipelines … addressing clients' most challenging problems You will collaborate with data scientists to design scalable implementations of their models You will write clean, iterative code using TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines You will use different distributed storage and computing technologies from the plethora of options available You will develop data More ❯

As ABSCs next TS/SCI-cleared Data Scientist, you will play a critical role in the design, engineering, development, deployment, and use of software for the 10-year DOMEX Technology Platform (DTP) contract, where we support our clients mission to centralize and standardize Tasking, Collection, Processing, Exploitation and Dissemination (TCPED) of Open Source Intelligence (OSINT) across the Department … Agencys (DIA) National Media and Exploitation Center (NMEC) architecture by leveraging cloud-based computing, artificial intelligence (Al), machine learning (ML) and cross-domain transfer systems to provide cutting edge data exploitation, enrichment, triage, and analytics capabilities to Defense and Intelligence Community members. DTP advances the state of the art in mission-focused big data analytics tools and … micro-service development spanning the breadth of Agile sprints to multi-year research and development cycles. As ABSCs Data Scientist, your job will be to perform cutting edge data analytics and support a major program advancing the state of the art in mission-focused big data analytics and predictive analytics. You succeed through effective cross-functional More ❯

on a routine basis. This includes overseeing and managing the integration of technical systems and ensuring alignment with NCIJTF's technical and analytical requirements. Candidates with a background in data science, cloud technologies (preferably AWS), big data technologies (Hadoop and Spark) as well as system integration, are highly sought after for this position. Responsibilities include: Technical liaison … manage system architectures that meet mission-critical needs while integrating robust cybersecurity principles. Cloud Expertise: Provide expertise in cloud environments, preferably AWS, ensuring effective integration and management of systems. Big Data Management: Lead initiatives focused on big data technologies, ensuring scalability, security, and efficiency. Collaboration: Work closely with technical and management teams to meet objectives and … Counterintelligence (CI) Polygraph. US Citizenship is required. Master's degree and 10 years of relevant experience OR Bachelor's degree with 18 years of relevant experience. Strong experience in data science, systems engineering, or systems integration, with a proven ability to handle complex technical projects. Proficient in cloud environments, particularly AWS. Must possess one or more of the following More ❯

a passion to make an impact. Harnessing our innovative technologies and strong partnerships, we aim to make travel easy and rewarding for everyone. Get to Know Our Team The Data department, based in Bangkok, oversees all of Agoda's data-related requirements. Our ultimate goal is to enable and increase the use of data in the company … through creative approaches and the implementation of powerful resources such as operational and analytical databases, queue systems, BI tools, and data science technology. We hire the brightest minds from around the world to take on this challenge and equip them with the knowledge and tools that contribute to their personal growth and success while supporting our company's culture … of diversity and experimentation. The role the Data team plays at Agoda is critical as business users, product managers, engineers, and many others rely on us to empower their decision making. We are equally dedicated to our customers by improving their search experience with faster results and protecting them from any fraudulent activities. Data is interesting only when More ❯

Senior Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking … Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you'll have the opportunity to be on the forefront of driving a major transformation within Capital One. In this role, you will be responsible for working on internal systems and services that power our auto lending business by leveraging … technologies like ECS, Lambda, S3, and Python. You will have the opportunity to work alongside software engineers, product managers, and data scientists to help drive comprehensive solutions to resolve our customer's needs. As part of the servicing data team you will play a key role in delivering data and reporting solutions that fuel the business. What More ❯

Senior Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking … Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you'll have the opportunity to be on the forefront of driving a major transformation within Capital One. In this role, you will be responsible for working on internal systems and services that power our auto lending business by leveraging … technologies like ECS, Lambda, S3, and Python. You will have the opportunity to work alongside software engineers, product managers, and data scientists to help drive comprehensive solutions to resolve our customer's needs. As part of the servicing data team you will play a key role in delivering data and reporting solutions that fuel the business. What More ❯

Senior Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking … Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Data Engineer, you'll have the opportunity to be on the forefront of driving a major transformation within Capital One. In this role, you will be responsible for working on internal systems and services that power our auto lending business by leveraging … technologies like ECS, Lambda, S3, and Python. You will have the opportunity to work alongside software engineers, product managers, and data scientists to help drive comprehensive solutions to resolve our customer's needs. As part of the servicing data team you will play a key role in delivering data and reporting solutions that fuel the business. What More ❯

Arthur Financial are supporting a leading global reinsurer to appoint a Chief Data Officer, for a newly created role. The Chief Data Officer will lead the design and implementation of the companies data strategy and roadmap. This will include hiring and developing a team, data governance and adoption of big data and AI tooling. … Responsibilities Ownership of the following areas; Data Model, Data Strategy, Data Governance & Quality, Analytics and Insights, Big Data and AI. Hiring and leading a team of data professional as well as managing outsource providers Requirements Experience of working in a Chief Data Officer, Head of Data or data leadership role within … the Specialty Insurance market Previous, working knowledge of the global reinsurance market Proven track record in designing data functions and bringing business users on a journey of adoption Track record in delivering data driven transformation More ❯

Arthur Financial are supporting a leading global reinsurer to appoint a Chief Data Officer, for a newly created role. The Chief Data Officer will lead the design and implementation of the companies data strategy and roadmap. This will include hiring and developing a team, data governance and adoption of big data and AI tooling. … Responsibilities Ownership of the following areas; Data Model, Data Strategy, Data Governance & Quality, Analytics and Insights, Big Data and AI. Hiring and leading a team of data professional as well as managing outsource providers Requirements Experience of working in a Chief Data Officer, Head of Data or data leadership role within … the Specialty Insurance market Previous, working knowledge of the global reinsurance market Proven track record in designing data functions and bringing business users on a journey of adoption Track record in delivering data driven transformation More ❯

Arthur Financial are supporting a leading global reinsurer to appoint a Chief Data Officer, for a newly created role. The Chief Data Officer will lead the design and implementation of the companies data strategy and roadmap. This will include hiring and developing a team, data governance and adoption of big data and AI tooling. … Responsibilities Ownership of the following areas; Data Model, Data Strategy, Data Governance & Quality, Analytics and Insights, Big Data and AI. Hiring and leading a team of data professional as well as managing outsource providers Requirements Experience of working in a Chief Data Officer, Head of Data or data leadership role within … the Specialty Insurance market Previous, working knowledge of the global reinsurance market Proven track record in designing data functions and bringing business users on a journey of adoption Track record in delivering data driven transformation More ❯

Arthur Financial are supporting a leading global reinsurer to appoint a Chief Data Officer, for a newly created role. The Chief Data Officer will lead the design and implementation of the companies data strategy and roadmap. This will include hiring and developing a team, data governance and adoption of big data and AI tooling. … Responsibilities Ownership of the following areas; Data Model, Data Strategy, Data Governance & Quality, Analytics and Insights, Big Data and AI. Hiring and leading a team of data professional as well as managing outsource providers Requirements Experience of working in a Chief Data Officer, Head of Data or data leadership role within … the Specialty Insurance market Previous, working knowledge of the global reinsurance market Proven track record in designing data functions and bringing business users on a journey of adoption Track record in delivering data driven transformation More ❯

Arthur Financial are supporting a leading global reinsurer to appoint a Chief Data Officer, for a newly created role. The Chief Data Officer will lead the design and implementation of the companies data strategy and roadmap. This will include hiring and developing a team, data governance and adoption of big data and AI tooling. … Responsibilities Ownership of the following areas; Data Model, Data Strategy, Data Governance & Quality, Analytics and Insights, Big Data and AI. Hiring and leading a team of data professional as well as managing outsource providers Requirements Experience of working in a Chief Data Officer, Head of Data or data leadership role within … the Specialty Insurance market Previous, working knowledge of the global reinsurance market Proven track record in designing data functions and bringing business users on a journey of adoption Track record in delivering data driven transformation More ❯

A global IT services, consulting, and business solutions company has partnered with a leading financial services organisation to hire an experienced Data Architect for a 6-month contract. In this role, you'll design and implement enterprise-scale Data Lake solutions, define architectural standards, and guide best practices across large-scale digital transformation programmes. You'll collaborate with … cross-functional teams to ensure scalable, secure, and high-performance data systems that align with business objectives. This is a hybrid role requiring 2 days per week on-site in Central London. Ready to shape the future of data architecture in financial services? Apply now to join a high-impact team at the forefront of transformation. Key Responsibilities … Design and develop enterprise-grade data architecture frameworks supporting Data Lakes and Big Data platforms Create conceptual, logical, and physical data models for robust, scalable storage solutions Define and maintain the overall structure of data flows and models across multiple platforms Oversee integration of diverse data sources into unified and secure data More ❯

the hunt for builders . No, we've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries such as telecoms … ready to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We're Intuita - a fast growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for … have working across our business, becoming a pivotal part of our journey, to not just meet, but continuously exceed our client expectations! The Role We are seeking a skilled Data Engineer(s) to join our team, ideally initially on a contract basis, however longer term there is potential to discuss longer term opportunities in the shape of a permanent More ❯

The Contractor shall analyze requirements and design, code, test, debug, and document data pipelines. The Contractor shall have the ability to create and integrate application programming interfaces (APIs). Their technical skills generally include multiple programming languages and a deep knowledge of SQL database design. The data engineer role requires a more in-depth knowledge in programming for … integrating complex models and using advanced software library frameworks to distribute large, clustered data sets. Data engineers collect and arrange data in a form that is useful for analytics. Data Engineers should be familiar with both streaming and batch models of data movement, aware of the trade-offs between the two, and able to apply … that knowledge to solve for business and operational problems. The Contractor shall perform the following tasks: • Developing, maintaining, and testing infrastructures for data generation to transform data from various structured and unstructured data sources. • Develop complex queries to ensure accessibility while optimizing the performance of NoSQL and/or big data infrastructure. • Create, document, and More ❯

Description ICF is a rapidly growing, entrepreneurial, multi-faceted consulting company, seeking a Data Engineer. This resource will help bring new data insights to a government agency committed to improving child welfare. The ICF team performs custom software development, analytics, and maintenance on a suite of web-based applications, and works closely with clients and other contractors to … required and candidates must reside within 50 miles of the Washington, DC Metro Area to be considered. What you'll be doing: Help build, and optimize a AWS-based data lake to support AI/ML initiatives and advance analytics Design and implement scalable data ingestion pipelines for both batch and real-time data from diverse structured … and unstructured sources Perform extensive data profiling, transformation and enrichment to prepare clean, ML ready datasets for data scientists and analysts. Develop custom reports and data visualizations to support analytics, decision-making across business and technical teams Collaborate with data scientists and business teams to deliver curated datasets and reporting needs for ML and analytics. Support More ❯

Opportunity PeopleTec is currently seeking a Senior Developer to support our Huntsville, AL location. Job Functions: Proficiency with Power BI, data analysis, data query, data aggregation, data visualization, software development, system architecture, data transformation, data management, and big data technology. Capable of utilizing Extract, Transform, Load (ETL) processes. Experienced in writing complex … statements, scripts, stored procedures, triggers, and views to implement business intelligence and data warehousing solutions. Solid foundation in, and application of, data warehousing and reporting platform concepts with ability to recommend solutions and drive best practices. Familiarity with multiple business intelligence environments is preferred. Develop ETL mappings to extract data from a source data system (databases … files, etc.), transform the data based on business requirements and load the data into a target data system (databases, files, etc.). Conduct performance tuning of the mappings developed to ensure that the data is extracted, transformed, and loaded in a reasonable amount of time based on the requirements. Develop Business Intelligence (BI) reports using BI More ❯

Overview We are looking for seasoned Senior Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines. We are looking for more than just a "Senior Data Engineer", but a technologist with excellent communication and customer service skills and a passion for data and problem solving. Contributions … Responsibilities include: Lead and architect migration of data environments with performance and reliability. Assess and understand the ETL jobs, workflows, BI tools, and reports Address technical inquiries concerning customization, integration, enterprise architecture and general feature/functionality of data products Experience in crafting database/data warehouse solutions in cloud (Preferably AWS. Alternatively Azure, GCP). Key … must have skill sets - Python, AWS Support an Agile software development lifecycle You will contribute to the growth of our Data Exploitation Practice! Qualifications Qualifications: Ability to hold a position of public trust with the US government. Master's Degree in related program and 7 years of relevant experience; OR Bachelor's Degree in related program and 10 years More ❯

requirements, with appropriate technical scrutiny, over the entire lifecycle of the requirements from capability definition through capability realization and capability usage. We have a near-term need for a Data Scientist/AI Engineer (Enablement & Outreach) to provide onsite support in Norfolk, VA. Responsibilities As a member of the Data Science & Artificial Intelligence (DSAI) Branch, responsible to the … Section Head/COTR, the candidate will contribute to the development and implementation of an enabling data science and AI capability at HQ SACT and for the NATO Enterprise, particularly in the context of the ongoing implementation of the Data Exploitation Framework and Program. Identify, contribute to, and implement machine learning (ML)/AI initiatives across HQ SACT … and the NATO Enterprise with suggestions for ML approaches and implementation, including the processing of training data and performance assessment of machine learning techniques on datasets. Apply existing data science techniques to new problems and datasets using specialized programming techniques to meet the needs of the project and customer. Evaluate the outcomes and performance of data science More ❯

Enlighten, honored as a Top Workplace from USA Today, is a leader in big data solution development and deployment, with expertise in cloud-based services, software and systems engineering, cyber capabilities, and data science. Enlighten provides continued innovation and proactivity in meeting our customers' greatest challenges. We recognize that the most effective environment for your projects doesn … Will significantly contribute to the development of custom software components and integration of open-source code to address complex time series analysis problems through the use of cutting edge Big Data/Cloud technology. As a result, the candidate will be expected to work autonomously identifying and solving problems quickly while working toward broader strategic goals set by … ONE of the following certifications: CASP+ CE, CISSP, CSSLP, or CCSP may be required in this position as directed by the customer. Prior experience or familiarity with DISA's Big Data Platform or other Big Data systems (e.g. Cloudera's Distribution of Hadoop, Hortonworks Data Platform, MapR, etc ) is a plus. Experience with Kubernetes (or More ❯

Enlighten, honored as a Top Workplace from USA Today, is a leader in big data solution development and deployment, with expertise in cloud-based services, software and systems engineering, cyber capabilities, and data science. Enlighten provides continued innovation and proactivity in meeting our customers' greatest challenges. We recognize that the most effective environment for your projects doesn … strong Linux foundation. Will significantly contribute to the development of custom software components and integration of open-source code to address complex problems through the use of cutting edge Big Data/Cloud technology. As a result, the candidate will be expected to work autonomously identifying and solving problems quickly while working toward broader strategic goals set by … days per week at our Columbia, MD office. However, flexibility is essential to accommodate any changes in the schedule. Preferred Requirements Prior experience or familiarity with DISA's Big Data Platform or other Big Data systems (e.g. Cloudera's Distribution of Hadoop, Hortonworks Data Platform, MapR, etc ) is a plus. Experience with CI/CD More ❯

Enlighten, honored as a Top Workplace from USA Today, is a leader in big data solution development and deployment, with expertise in cloud-based services, software and systems engineering, cyber capabilities, and data science. Enlighten provides continued innovation and proactivity in meeting our customers' greatest challenges. We recognize that the most effective environment for your projects doesn … strong Linux foundation. Will significantly contribute to the development of custom software components and integration of open-source code to address complex problems through the use of cutting edge Big Data/Cloud technology. As a result, the candidate will be expected to work autonomously identifying and solving problems quickly while working toward broader strategic goals set by … oof 2 days per week at our San Antonio office. Flexibility is essential to adapt to schedule changes as needed. Preferred Requirements Prior experience or familiarity with DISA's Big Data Platform or other Big Data systems (e.g. Cloudera's Distribution of Hadoop, Hortonworks Data Platform, MapR, etc ) is a plus. Experience with CI/ More ❯

Developer to work in Huntsville, AL. Candidate must possess an active Top Secret/SCI Eligible clearance. The Senior Developer will possess a solid foundation in, and application of, data warehousing and reporting platform concepts with the ability to recommend solutions and drive best practices. The candidate will develop ETL mappings to extract data from a source data system (databases, files, etc.), transform the data based on business requirements and load the data into a target data system. The Senior Developer will conduct performance tuning of the mappings developed to ensure that the data is extracted, transformed, and loaded in a reasonable amount of time based on the requirements. The ideal candidate will … Secret Clearance/SCI Eligibility •At least eight (8+) years of experience •Esri products exp, ArcGIS online, Python, Tomcat administration, C#, Shell scripting, & AWS experience •Proficient with Power BI, data analysis, data query, data aggregation, data visualization, software development, system architecture, data transformation, data management, and big data technology •Capable of utilizing More ❯