1 to 25 of 574 Big Data Jobs

services that equip federal agencies with solutions to courageously transform today for a better tomorrow. Responsibilities: Responsible for developing, expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. Support software developers, database architects, data analysts and data scientists on data initiatives and ensure optimal data delivery architecture is consistent throughout ongoing projects. Creates new pipeline and maintains existing pipeline, updates Extract, Transform, Load (ETL) process, creates new ETL feature , builds PoCs with Redshift Spectrum, Databricks, AWS EMR, SageMaker, etc.; Implements ...

Description Job Description Job Overview: The Lead Data Engineer is responsible for designing, developing, and managing scalable data integration frameworks and data platforms. This role involves leading engineering teams, implementing data solutions, and ensuring optimal performance, reliability, and scalability of data systems. The candidate will … work on data warehouses, data lakes, and large-scale data processing while driving best practices in data engineering and analytics. Requirement/Must Have: Strong experience in designing and implementing ETL/ELT solutions. Hands-on experience with data warehouses, data lakes, and large ...

Description About the Role: As a Software Engineer at multiple levels, you will play a critical role in designing, developing, and maintaining scalable big data solutions that support complex and secure environments. Your work will directly contribute to the advancement of data processing capabilities using cutting-edge … maintaining an active Top Secret clearance. This position demands a strong proficiency in JavaScript for developing interactive and responsive user interfaces that complement backend data systems. Ultimately, your contributions will enable the organization to leverage big data insights securely and effectively, driving informed decision-making and operational ...

Description About the Role: As a Software Engineer at multiple levels, you will play a critical role in designing, developing, and maintaining scalable big data solutions that support complex and secure environments. Your work will directly contribute to the advancement of data processing capabilities using cutting-edge … maintaining an active Top Secret clearance. This position demands a strong proficiency in JavaScript for developing interactive and responsive user interfaces that complement backend data systems. Ultimately, your contributions will enable the organization to leverage big data insights securely and effectively, driving informed decision-making and operational ...

Data Reliability Engineer II (dRE) Role Overview: A crucial role in CME's Cloud transformation, the dRE II will be aligned to data product pods ensuring that our data infrastructure is reliable, scalable, and efficient as the GCP data footprint expands rapidly. Accountabilities: Automate data tasks on Google Cloud Platform (GCP). Work with data domain owners, data scientists, and other stakeholders to ensure that data is consumed effectively on GCP. Design, build, secure, and maintain data infrastructure, including data pipelines, databases, data warehouses, and data processing ...

Description Job Description Next Phase Solutions and Services is seeking a Senior Solutions Architect to support a federal data analytics modernization initiative. This role will provide technical leadership and hands-on expertise in designing, implementing, and optimizing scalable data platforms, with a focus on cloud-based big … data environments, analytics pipelines, and data visualization solutions. The ideal candidate brings deep experience in data platform architecture, big data technologies, and visualization tools, along with prior experience supporting federal agencies such as DHS or USCIS. This individual will play a key role in shaping ...

Description Job DescriptionFracsys Inc is hiring a AWS Data Engineer position. The ideal candidate must have at least 8+ years of industry experience. He or she must be responsible for successful technical delivery of Data Warehousing and Business Intelligence projects. This positions requires US Citizenship due to Clearance … requirements. Responsibilities Data extraction, Data cleaning, Data Loading, Statistical Data Analysis, Exploratory Data Analysis, Data Wrangling, Write complex SQL queries and stored procedures to extract, manipulate, and analyze data from relational databases Conduct diagnostic, troubleshooting steps and present conclusions to a varied audience ...

Description Job DescriptionInfomatics is hiring a Senior Data Engineer on a direct hire/FTE basis to lead design, development and implementation efforts on our client's Enterprise Analytics platform which includes an MPP Enterprise Data Warehouse, cloud-based Data Lake and other Big Data technologies. Essential Duties and Responsibilities : Guides the the strategic capabilities and architecture design related to Data Warehousing, Big Data and Data analytics in close collaboration with Technical Leadership. Architects and develops code for large-scale ETL pipelines with data processing frameworks supporting distributed data ...

summary What you'll lead Working as part of BrisDoc's Business Transformation team, the Senior Data Engineer will take a lead role in developing and building our cloud architecture, data lake and warehousing, and data pipelines to support the organisation's service development and improvement. … hours urgent care services during an important time of change and development in NHS care, with a shift to more digitised, technological and data-driven services that support the delivery of excellent healthcare services. The role will work across BrisDoc and its clinical, operational and back-office services, clearly ...

Description Job Description Analytica is seeking an experienced Data Architect to design, implement, and optimize enterprise data solutions in support of federal government missions. The Data Architect will play a hands-on role in modernizing data environments, leveraging cloud-native technologies, Databricks, and advanced data engineering frameworks to ensure scalable, secure, and high-performing solutions. This role requires strong expertise in cloud platforms (AWS, Azure, GCP), big data ecosystems, and modern data architecture patterns , along with an ability to translate mission needs into technical solutions. Analytica has been recognized by Inc. ...

cloud development and footprint in national-security focused agencies within the Department of Defense and U.S. Intelligence Community. We are seeking to hire a Data Engineer to our team! Client: CTEC develops and delivers innovative customer-centric technologies and solutions that support the Office of Personnel Management … Health and Insurance business unit and Office of the Chief Information Officer (OCIO). Duties and Responsibilities: Data Pipeline & ETL Development: Design, develop, and maintain scalable ETL pipelines and data workflows to ingest, transform, and integrate data from legacy systems and external sources into modern cloud-based ...

Description Job Description Description: Hybrid 3 days onsite/2 days remote in Rockville, MD Our client seeks a Big Data Engineer to design and optimize large-scale data processing on AWS with Spark and Kubernetes. The role will implement containerized workloads on EMR on EKS, build … scalable data pipelines, and improve performance, reliability, and observability. The engineer will collaborate with cross-functional teams, apply Spark tuning expertise, and manage Kubernetes-based infrastructure to support data-driven outcomes. Financial industry experience is beneficial. We can facilitate w2 and corp-to-corp consultants. ...

Description Job Description Senior IT Data Engineer (Cloudera/Big Data Platforms) Location: Washington, DC Clearance Requirement: U.S. Citizenship required About The Britton Group The Britton Group is a premier provider of intelligence and national security solutions, specializing in mission-critical IT services, enterprise digital transformation, artificial … agile solutions to the federal government, we are a trusted partner to the Intelligence Community. The Opportunity This position supports a mission-critical data engineering initiative focused on building, optimizing, and sustaining enterprise data pipelines within a large-scale distributed data environment. The selected candidate will play ...

NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute complex operations … worlds leading corporations. EXL was founded on the core values of innovation, collaboration, excellence, integrity and respect, creating value from data to ensure faster decision-making and transforming operating models. Key industries include Insurance, Healthcare, Banking and Financial Services, Media, and Retail, among others. Headquartered in New York ...

Your new company Working for a renowned financial services organisation Your new role We're looking for a Data Engineer to design and deliver scalable on prem, high-quality data solutions for low/high-level data platforms that power analytical and business insights. This … hands-on role suited to someone with strong data engineering and big data expertise, ideally gained within financial services.Using , Big Data tools and Spark development you will ensure data quality through automated validation, monitoring, and testing. You will also enable seamless integration across data ...

Description Job Description Position: Senior Data Architect Location: Mostly Remote with occasional Travel to Herndon, VA or other states Length: 6 -12 -month Contract to Hire Target Pay Range: $110 - $115/Hourly Target Conversion Salary : $163,500 - $212,500/Annually Work Auth … Position is not eligible for sponsorship. Benefits: This position may be eligible for medical, dental, vision, and 401(k). The Senior Architect, Cloud Data is a member of the Chief Data Office and plays a lead role in the overall design and implementation of the organization ...

matching Competitive salary Health insurance Paid time off About this Role: Imagineeer is seeking an experienced ETL Developer to design, develop, and implement robust data integration solutions that enable efficient data movement and transformation across enterprise systems. This role is vital for ensuring data is accurately extracted … intelligence, reporting, and analytics initiatives. The ideal candidate possesses strong technical expertise in ETL tools and methodologies, combined with excellent problem-solving skills and data management knowledge. This position may require the ability to obtain and maintain a Public Trust clearance. Key Responsibilities: Design, develop, and implement ETL processes ...

Time On-site or Hybrid (based on contract requirements) Overview Navteca is seeking a Business Intelligence (BI) Architect/Developer with strong experience in data analysis, business intelligence, and data engineering. This role supports enterprise data initiatives by designing, developing, and maintaining data pipelines, reporting systems … analytics solutions. The ideal candidate will have hands-on experience across the full data lifecyclefrom data ingestion and transformation to reporting and visualizationand will play a key role in enabling data-driven decision-making across multiple systems. Key Responsibilities Design, develop, and maintain business intelligence and data ...

this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer requirements … definition, effort and cost estimation, Past experience in dealing with partners, tools vendors, etc. Business Domain Knowledge More than 5 years of experience in Big Data implementation projects Experience in the definition of Big Data architecture with different tools and environments: Cloud (AWS, Azure ...

/Databricks • Leverage Spark and SQL to process and transform large scale datasets • Develop and optimize ELT/ETL processes for high volume of data workflows • ETL: Hands on experience of building data pipelines. Proficiency in data integration platforms such as Apache Spark or Talend• Big … Data: Experience of 'big data' platforms such as Hadoop, Hive or Snowflake for data storage and processing• Data Warehousing & Database Management: Understanding of Data Warehousing concepts, Relational Oracle database design• Data Modeling & Design: Good exposure to data modeling techniques; design, optimization ...

Description Job DescriptionDatabricks Data EngineerWho we are Horizon Industries Limited (Horizon) is a dynamic IT and Management Consulting firm based in the Washington, DC area. Founded in 1996, Horizon Industries Limited (Horizon) has evolved into a company of highly qualified professionals that provides full-cycle IT Consultant and Management … core values, and we PRIDE ourselves on a diverse, employee, and family-centric approach. Who we are looking for We are seeking a Databricks Data Engineer for a full-time position supporting our various clients We are committed to your growth and success in the IT software development industry. ...

DescriptionEast Tennessee Department of Energy Facility is looking for a SIEM Engineer who would be responsible for the process of acquiring, importing, and preparing data from various sources into a data storage or processing system. This role is critical in ensuring that data is available, accurate … ready for analysis. The specific duties and responsibilities include:1. Data Acquisition: - Identifying and connecting to various data sources (e.g., databases, APIs, file systems, streaming data sources). - Developing and maintaining data pipelines to automate the ingestion of data from these sources.2. Data Transformation ...

Description Job Description KDA Consulting Inc. is seeking a highly skilled Full Stack Developer with Big Data expertise to support mission-critical programs within the Intelligence Community (IC). This role will focus on designing, developing, and maintaining scalable applications that process and analyze large volumes of data in support of national security objectives. The ideal candidate will bring a strong mix of full stack engineering capabilities and data-intensive application experience , with the ability to operate in a fast-paced, highly collaborative environment. This position offers the opportunity to work on modernized systems, cloud-based ...

months or longer Workplace: Remote Visa: USC/GC/GC-EAD Location: Houston, TX Client: Fujitsu Managing Technical Consultant Job Description: The Azure Data Lake Engineer is responsible for designing, building, and maintaining scalable data ingestion, storage, and processing solutions on Microsoft Azure, primarily using Azure Data Lake Storage (ADLS), Azure Data Factory, and related services. Top 3 Must Skills 1. 12+ years hands-on experience building scalable ETL/ELT pipelines using Azure Data Factory (mapping data flows, pipelines, triggers)& Synapse pipelines. 2. Experience building data ingestion frameworks, data validation ...

innovation. Our teams are at the frontier of the Nation's most complex and rewarding challenges. Join our team. Barbaricum is seeking a Data Engineer to provide support an emerging capability for the USSTRATCOM J2 at Offutt Air Force Base near Omaha, Nebraska. This individual will work to migrate … existing ad hoc data flows to JWICS AWS available to the enterprise. Initially, the Data Engineer will use Python to automate data gathering and data cleaning efforts. Using these foundational efforts, the Data Engineer will then develop, implement, and operate a data management system ...