1 to 25 of 364 Big Data Jobs

services that equip federal agencies with solutions to courageously transform today for a better tomorrow. Responsibilities: Responsible for developing, expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. Support software developers, database architects, data analysts and data scientists on data initiatives and ensure optimal data delivery architecture is consistent throughout ongoing projects. Creates new pipeline and maintains existing pipeline, updates Extract, Transform, Load (ETL) process, creates new ETL feature , builds PoCs with Redshift Spectrum, Databricks, AWS EMR, SageMaker, etc.; Implements ...

Description About the Role: As a Software Engineer at multiple levels, you will play a critical role in designing, developing, and maintaining scalable big data solutions that support complex and secure environments. Your work will directly contribute to the advancement of data processing capabilities using cutting-edge … maintaining an active Top Secret clearance. This position demands a strong proficiency in JavaScript for developing interactive and responsive user interfaces that complement backend data systems. Ultimately, your contributions will enable the organization to leverage big data insights securely and effectively, driving informed decision-making and operational ...

Description About the Role: As a Software Engineer at multiple levels, you will play a critical role in designing, developing, and maintaining scalable big data solutions that support complex and secure environments. Your work will directly contribute to the advancement of data processing capabilities using cutting-edge … maintaining an active Top Secret clearance. This position demands a strong proficiency in JavaScript for developing interactive and responsive user interfaces that complement backend data systems. Ultimately, your contributions will enable the organization to leverage big data insights securely and effectively, driving informed decision-making and operational ...

Data Reliability Engineer II (dRE) Role Overview: A crucial role in CME's Cloud transformation, the dRE II will be aligned to data product pods ensuring that our data infrastructure is reliable, scalable, and efficient as the GCP data footprint expands rapidly. Accountabilities: Automate data tasks on Google Cloud Platform (GCP). Work with data domain owners, data scientists, and other stakeholders to ensure that data is consumed effectively on GCP. Design, build, secure, and maintain data infrastructure, including data pipelines, databases, data warehouses, and data processing ...

Description Job DescriptionFracsys Inc is hiring a AWS Data Engineer position. The ideal candidate must have at least 8+ years of industry experience. He or she must be responsible for successful technical delivery of Data Warehousing and Business Intelligence projects. This positions requires US Citizenship due to Clearance … requirements. Responsibilities Data extraction, Data cleaning, Data Loading, Statistical Data Analysis, Exploratory Data Analysis, Data Wrangling, Write complex SQL queries and stored procedures to extract, manipulate, and analyze data from relational databases Conduct diagnostic, troubleshooting steps and present conclusions to a varied audience ...

Description Job DescriptionInfomatics is hiring a Senior Data Engineer on a direct hire/FTE basis to lead design, development and implementation efforts on our client's Enterprise Analytics platform which includes an MPP Enterprise Data Warehouse, cloud-based Data Lake and other Big Data technologies. Essential Duties and Responsibilities : Guides the the strategic capabilities and architecture design related to Data Warehousing, Big Data and Data analytics in close collaboration with Technical Leadership. Architects and develops code for large-scale ETL pipelines with data processing frameworks supporting distributed data ...

summary What you'll lead Working as part of BrisDoc's Business Transformation team, the Senior Data Engineer will take a lead role in developing and building our cloud architecture, data lake and warehousing, and data pipelines to support the organisation's service development and improvement. … hours urgent care services during an important time of change and development in NHS care, with a shift to more digitised, technological and data-driven services that support the delivery of excellent healthcare services. The role will work across BrisDoc and its clinical, operational and back-office services, clearly ...

cloud development and footprint in national-security focused agencies within the Department of Defense and U.S. Intelligence Community. We are seeking to hire a Data Engineer to our team! Client: CTEC develops and delivers innovative customer-centric technologies and solutions that support the Office of Personnel Management … Health and Insurance business unit and Office of the Chief Information Officer (OCIO). Duties and Responsibilities: Data Pipeline & ETL Development: Design, develop, and maintain scalable ETL pipelines and data workflows to ingest, transform, and integrate data from legacy systems and external sources into modern cloud-based ...

Description Job Description Description: Hybrid 3 days onsite/2 days remote in Rockville, MD Our client seeks a Big Data Engineer to design and optimize large-scale data processing on AWS with Spark and Kubernetes. The role will implement containerized workloads on EMR on EKS, build … scalable data pipelines, and improve performance, reliability, and observability. The engineer will collaborate with cross-functional teams, apply Spark tuning expertise, and manage Kubernetes-based infrastructure to support data-driven outcomes. Financial industry experience is beneficial. We can facilitate w2 and corp-to-corp consultants. ...

NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute complex operations … worlds leading corporations. EXL was founded on the core values of innovation, collaboration, excellence, integrity and respect, creating value from data to ensure faster decision-making and transforming operating models. Key industries include Insurance, Healthcare, Banking and Financial Services, Media, and Retail, among others. Headquartered in New York ...

Your new company Working for a renowned financial services organisation Your new role We're looking for a Data Engineer to design and deliver scalable on prem, high-quality data solutions for low/high-level data platforms that power analytical and business insights. This … hands-on role suited to someone with strong data engineering and big data expertise, ideally gained within financial services.Using , Big Data tools and Spark development you will ensure data quality through automated validation, monitoring, and testing. You will also enable seamless integration across data ...

this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer requirements … definition, effort and cost estimation, Past experience in dealing with partners, tools vendors, etc. Business Domain Knowledge More than 5 years of experience in Big Data implementation projects Experience in the definition of Big Data architecture with different tools and environments: Cloud (AWS, Azure ...

Description Job DescriptionDatabricks Data EngineerWho we are Horizon Industries Limited (Horizon) is a dynamic IT and Management Consulting firm based in the Washington, DC area. Founded in 1996, Horizon Industries Limited (Horizon) has evolved into a company of highly qualified professionals that provides full-cycle IT Consultant and Management … core values, and we PRIDE ourselves on a diverse, employee, and family-centric approach. Who we are looking for We are seeking a Databricks Data Engineer for a full-time position supporting our various clients We are committed to your growth and success in the IT software development industry. ...

DescriptionEast Tennessee Department of Energy Facility is looking for a SIEM Engineer who would be responsible for the process of acquiring, importing, and preparing data from various sources into a data storage or processing system. This role is critical in ensuring that data is available, accurate … ready for analysis. The specific duties and responsibilities include:1. Data Acquisition: - Identifying and connecting to various data sources (e.g., databases, APIs, file systems, streaming data sources). - Developing and maintaining data pipelines to automate the ingestion of data from these sources.2. Data Transformation ...

Description Job Description KDA Consulting Inc. is seeking a highly skilled Full Stack Developer with Big Data expertise to support mission-critical programs within the Intelligence Community (IC). This role will focus on designing, developing, and maintaining scalable applications that process and analyze large volumes of data in support of national security objectives. The ideal candidate will bring a strong mix of full stack engineering capabilities and data-intensive application experience , with the ability to operate in a fast-paced, highly collaborative environment. This position offers the opportunity to work on modernized systems, cloud-based ...

innovation. Our teams are at the frontier of the Nation's most complex and rewarding challenges. Join our team. Barbaricum is seeking a Data Engineer to provide support an emerging capability for the USSTRATCOM J2 at Offutt Air Force Base near Omaha, Nebraska. This individual will work to migrate … existing ad hoc data flows to JWICS AWS available to the enterprise. Initially, the Data Engineer will use Python to automate data gathering and data cleaning efforts. Using these foundational efforts, the Data Engineer will then develop, implement, and operate a data management system ...

innovation. Our teams are at the frontier of the Nation's most complex and rewarding challenges. Join our team. Barbaricum is seeking a Data Engineer to provide support an emerging capability for the USSTRATCOM J2 at Offutt Air Force Base near Omaha, Nebraska. This individual will work to migrate … existing ad hoc data flows to JWICS AWS available to the enterprise. Initially, the Data Engineer will use Python to automate data gathering and data cleaning efforts. Using these foundational efforts, the Data Engineer will then develop, implement, and operate a data management system ...

finalist in 2021! Belay Technologies is seeking a Cloud Engineer to join our intel team. The SWE develops, maintains, and enhances complex and diverse Big-Data cloud systems based on documented requirements. The Cloud Software Engineer provides expertise in cloud computing, and Eco-System, including implementing applications, distributed … developing software with high-level languages, such as Java, C, and C++. Shall have at least two (2) years of experience with distributed scalable Big Data Store (NoSQL), such as HBase, CloudBase/Accumulo, Big Table, etc., as well as two (2) years of experience with ...

days/week Flexible working : Variety of flexible work patterns subject to line manager discretion e.g. Compressed 9-day fortnight. Reports to: Lead Data Engineer Deadline Note: We reserve the right to close the advert before the advertised deadline if there are a high volume of applications. Role Summary … Senior data engineer role will have a specific focus on data and integration, ensuring that they drive single version of the truth by developing and maintaining reliable solutions to store and manage key data. The role will source, model, and provide data in a form which ...

supportive environment where people are trusted, valued and encouraged to grow their careers within a forward-thinking organisation. Your new role As a Data Architect, you'll play a key role in shaping how data is designed, managed and used across the business. You'll set the architectural … direction for our data estate - from the point data first lands on the platform, through the Bronze, Silver and Gold layers of our Medallion Architecture, and all the way to analytics, AI and self-service reporting.Working within the Microsoft Azure and Databricks ecosystem, you'll help build ...

Description Job Description KDA Consulting Inc. is seeking a highly skilled Data Engineer to design, build, and maintain scalable data pipelines and architectures supporting mission-critical programs within the Intelligence Community (IC). This role focuses on enabling efficient data processing, analytics, and decision-making by delivering … reliable, high-quality data solutions in cloud environments. The ideal candidate will have strong experience with AWS cloud services, data engineering best practices, and big data technologies , with the ability to operate in a fast-paced, collaborative environment supporting complex mission systems. Data Pipeline Development ...

Description Job Description Cloud Software Engineer - Big Data/Cloud - 12+ yrs of Experience - TS/SCI with Poly Required Halogen Engineering Group is looking for a Cloud Software Engineer who can develop, maintain, and enhance complex and diverse Big-Data Cloud systems based upon documented … Computer Science or related discipline from an accredited college or university is required; four (4) years of which must be in programs utilizing Big-Data cloud technologies and/or Distributed Computing. Four (4) years of cloud software engineering experience on projects with similar Big-Data ...

Description Job Description Cloud Software Engineer - Big Data/Cloud - 8+ yrs of Experience - TS/SCI with Poly Required Halogen Engineering Group is looking for a Cloud Software Engineer who can develop, maintain, and enhance complex and diverse Big-Data Cloud systems based upon documented … engineering experience in programs and contracts of similar scope, type, and complexity is required; two (2) years of which must be in programs utilizing Big-Data Cloud technologies and/or Distributed Computing. Bachelors degree in Computer Science or related discipline from an accredited college or university ...

Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group, Akkodis combines the expertise of AKKA and Modis, with over 50,000 engineers … EMEA, and APAC. Our teams bring extensive cross-sector knowledge in critical technology areas such as mobility, software services, robotics, simulations, cybersecurity, AI, and data analytics, enabling clients to tackle complex challenges in today’s rapidly evolving markets. Scope: Akkodis is launching a new technical delivery team to drive ...

London Office.Full time hours. We are happy to discuss flexible working! Top 3 skills needed for this role: Expert in building scalable, high-quality data pipelines Hands-on experience with cloud data platforms The ability to optimise, automate, and deliver reliable data solutions independently What this role … about: Join us as a Data Engineer and become a driving force behind high-impact, high-performance data solutions. Youll take ownership of designing and supercharging data pipelines that keep our business moving, bringing fresh thinking and technical flair to every challenge. Your voice will shape ...