251 to 265 of 265 Permanent Data Lake Jobs

Job Number: 260 Job Title: DATA ENGINEER (260) - MARYLAND -URGENT Job Type: Full-time Clearance Level: Top Secret/SCI - Full Scope Polygraph Work Arrangement: On-site Job Location: Annapolis Junction MD Salary: 129K-155K Background Collaborate closely with a team of developers to fulfill data integration requirement Write and maintain code using an ETL platform … to ensure data is transformed into suitable formats as defined by IC ITE initiatives Interface with external teams and systems, employing various protocols including HTML and SFTP to collect data efficiently Enhance the ETL platform by adding features aimed at shortening timelines for future data integration effort Develop and maintain software, ensuring seamless integration … into a fully functional system Collaboration with external teams will be necessary to validate data ingest processes Responsible for providing comprehensive documentation covering system architecture, development, and any enhancements made throughout the process Requirements Bachelor's degree with 9+ years of professional experience Master's degree with 7+ years of professional experience PhD with 5+ years of professional More ❯

integrate CRM and Commerce solutions from leading platforms (Salesforce, Microsoft, Oracle, etc.) based on client needs. Design robust architectures that integrate CRM and commerce solutions with ERP systems, data platforms, analytics tools (Tableau, Power BI), and external systems. Lead large-scale digital transformation projects, ensuring alignment of CRM solutions with ERP, data lakes, cloud infrastructure, and … experience with CRM platforms such as Salesforce, SAP, Microsoft Dynamics, or Oracle working across sales, service and marketing. Proven expertise in delivering complex CRM integrations with external systems (Data Lakes, ERP, analytical platforms, and messaging systems) Experience with commerce platforms (such as Salesforce commerce cloud, Adobe commerce, etc ) and integration platforms (such as Mulesoft, Dell Boomi, etc) Have More ❯

DevOps Engineer/Data Engineer – Azure Data Platform 6 Month Contract Hybrid Working - Newcastle Or Leeds £400-£450 Inside IR35 We are looking for an experienced DevOps Engineer to join our team and take a leading role in developing, supporting, and optimising our Microsoft Azure Data Platform. This is a hands-on position where … you will exercise substantial autonomy, solve complex challenges, and help shape our data platform strategy. Key Responsibilities: Develop, support, and optimise solutions across Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake. Design, build, and maintain Infrastructure and Configuration as Code using Terraform. Implement and manage CI/CD pipelines (ideally in GitLab … for SC Clearance (must have lived and worked in the UK for the past 5 years). Strong experience with Microsoft Azure services including ADF, Synapse Analytics, and Data Lake. Additional experience with Azure DevOps. Demonstrable experience developing and supporting cloud-based applications. Proficiency with Infrastructure as Code (Terraform). Hands-on experience with CI/CD pipelines More ❯

DevOps Engineer/Data Engineer – Azure Data Platform 6 Month Contract Hybrid Working - Newcastle Or Leeds £400-£450 Inside IR35 We are looking for an experienced DevOps Engineer to join our team and take a leading role in developing, supporting, and optimising our Microsoft Azure Data Platform. This is a hands-on position where … you will exercise substantial autonomy, solve complex challenges, and help shape our data platform strategy. Key Responsibilities: Develop, support, and optimise solutions across Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake. Design, build, and maintain Infrastructure and Configuration as Code using Terraform. Implement and manage CI/CD pipelines (ideally in GitLab … for SC Clearance (must have lived and worked in the UK for the past 5 years). Strong experience with Microsoft Azure services including ADF, Synapse Analytics, and Data Lake. Additional experience with Azure DevOps. Demonstrable experience developing and supporting cloud-based applications. Proficiency with Infrastructure as Code (Terraform). Hands-on experience with CI/CD pipelines More ❯

We are seeking an experienced Data Engineer with expertise in AWS cloud technologies to design and build ETL pipelines , data warehouses , and data lakes . Key Skills: AWS services like EMR, Glue, Redshift, Kinesis, Lambda, DynamoDB (or equivalent open-source tools). Note: We require candidates who are eligible for SC Clearance or possess More ❯

We are seeking an experienced Data Engineer with expertise in AWS cloud technologies to design and build ETL pipelines , data warehouses , and data lakes . Key Skills: AWS services like EMR, Glue, Redshift, Kinesis, Lambda, DynamoDB (or equivalent open-source tools). Note: We require candidates who are eligible for SC Clearance or possess More ❯

8+ years of experience in Data Integration and ETL development. Strong hands-on expertise in Oracle Data Integrator (ODI 12c). Proficiency in Google BigQuery, including writing optimized SQL queries and understanding partitioning/clustering. Experience in working with cloud platforms, preferably Google Cloud Platform (GCP). Solid understanding of data warehousing concepts, dimensional … modeling, and data lakes. Experience with relational databases (e.g., Oracle, SQL Server, PostgreSQL). Ability to troubleshoot and resolve complex data transformation and integration issues. Experience working in Agile/Scrum environments. Strong analytical, problem-solving, and communication skills. More ❯

Our Client is a leading data analytics industry operating in the DOD & Federal industry. They are at the forefront of innovation, providing groundbreaking Data and Mobile solutions to help our customers extract valuable insights from vast amounts of data. Role Summary We are seeking a Cleared Mobile Developer to join their product team. In this role … Essential Skills & Experience • Proven experience in React Native, Flutter, Swift, Objective-C, Java, or Kotlin • Familiarity with MapBox is advantageous • Knowledge of Node.JS is a plus • Experience with data warehouses and data lakes is desirable • Strong communication skills and the ability to work independently Desirable Skills & Experience • Background in working with big data • Proficiency … with a passion for creating impactful solutions, we want to hear from you. Join our team and be part of a company dedicated to pushing the boundaries of data analytics. Submit your CV today. More ❯

ML solutions design, architecture and development and deployment of large scale machine learning or deep learning models and/or systems into production, including batch and real-time data processing. - Working knowledge of generative AI and hands-on experience in prompt engineering, deploying and hosting Large Foundational Models - Strong communication skills in English and Spanish with the ability … network, compute, storage, and virtualization experience - AWS experience preferred, with proficiency in a wide range of AWS services (e.g., EC2, S3, RDS, Lambda, SageMaker pipelines, Glue, LakeFormation, LLM, Bedrock, Datalake, MLOps, Model inference, Model Monitoring, Bedrock, and other ML services) - AWS Associate level certifications (e.g., Solutions Architect Associate, Machine Learning Associate) - Experience with automation and scripting (e.g., Terraform, Python) Amazon … We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice ( ) to know more about how we collect, use and transfer the personal data of our More ❯

We're working with a hi-tech simulation/data-analytics company which services the defence and security market. They are looking to expand their in-house software engineering capability with the addition of a Full Stack Software Developer. This mid-level role that would suite developers with ideally 3-6 years' experience, please still apply if your … performance Supporting ongoing system integration, testing, and documentation What We're Looking For: Strong back-end development experience (ideally in Python), particularly working with both structured and unstructured data (e.g. SQL, NoSQL, data lakes). Proficient in modern front-end technologies (HTML/CSS, JavaScript, React or similar). Experience working collaboratively as part of a More ❯

Weareisseekinganexperienced DataArchitect topartnerwithleadingfinancialservicesclientsindeliveringinnovative,scalable,andsecuredatasolutions. Whatyoulldo: Collaboratewithclientstoassessdataneeds,designarchitectures,anddeveloproadmapsalignedtobusinessanddatastrategies. Translatebusinessrequirementsintorobust,compliant,andfuture-prooftechnicalsolutions. Designandimplementdatawarehousingsolutions,datalakes,andETLprocesses. Ensurealignmentofdataarchitecturewithorganisationalgoalsandregulatorystandards. Keepaheadofemergingtechnologiesandbestpracticesindataarchitecture,analytics,andcloudplatforms. Essential: Strongunderstandingofthefinancialservicesindustry. Extensiveknowledgeofscalable,efficient,andsecuredataarchitecture. Experiencewithdatawarehousing,datalakes,ETLprocesses. Proficiencyinlogicalandphysicaldatamodelling. Knowledgeofcloudplatforms(AWS,Azure,GoogleCloud,Snowflake). Excellentcommunicationandstakeholdermanagementskills. ProactiveapproachtoemergingtechnologiesandMicrosofttechstack. More ❯

research informatics. You will architect and industrialize the operational backbone of our discovery platform, enabling scientists to work faster, smarter, and at scale, while ensuring high-quality, reproducible data generation to power our AI/ML-driven discovery engine. You will be a key member of the R&D Leadership Team, responsible for shaping strategy, integrating operational functions … R&D infrastructure into a fully integrated, automation-enabled, digitally connected lab. Champion the adoption of modern lab technologies, automated workflows, and informatics platforms to maximize efficiency, scalability, data quality and accessibility. Oversee the design, deployment, and continuous improvement of a modern informatics stack for data capture, analysis, and sharing across teams. Ensure operational systems and … align operational capabilities with scientific priorities. Manage and expand external relationships with technology providers, automation vendors, CROs, and academic collaborators. Build and lead a multidisciplinary platform operations and data team, blending expertise in lab operations, automation engineering, and research informatics. Foster a culture of innovation, inclusivity, and scientific excellence, while mentoring emerging leaders. Present to the company's More ❯

Description As part of the Platform & AI Enablement team under GPTO Engineering, you'll report to the Sr. Director Engineering API. This team is accountable for shaping enterprise data architecture, enabling high-performance AI-driven workloads, and acting as a technical bridge between engineering and architecture. Your Impact Lead the design and delivery of platform capabilities powering enterprise … scale data processing, AI integration, and developer acceleration Partner with architects and senior engineers to set technical direction and align implementation patterns with long-term strategy Apply a product mindset to ensure platform solutions address real customer and business needs Deliver thought leadership and coding excellence across Java, React, Python, and other fit-for-purpose technologies Mentor and … technical dead-ends Contribute to technical planning, strategy, and retrospectives that shape the future of the platform Your Qualifications 12+ years of software engineering experience in enterprise-scale, data-centric, or platform environments Deep expertise in distributed data technologies such as Apache Kafka, Flink, and/or Pulsar Strong background in event-driven architectures, streaming pipelines More ❯

security teams through full lifecycle development: requirements, architecture, implementation, accreditation, and O&M • Develop and oversee the implementation of secure unidirectional (e.g., OWL) and bidirectional (e.g., HAGs, CDGs) data transfer mechanisms between domains • Interface with NSA NCDSMO, DISA, and authorizing officials (AOs) to guide systems through CDS approval/accreditation (e.g., CDTAB) • Author and validate CDS artifacts such … Risk Assessments, Security Architectures, Test Plans, Filtering Strategies, Interface Control Documents (ICDs), and Security Impact Assessments (SIAs) • Guide integration of CDS with Zero Trust Architecture (ZTA), cloud enclaves, data lakes, and secure DevSecOps pipelines • Represent the program to senior government stakeholders, vendors, and mission partners on all CDS-related matters • Maintain enterprise awareness of emerging CDS technologies, high … DoD, or Federal Civilian mission environments • Understanding of NSA Raise the Bar (RTB), NCDSMO governance, DoDI 8540.01/8500.01/RMF/CDTAB/CDSE process • Experience with Data Diodes/One Way Links (OWL, Fox-IT), High Assurance Guards (Radiant Mercury, ISSE Guard, Forcepoint Data Guards, SDoT), Transfer Guards (TGS, Downgrade Server), and Access Solutions More ❯

large-scale training of multi-modal LLM/VLM/VLA systems integrating inputs such as vision, audio, proprioception, LiDAR, and point cloud data. Build end-to-end data pipelines : collect sim/tele-op logs, manage versioned data lakes, apply weak supervision, curate datasets, and run evaluation loops. Collaborate with MLOps and Data More ❯