51 to 75 of 293 Permanent Apache Jobs

and Data Practice. You will have the following experience : 8+ years of experience in data engineering or cloud development. Strong hands-on experience with AWS services Proficiency in Databricks, Apache Spark, SQL, and Python. Experience with data modeling, data warehousing, and DevOps practices. Familiarity with Delta Lake, Unity Catalog, and Databricks REST APIs. Excellent problem-solving and communication skills. More ❯

event driven analytics; set of analytics orchestrated through rules engine.• Experience documenting data models, schemas, data element dictionaries, and other technical specifications. • Pig• PySpark • Piranhas Desired:• Python• Java• Scala• Apache NiFi• Ansible• Experience working in Agile environment. • Experience deploying applications in a cloud environment• MongoDB Security Clearance Required: TS/SCI with Poly About Avid Technology Professionals Avid Technology More ❯

with modern web technologies (i.e., Node.js, React) RDBMS database design (i.e., PostgreSQL, Oracle DB, MySQL) Service Oriented Architecture (SOA) and web services (i.e., REST, AJAX, JSON) Application hosting (i.e., Apache, Tomcat, Nginx) Source Code Management (i.e., Git) Containerization and orchestration technologies (i.e., Docker, Kubernetes) CI/CD automation tools (i.e., Jenkins, Tekton) Experience with Agile software development Experience with More ❯

NoSQL databases such as MongoDB, ElasticSearch, MapReduce, and HBase.1. Demonstrated experience working with big data processing and NoSQL databases such as MongoDB, ElasticSearch, MapReduce, and HBase. Demonstrated experience with Apache NiFi. Demonstrated experience with the Extract, Transform, and Load (ETL) processes. Demonstrated experience managing and mitigating IT security vulnerabilities using Plans of Actions and Milestones (POAMs). Demonstrated experience More ❯

applications and high proficiency SQL for complex querying and performance tuning. ETL/ELT Pipelines: Proven experience designing, building, and maintaining production-grade data pipelines using Google Cloud Dataflow (Apache Beam) or similar technologies. GCP Stack: Hands-on expertise with BigQuery , Cloud Storage , Pub/Sub , and orchestrating workflows with Composer or Vertex Pipelines. Data Architecture & Modelling: Ability to More ❯

Databricks, Cloud RDS, NiFi, AWS Redshift, and Elasticsearch. Preferred Skills • Databricks workflows • Databricks Unity Catalog • Databricks Autoloader • Databricks Delta Live Tables/Delta Lake • Databricks Workspace/Notebooks • MLflow • Apache Spark • Experience with collaboration tools: MS Teams, Outlook, SharePoint, Confluence. • AWS Professional certification or equivalent. • Excellent problem-solving and communication skills. • Familiarity with CISA Securing the Software Supply Chain More ❯

SQLite, and/or Arc SDE o Web: e.g API's, GeoJson, REST Demonstrated experience with two or more cloud based technologies. o e.g. Docker containers, Jupyter Hub, Zeppelin, Apache-Spark, Centos, Jenkins, GIT Domain knowledge/IC: o Background in intelligence, defense, international relations, or public administration multi-disciplines. Demonstrated familiarity with the US Intelligence Community specifically GEOINT More ❯

data solutions. • Work with relational, NoSQL, and cloud-based data platforms (PostgreSQL, MySQL, MongoDB, Elasticsearch, AWS/GCP data services). • Support data integration and transformation using modern tools (Apache NiFi, Kafka, ETL pipelines). • Contribute to DevOps and test automation processes by supporting CI/CD pipelines, version control (Git), and containerized/cloud environments. • Perform data analysis More ❯

Demonstrated experience in the administration, provisioning, and use of cloud technologies (i.e. AWS) particularly with application of data science approaches in the cloud. 6. Demonstrated experience deploying and tuning Apache NiFi or other ETL workflows. 7. Demonstrated experience hosting and managing Structured Query Language (SQL) databases within cloud based relational databases. 8. Demonstrated experience optimizing connectivity between cloud-based More ❯

environments, and better development practices Excellent written and verbal communication skills Experience with DevOps frameworks Entity Framework or similar ORM. Continuous Integration, Configuration Management. Enterprise Service Bus (ESB) Management (Apache Active MQ or NIFI) Technical Writing. Past Intelligence Systems experience. Experience with Test Driven Development Some system administration experience Experience with Jira, Confluence U.S. Citizen Must be able to More ❯

managing data lakes and optimizing data workflows. Preferred Qualifications Experience with Master Data Management (MDM) tools or Microsoft Fabric. Knowledge of additional data technologies such as SQL, NoSQL databases, Apache Spark, Kafka, ML with Python. Prior experience in regulated industries (e.g., finance, education, healthcare) with a focus on data compliance. Certifications in cloud architecture (e.g., AWS Certified Solutions Architect More ❯

change management in production environments. Strong communication skills and a positive, solution-focused mindset, with the ability to adapt to changing client needs. Desirable Skills: Hands-on experience with Apache NiFi for data flow management. Exposure to Java, JavaScript/TypeScript, and Vue for full-stack understanding. Experience with BDD frameworks like Cucumber. Background in supporting or working on More ❯

data warehouses (e.g. Snowflake, Redshift). Familiarity with data pipelining and orchestration systems (e.g. Airflow). Understanding of modern analytics architectures and data visualisation tools (we use Preset.io/Apache Superset). Exposure to CI/CD pipelines (GitLab CI preferred). Experience with advertising or media data is a plus. More ❯

data warehouses (e.g. Snowflake, Redshift). Familiarity with data pipelining and orchestration systems (e.g. Airflow). Understanding of modern analytics architectures and data visualisation tools (we use Preset.io/Apache Superset). Exposure to CI/CD pipelines (GitLab CI preferred). Experience with advertising or media data is a plus. More ❯

environments, and better development practices • Excellent written and verbal communication skills • Experience with DevOps frameworks • Entity Framework or similar ORM. • Continuous Integration, Configuration Management. • Enterprise Service Bus (ESB) Management (Apache Active MQ or NIFI) • Technical Writing • Past Intelligence Systems experience. • Experience with Test Driven Development • Some system administration experience • Experience with Jira, Confluence Desired Qualification: • AWS, biometric, Microservices, User More ❯

data warehouses (e.g. Snowflake, Redshift). Familiarity with data pipelining and orchestration systems (e.g. Airflow). Understanding of modern analytics architectures and data visualisation tools (we use Preset.io/Apache Superset). Exposure to CI/CD pipelines (GitLab CI preferred). Experience with advertising or media data is a plus. More ❯

data warehouses (e.g. Snowflake, Redshift). Familiarity with data pipelining and orchestration systems (e.g. Airflow). Understanding of modern analytics architectures and data visualisation tools (we use Preset.io/Apache Superset). Exposure to CI/CD pipelines (GitLab CI preferred). Experience with advertising or media data is a plus. More ❯

data warehouses (e.g. Snowflake, Redshift). Familiarity with data pipelining and orchestration systems (e.g. Airflow). Understanding of modern analytics architectures and data visualisation tools (we use Preset.io/Apache Superset). Exposure to CI/CD pipelines (GitLab CI preferred). Experience with advertising or media data is a plus. More ❯

are constantly looking for components to adopt in order to enhance our platform. What you'll do: Develop across our evolving technology stack - we're using Python, Java, Kubernetes, Apache Spark, Postgres, ArgoCD, Argo Workflow, Seldon, MLFlow and more. We are migrating into AWS cloud and adopting many services that are available in that environment. You will have the More ❯

data from PDFs, video, and audio sources for use in LLM-powered workflows-leveraging best practices like semantic chunking and privacy controls Orchestrate multimodal pipelines using scalable frameworks (e.g., Apache Spark, PySpark) for automated ETL/ELT workflows appropriate for unstructured media Implement embeddings drives-map media content to vector representations using embedding models, and integrate with vector stores More ❯

set of ML and NLP models - Build and maintain batch and real-time feature computation pipelines capable of processing complex structured and unstructured data using technologies such as Spark, Apache Airflow, AWS SageMaker etc. - Contribute to the implementation of foundational ML infrastructure such as feature storage and engineering, asynchronous (batch) inference and evaluation - Apply your keen product mindset and More ❯

such as Snowflake. Strong expertise in SQL, including development, optimization, and performance tuning for large-scale data environments. Working knowledge of Python would be a plus. Working knowledge of Apache Iceberg is an asset. Experience with Palantir Foundry is advantageous, and knowledge of Ontology concepts is a plus. AIG, we value in-person collaboration as a vital part of More ❯

substituted for a degree) • 15+ years of relevant experience in software development, ranging from work in a DevOps environment to full stack engineering • Proficiency in the following technologies: • Java • Apache NiFi workflow configuration and deployment • Databases such as PostgreSQL and MongoDB • Python and machine learning • Docker • Kubernetes • Cloud-like infrastructure • Experience with Jenkins for pipeline integration and deployment • Familiarity More ❯

languages such as Python, Java, or C++. Experience with machine learning frameworks and libraries (e.g., TensorFlow, PyTorch, Scikit-learn). Familiarity with data processing tools and platforms (e.g., SQL, Apache Spark, Hadoop). Knowledge of cloud computing services (e.g., AWS, Google Cloud, Azure) and containerization technologies (e.g., Docker, Kubernetes) is a plus. Hugging Face Ecosystem: Demonstrated experience using Hugging More ❯

Demonstrated experience in the administration, provisioning, and use of cloud technologies (i.e. AWS) particularly with application of data science approaches in the cloud. 5. Demonstrated experience deploying and tuning Apache NiFi or other ETL workflows. 6. Demonstrated experience hosting and managing Structured Query Language (SQL) databases within cloud based relational databases. 7. Demonstrated experience optimizing connectivity between cloud-based More ❯