26 to 50 of 83 Permanent Apache Jobs

skills Solid foundation in mathematics and statistics Preferred Qualifications Experience with MLOps tools such as MLflow or Kubeflow. Knowledge of big data technologies like Apache Spark, Hadoop, or Databricks. Experience in NLP, Computer Vision, or other advanced AI domains. Relevant certifications (AWS, Azure, Google Cloud, Coursera, edX). ...

preparation. Machine learning and statistical methods, including model validation. Data analytics and visualisation techniques. Processing large datasets using batch or streaming tools such as Apache Spark. Data acquisition and fusion approaches. Cloud platforms (ideally AWS) and cloud-based data science solutions. DataOps principles and practices. Structured and unstructured databases. ...

Face Transformers to enable capabilities such as intelligent document processing, conversational AI, and semantic search. Knowledge and experience of some of the following tools; Apache Spark, Databricks, Pandas for data processing and feature engineering SQL, MongoDB for structured and unstructured data management SageMaker, Azure ML for model deployment, tracking ...

data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

tool integration · dbt, Dagster, or modern data stack tools Our Tech Stack · Frontend: React, TypeScript, Modern CSS · Backend: Python (FastAPI/Flask), Node.js · Data: Apache Iceberg, dbt, Tableau · Infrastructure: AWS EKS, Docker, Terraform What We Offer · Clear project pipeline with high business impact · Progression opportunities as team scales · Modern ...

Kubernetes Strong Git-based development workflows Experience delivering features end-to-end in distributed teams Confident troubleshooting production issues in real time Desirable Skills Apache Spark (EMR) & Delta Lake PostgreSQL (Aurora) CI/CD using GitHub Actions IaC (Helm, CloudFormation) Monitoring tools (Sentry) Role Responsibilities You'll be hands ...

languages: Assembly, C, C++, Java, C#, .NET, Python. Expertise in operating systems (Linux, Windows), databases (MS SQL, MySQL, Postgres), and application/web servers (Apache, IIS, Wildfly). Strong networking knowledge (switching, routing, firewalls) and hardware hacking (JTAG, FPGA, USB). Experience with security testing tools: Kali Linux, Nessus ...

Work with solution architects to design migration-day data processes for partner onboarding. Build and maintain ETL pipelines and workflow automation using Snowflake and Apache Airflow. Document processes, learnings, and development work using version control best practices. Implement robust data quality checks and reconciliation processes throughout pipelines. Collaborate with … functionally. Strong communication skills, with the ability to translate technical concepts to non-technical audiences. Hands-on experience building and managing production workflows in Apache Airflow. Experience delivering production-grade transformations in dbt, including testing and documentation. Advanced SQL skills across multiple dialects. Strong understanding of data modelling ...

Work with solution architects to design migration-day data processes for partner onboarding. Build and maintain ETL pipelines and workflow automation using Snowflake and Apache Airflow. Document processes, learnings, and development work using version control best practices. Implement robust data quality checks and reconciliation processes throughout pipelines. Collaborate with … functionally. Strong communication skills, with the ability to translate technical concepts to non-technical audiences. Hands-on experience building and managing production workflows in Apache Airflow. Experience delivering production-grade transformations in dbt, including testing and documentation. Advanced SQL skills across multiple dialects. Strong understanding of data modelling ...

Design Documents (ADDs) and technical blueprints Architect and optimise data pipelines using Airflow/MWAA and dbt Define and implement data lakehouse solutions using Apache Iceberg and S3 Lead performance tuning across Snowflake, Airflow, and Iceberg environments Ensure platform reliability, observability, and scalability Drive adoption of cloud-native design ...

Level Mid-Senior level Industry Software Development Employment Type Full-time Job Functions Consulting Skills Data Science Artificial Intelligence (AI) Business Sales Business Insights Apache Spark Analytics Machine Learning Pattern Recognition Financial Services ...

some of the following technologies on both Windows and Linux: C++ Javascript Python XML JSON HTML CSS Web backend servers (Angular, Django, NodeJS, React, Apache or similar) Web Sockets Docker TCP-IP/UDP SQL or other databases Dev tools (Wireshark, system log interrogation etc..) Databases Cyber Security Desirable ...

cases. Implement data governance, role-based access control, and security best practices in Snowflake. Automate workflows and pipelines using orchestration tools such as Apache Airflow. Work closely with data analysts, architects, and business stakeholders to understand business requirements. Support hospitality analytics use cases, including booking trends, guest behaviour analysis … data preparation for machine learning models. Familiarity with predictive analytics, recommendation engines, or customer behavior analysis is an advantage. Preferred Skills Experience with Apache Airflow for orchestration. Knowledge of CI/CD pipelines, Git-based workflows, and DevOps practices. Experience with data governance, metadata management, and data catalogue tools. ...

systems are developed and used responsibly and ethically. Tooling the Future: Get hands-on with cutting-edge technologies like Hugging Face, PyTorch, TensorFlow, Apache Spark, Apache Airflow, and other modern data and ML frameworks. Collaborate and Lead: Partner closely with ML Engineers, Data Scientists, and Researchers to understand … services. Programming Prowess: Strong programming skills in Python and SQL are essential. Big Data Ecosystem Expertise: Hands-on experience with big data technologies like Apache Spark, Kafka, and data orchestration tools such as Apache Airflow or Prefect. ML Data Acumen: Solid understanding of data requirements for machine learning ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical … Data Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required experience in the following: Apache Kafka Apache NiFI SQL and NoSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java Understand and interpret technical ...

Desirable Skills and Experience Experience working with cloud platforms, ideally AWS. A strong Linux background. Experience with data integration and messaging technologies such as Apache NiFi, Apache Kafka, RabbitMQ, or similar tools. Experience using Infrastructure as Code tools such as Terraform or CloudFormation. Previous experience working ...

with Red Hat OpenShift and Ceph storage platforms Programming experience (e.g. Python, JavaScript) Experience working with event streaming and data pipeline technologies (e.g. Kafka, Apache NiFi, Apache Spark) Experience delivering multi-system integration projects within defence, government, or highly regulated environments. Experience implementing and configuring training simulation technologies ...

service availability metrics Telecom Linux Server Administration Administer Ubuntu LTS environments (20.04-24.04) Apply system updates, security patches, and package management Configure and maintain Apache, MySQL/MariaDB, SSL certificates, and firewalls Monitor and troubleshoot performance, resource usage, and service failures Implement log rotation, cleanup, and routine maintenance procedures ...

some of the following technologies on both Windows and Linux: C++ Javascript Python XML JSON HTML CSS Web backend servers (Angular, Django, NodeJS, React, Apache or similar) Web Sockets Docker TCP-IP/UDP SQL or other databases Dev tools (Wireshark, system log interrogation etc..) Databases Cyber Security Desirable ...

Platforms Itential Automation Platform Cisco NSO – Service development and lifecycle Apache Airflow Hasi Corp Vault Openshift Automation development Python Fast API Rest API Netconf Yang modelling XML/Json Jinja/TextFSM Pytest Unit testing Database MongoDB DevOps Docker Git CI/CD Kubernetes Networking Ciena 517x/ ...

drive alignment across teams without formal authority. Strong prioritisation instincts, balancing deep technical work with organizational needs. Nice to Have Familiarity with the Apache Iceberg table format. Knowledge of data contract frameworks and schema validation tooling. Why Join? You will join a high-performance team where engineering quality ...

secrets and access control using Azure Key Vault and Azure AD Enable hybrid connectivity between on-premises and cloud environments Support orchestration workflows using Apache Airflow Monitor system performance using tools such as Azure Monitor, Prometheus, and Grafana Collaborate across engineering teams to ensure reproducibility, scalability, and compliance Contribute ...

language used for automation (e.g. Python, JavaScript, TypeScript). · Experience integrating automated tests into CI/CD pipelines, or using orchestration platforms such as Apache Airflow · Practical experience working with real and/or virtual devices (Android, iOS, emulators/simulators) and dealing with the challenges of scale, stability ...

language used for automation (e.g. Python, JavaScript, TypeScript). · Experience integrating automated tests into CI/CD pipelines, or using orchestration platforms such as Apache Airflow · Practical experience working with real and/or virtual devices (Android, iOS, emulators/simulators) and dealing with the challenges of scale, stability ...

direction within your team Required Skills and Experience Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...