51 to 75 of 105 Apache Jobs

technical delivery of data platforms and pipelines built in AWS-with a focus on AWS Glue, Managed Workflows for Apache Airflow (MWAA), and Python-and collaborate closely with Directors, Senior Architects, and Program Leadership to deliver business outcomes at scale. This is a player-coach role: you will design … environment. Advanced hands-on expertise with: Python (including PySpark & data engineering patterns) AWS Glue (Jobs, Crawlers, Glue Studio, Glue Catalog, PySpark, Job bookmarks) MWAA (Apache Airflow) (DAG design, scheduling, sensors, retries, XComs, task isolation, best practices) Strong across broader AWS services: S3, Lambda, Step Functions, IAM, CloudWatch, KMS, Secrets ...

systems are developed and used responsibly and ethically. Tooling the Future: Get hands-on with cutting-edge technologies like Hugging Face, PyTorch, TensorFlow, Apache Spark, Apache Airflow, and other modern data and ML frameworks. Collaborate and Lead: Partner closely with ML Engineers, Data Scientists, and Researchers to understand … services. Programming Prowess: Strong programming skills in Python and SQL are essential. Big Data Ecosystem Expertise: Hands-on experience with big data technologies like Apache Spark, Kafka, and data orchestration tools such as Apache Airflow or Prefect. ML Data Acumen: Solid understanding of data requirements for machine learning ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical … Data Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required experience in the following: Apache Kafka Apache NiFI SQL and NoSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java Understand and interpret technical ...

Desirable Skills and Experience Experience working with cloud platforms, ideally AWS. A strong Linux background. Experience with data integration and messaging technologies such as Apache NiFi, Apache Kafka, RabbitMQ, or similar tools. Experience using Infrastructure as Code tools such as Terraform or CloudFormation. Previous experience working ...

with Red Hat OpenShift and Ceph storage platforms Programming experience (e.g. Python, JavaScript) Experience working with event streaming and data pipeline technologies (e.g. Kafka, Apache NiFi, Apache Spark) Experience delivering multi-system integration projects within defence, government, or highly regulated environments. Experience implementing and configuring training simulation technologies ...

analysis on complex system-wide issues. Linux Engineering: Manage and optimise a large-scale estate across RedHat, Ubuntu, and CentOS, ensuring peak performance of Apache, Nginx, and Tomcat stacks. Automation & IaC: Drive efficiency through the development of custom Ansible, Puppet, and Terraform scripts to automate deployments and server hardening. ...

service availability metrics Telecom Linux Server Administration Administer Ubuntu LTS environments (20.04-24.04) Apply system updates, security patches, and package management Configure and maintain Apache, MySQL/MariaDB, SSL certificates, and firewalls Monitor and troubleshoot performance, resource usage, and service failures Implement log rotation, cleanup, and routine maintenance procedures ...

some of the following technologies on both Windows and Linux: C++ Javascript Python XML JSON HTML CSS Web backend servers (Angular, Django, NodeJS, React, Apache or similar) Web Sockets Docker TCP-IP/UDP SQL or other databases Dev tools (Wireshark, system log interrogation etc..) Databases Cyber Security Desirable ...

Platforms Itential Automation Platform Cisco NSO – Service development and lifecycle Apache Airflow Hasi Corp Vault Openshift Automation development Python Fast API Rest API Netconf Yang modelling XML/Json Jinja/TextFSM Pytest Unit testing Database MongoDB DevOps Docker Git CI/CD Kubernetes Networking Ciena 517x/ ...

architecture to support data consumption for reporting systems, operational applications, and analytics platforms. Implement automation, orchestration, and scalable pipeline frameworks using tools such as Apache Airflow. Collaborate with business stakeholders and technical teams to align the data platform with enterprise data strategy. Support hospitality analytics use cases, including guest ...

drive alignment across teams without formal authority. Strong prioritisation instincts, balancing deep technical work with organizational needs. Nice to Have Familiarity with the Apache Iceberg table format. Knowledge of data contract frameworks and schema validation tooling. Why Join? You will join a high-performance team where engineering quality ...

secrets and access control using Azure Key Vault and Azure AD Enable hybrid connectivity between on-premises and cloud environments Support orchestration workflows using Apache Airflow Monitor system performance using tools such as Azure Monitor, Prometheus, and Grafana Collaborate across engineering teams to ensure reproducibility, scalability, and compliance Contribute ...

secrets and access control using Azure Key Vault and Azure AD Enable hybrid connectivity between on-premises and cloud environments Support orchestration workflows using Apache Airflow Monitor system performance using tools such as Azure Monitor, Prometheus, and Grafana Collaborate across engineering teams to ensure reproducibility, scalability, and compliance Contribute ...

with EKS) Proficiency in Git-based development workflows Experience working independently and communicating effectively in distributed teams Desirable : Familiarity with (or happy to learn): Apache Spark (EMR) and Delta Lake PostgreSQL (Aurora) CI/CD (Github Actions) and IaC (Helm, CloudFormation) Monitoring (Sentry) Knowledge/interest in research ...

language used for automation (e.g. Python, JavaScript, TypeScript). · Experience integrating automated tests into CI/CD pipelines, or using orchestration platforms such as Apache Airflow · Practical experience working with real and/or virtual devices (Android, iOS, emulators/simulators) and dealing with the challenges of scale, stability ...

language used for automation (e.g. Python, JavaScript, TypeScript). · Experience integrating automated tests into CI/CD pipelines, or using orchestration platforms such as Apache Airflow · Practical experience working with real and/or virtual devices (Android, iOS, emulators/simulators) and dealing with the challenges of scale, stability ...

direction within your team Required Skills and Experience Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka ...

with Red Hat OpenShift and Ceph storage platforms Programming experience (e.g. Python, JavaScript) Experience working with event streaming and data pipeline technologies (e.g. Kafka, Apache NiFi, Apache Spark) Experience delivering multi-system integration projects within defence, government, or highly regulated environments Experience implementing and configuring training simulation technologies ...

with Red Hat OpenShift and Ceph storage platforms Programming experience (e.g. Python, JavaScript) Experience working with event streaming and data pipeline technologies (e.g. Kafka, Apache NiFi, Apache Spark) Experience delivering multi-system integration projects within defence, government, or highly regulated environments Experience implementing and configuring training simulation technologies ...

systems as a shared responsibility, Active Directory, GPOs, DNS, NFS, and related enterprise management systems Administrative management of Web services such as IIS and Apache Ability to create new and manage email accounts in M365. Basic administrative support of databases such as Microsoft SQL and MySQL Work with ...

Management will not be a sponsor for this position. This position is located at the Tempe campus, Tempe, AZ (on Rural Road south of Apache Blvd) and may require working from other campuses depending on operational needs. Must possess a valid Arizona driver's license (minimum of Class ...

hands-on experience with Google Cloud Platform (BigQuery, Cloud Storage, etc.). Proven experience in DBT for data transformation. Expertise in Cloud Composer/Apache Airflow for workflow orchestration. Advanced proficiency in Python. Solid experience with Terraform for infrastructure provisioning. Demonstrated experience in migrating legacy systems (on-prem ...

orchestrate workloads across CPU and GPU environments. Your work will include: Designing and building distributed services in Rust Developing scalable work queue systems (e.g. Apache Pulsar, RabbitMQ) Building GPU node orchestration services for data movement Creating robust storage lifecycle and indexing services Designing performant APIs using gRPC What ...

optimise performance across distributed systems. Mandatory Skills & Experience Minimum 3+ years of experience in software development. Proficiency in LAMP stack: Excellent understanding of Linux, Apache, MySQL, and PHP, with hands-on experience in developing and maintaining applications using this stack Scripting and programming skills: Strong knowledge of Scripting languages ...

technical and non-technical audiences Experience gathering requirements through workshops, interviews and documentation analysis Ability to thrive in fast-paced delivery environments Bonus Skills : Apache AirFlow, BigQuery, Cloud Platform certificates, Data Governance Frameworks Salary: £50,000-£55,000 Benefits: Bonus, 25 Days Holiday, Health & Dental Cover, Income Protection ...