126 to 140 of 140 Apache Jobs

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

documentation and technical reports. MOD or Defence security standards and accreditation processes. Working with secure or safety-critical systems. Exposure to technologies such as Apache Kafka, Apache NiFi, Node.js, TypeScript, MongoDB, AI or Machine Learning would also be beneficial. Security Clearance Due to the nature of the work ...

involved in a modern data transformation programme, including a planned migration to Microsoft Fabric. Key Responsibilities Develop and maintain data pipelines using Apache Airflow. Design and optimise SQL-based data solutions. Build and enhance Power BI reports and dashboards. Work closely with stakeholders to gather requirements and deliver insights. … Support ongoing improvements to the data platform and reporting environment. Contribute to the organisation's future migration to Microsoft Fabric. Required Skills Experience with Apache Airflow. Strong Azure SQL skills. Power BI development and data modelling experience. Good understanding of ETL/ELT processes and data warehousing concepts. Strong ...

ensuring best practices in data architecture, security, and cloud computing Proficiency in data modelling, ETL processes, data warehousing, distributed systems and metadata systems Utilise Apache Flink and other streaming technologies to build real-time data processing systems that handle large-scale, high-throughput data Ensure all data solutions comply … Lambda, and Redshift. Experience with other cloud providers (e.g., Azure, GCP) is a plus In-depth knowledge and hands-on experience with Apache Flink for real-time data processing Proven experience in mentoring and managing teams, with a focus on developing talent and fostering a collaborative work environment Strong ...

scalable ELT/ETL flows (batch and streaming) Interface between Data Analysts and Data Scientists Enrich data and load into big data environment (Apache Hadoop on Cloudera) Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Experience in data modeling (relational databases and Apache Hadoop … Know-how of core technologies such as SQL (MS SQL Server), Apache Hadoop (Kafka, NiFi, Flink, Scala and/or Java, Python) and Linux Showing interest in working with high-frequency data processing in a near-realtime environment Wir bieten State-of-the-Art Technologies We use the latest ...

designing and delivering modern data platforms, working closely with clients and technical teams to build scalable, secure and high-performing solutions using Databricks, Apache Spark and cloud technologies. You'll also play a key role in pre-sales activities, solution design, and helping to drive strategic Databricks initiatives across … Databricks and modern data platform delivery. Skills & Experience Required 7+ years' experience in Data Architecture or Solution Architecture. Strong commercial experience with Databricks and Apache Spark . Experience delivering enterprise data platforms on AWS, Azure or GCP. Strong understanding of data warehousing, data lakes and lakehouse architectures. Experience designing ...

ensuring best practices in data architecture, security, and cloud computing Proficiency in data modelling, ETL processes, data warehousing, distributed systems and metadata systems Utilise Apache Flink and other streaming technologies to build real-time data processing systems that handle large-scale, high-throughput data Ensure all data solutions comply … Lambda, and Redshift. Experience with other cloud providers (e.g., Azure, GCP) is a plus In-depth knowledge and hands-on experience with Apache Flink for real-time data processing Proven experience in mentoring and managing teams, with a focus on developing talent and fostering a collaborative work environment Strong ...

support high availability and load-balancing solutions. Configure and troubleshoot networking technologies including DNS, routing and Firewalls. Manage web services and Proxy technologies including Apache, NGINX and Squid. Oversee backup, recovery and disaster recovery processes using Veeam. Manage endpoint security and device compliance through Microsoft Intune. Maintain server infrastructure … VMware ESXi administration experience. Strong networking knowledge including DNS, load balancing, routing and troubleshooting. Experience with Veeam backup and disaster recovery solutions. Experience managing Apache, NGINX, Squid or similar web technologies. Scripting and automation experience. Strong understanding of infrastructure security, system hardening and access control. Proven experience leading ...

analytics tools Required Experience 5+ years in professional Java backend development Core Tech Stack Java, Spring Boot, JPA/Hibernate, MySQL (or other RDBMS), Apache Kafka, Linux Preferred/Plus Tech Directed Acyclic Graphs, Graph Databases, FFmpeg, CI/CD systems, Spring Cloud, Swagger, Snowflake, Apache Doris, Debezium … Database Management: Solid understanding of MySQL (or other major RDBMS) along with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working ...

responsibilities include: Demonstrate expertise in Airflow, Google Cloud Platform, Control-M or Automic and REST‐based API orchestration. Contribute to the integration of Apache Airflow into the IT landscape, driving adoption technically and organizationally. Design and implement concepts for improving or replacing existing processes from Control‐M or Automic … activities in a self‐reliant manner. Apply strong Airflow and workload‐automation architecture experience. Skills and experience required: Experience with workload‐automation tooling, preferably Apache Airflow, Control‐M and/or Google Cloud Composer using standard agile SDLC techniques. Knowledge of developing guidelines for Airflow clusters and DAGs, performance ...

with external clients across a variety of industry markets. Minimum of 5+ years of customer‐facing experience would be preferred. [Preferred] Experience working with Apache SparkTM to process large‐scale distributed datasets. Communication: Proven ability to communicate and teach complex technical concepts to both technical and non‐technical audiences. … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn, and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

understand how they’re designed, scaled, and why they fail. Hands‐on experience building large‐scale data processing systems using technologies such as Apache Spark and processing very large datasets. Deep experience designing high‐performance data architectures using PostgreSQL, DuckDB, Redis, and similar technologies. Experience building distributed, event‐driven … over genes, variants, diseases, medications, and scientific literature. Design high‐performance data models, indexing strategies, and storage architectures across PostgreSQL, Qdrant, Redis, DuckDB, and Apache Spark. Develop guardrails and deterministic reasoning layers that keep AI responses scientifically accurate, explainable, and grounded in genomic evidence. Translate complex bioinformatics and genomic ...