101 to 125 of 138 Apache Jobs

Directory Services (Active Directory, LDAP, etc.) Windows and/or *nix environments Scripting (e.g. PowerShell, Python, Bash) Databases (Oracle, MSSQL, MySQL, PostgreSQL) Web technologies (Apache, IIS, etc.) DevOps and software development practices Application integration Reporting and data analysis ...

kernels. Experience with RLHF pipelines (PPO, DPO, ORPO). Experience training or deploying multimodal or diffusion models. Experience with large‐scale data processing (Apache Arrow, Spark, Ray). How We Work The best products today in the world were built by small, world class teams. We are a high ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn, and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

repair and reassembly of systems already in use. In doing so, they work on the most famous aircraft and helicopters; think of the Apache combat helicopter, the F-35 Lightning II (JSF), the Bombardier Dash 8 Q400 and the multipurpose NH90 maritime combat helicopter. Over de functie ...

workloads. Practical experience working with AWS cloud services, including compute, storage, and security tooling. Infrastructure-as-code experience using Terraform. Distributed data processing using Apache Spark. Workflow scheduling and orchestration with Apache Airflow. Containerisation and environment management using Docker. CI/CD pipeline implementation and maintenance using GitLab. ...

Software Developer Permanent | Hybrid (willing to travel to Newcastle) | Python | Apache | Data | SC cleared Hybrid work arrangement. Read the overview of this opportunity to understand what skills, including and relevant soft skills and software package proficiencies, are required. Office attendance is up to 60%. Location is flexible: London … must be willing to travel to Newcastle when required. The Role: We are looking for Software Developers with strong Python and data processing with Apache Spark responsible to lead the design, development, and operation of data-driven applications and pipelines in a collaborative Dev and DevOps environment. The role ...

code. Perfect if you want scope for growth without going “post-technical.” What you’ll do Design and build modern data platforms using Databricks, Apache Spark, Snowflake, and cloud-native services (AWS, Azure, or GCP). Develop robust pipelines for real-time and batch data ingestion from diverse … Lead Data Engineer in complex enterprise environments. Can demonstrate strong coding skills in Python (Scala or functional languages a plus). Expertise with Databricks, Apache Spark, and Snowflake is a must (HDFS/HBase also useful). Has experience integrating large, messy datasets into reliable, scalable data products. Strong ...

administration in a physical and virtual enterprise environment. Strong knowledge of Linux scripting languages and installing, configuring, and maintaining OS services such as Bind, Apache, MySQL and other databases, Nginx, etc. A solid understanding configuration management tools such as Puppet is a plus. Experience with Pure SAN or other ...

Design, build, and maintain cloud-based infrastructure using AWS Develop and manage Infrastructure as Code using Terraform Support and optimise data processing pipelines using Apache Spark and Airflow Collaborate with cross-functional teams to deliver secure and scalable solutions Implement CI/CD pipelines using GitLab Containerise applications … Notebooks for data exploration and development Key Skills & Experience Strong experience with AWS services Expertise in Terraform (Infrastructure as Code) Hands-on experience with: Apache Spark Python Apache Airflow Docker GitLab CI/CD Experience with security scanning tools such as: Trivy Trend Micro Wiz (or similar) Knowledge ...

including new capabilities like the E-7 AEW&C and the P-8A Maritime Patrol Aircraft, Autonomous Systems, C4ISR Services, Support for the Chinook & Apache Fleets, Logistic Information Services and Training Services and are very much in a growth phase. Responsibilities: As the Boundary Cell you shall ...

including new capabilities like the E-7 AEW&C and the P-8A Maritime Patrol Aircraft, Autonomous Systems, C4ISR Services, Support for the Chinook & Apache Fleets, Logistic Information Services and Training Services and are very much in a growth phase. Responsibilities: As the Boundary Cell you shall ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

Design, build, and maintain cloud-based infrastructure using AWS Develop and manage Infrastructure as Code using Terraform Support and optimise data processing pipelines using Apache Spark and Airflow Collaborate with cross-functional teams to deliver secure and scalable solutions Implement CI/CD pipelines using GitLab Containerise applications … Access Layer Secure File Transfer (SFT) Key Skills & Experience Strong experience with AWS services Expertise in Terraform (Infrastructure as Code) Hands-on experience with: Apache Spark Python Apache Airflow Docker GitLab CI/CD Experience with security scanning tools such as: Trivy Trend Micro Wiz (or similar) Knowledge ...

InnovationResearch, evaluate, and recommend new technologies and tools that enhance Arriva's data and BI capabilitiesStay current with emerging trends including open table formats (Apache Iceberg, Delta Lake), data observability, real-time/streaming architectures, and cloud-native solutionsConduct proofs-of-concept and technical assessments to validate new technologies … understanding of modern data engineering patterns including ETL/ELT, data lake architectures, and lakehouse approachesUnderstanding of emerging technologies such as open table formats (Apache Iceberg, Delta Lake), data observability tools, and real-time/streaming architecturesExperience with data governance frameworks, data quality tools, metadata management, and ensuring compliance ...

evaluate, and recommend new technologies and tools that enhance Arriva's data and BI capabilities* Stay current with emerging trends including open table formats (Apache Iceberg, Delta Lake), data observability, real-time/streaming architectures, and cloud-native solutions* Conduct proofs-of-concept and technical assessments to validate … modern data engineering patterns including ETL/ELT, data lake architectures, and lakehouse approaches* Understanding of emerging technologies such as open table formats (Apache Iceberg, Delta Lake), data observability tools, and real-time/streaming architectures* Experience with data governance frameworks, data quality tools, metadata management, and ensuring compliance ...

evaluate, and recommend new technologies and tools that enhance Arriva's data and BI capabilities* Stay current with emerging trends including open table formats (Apache Iceberg, Delta Lake), data observability, real-time/streaming architectures, and cloud-native solutions* Conduct proofs-of-concept and technical assessments to validate … modern data engineering patterns including ETL/ELT, data lake architectures, and lakehouse approaches* Understanding of emerging technologies such as open table formats (Apache Iceberg, Delta Lake), data observability tools, and real-time/streaming architectures* Experience with data governance frameworks, data quality tools, metadata management, and ensuring compliance ...

code review, source control, build, test, deploy, and operations Awesome If You: Are experienced in Rust/Java/Kotlin Have experience with AWS, Apache Kafka, Kafka Streams, Apache Beam/Flink/Spark – especially deployment, monitoring & debugging Have experience with productisation of Machine Learning research projects ...

interactive dashboards and reports using Power BI Build and optimise scalable ETL (Extract, Transform, Load) pipelines Develop and manage automated workflows using Python and Apache Airflow Manage and optimise SQL and Oracle database environments for performance, reliability, and scalability Lead end-to-end data and reporting initiatives from requirements … with Power BI Strong Python programming skills for data processing and automation Solid experience with SQL and Oracle database systems Hands-on experience with Apache Airflow for workflow orchestration Strong understanding of ETL processes, data pipelines, and data architecture Experience managing data-focused projects including planning, coordination, and risk ...

teams and setting best practice standards Designing data models, ETL pipelines, warehousing solutions and distributed systems Building and supporting real-time streaming platforms using Apache Flink and related technologies Ensuring compliance with industry standards and government regulations Tracking delivery against agreed designs and managing design deviations Supporting pre-sales … data architecture on complex, secure programmes Strong hands-on AWS experience (EC2, S3, RDS, Lambda, Redshift); Azure or GCP a bonus Proven experience using Apache Flink for real-time, high-throughput data processing Experience leading, mentoring and developing technical teams Confident engaging with senior technical and non-technical stakeholders ...

partnership with Inspire People, is hiring a Lead Data Engineer with strong SQL and Python expertise, experience across modern cloud data platforms including Databricks, Apache Spark and lakehouse architectures, and a proven ability to design, build and lead delivery of reliable data products. This is a permanent role based … Strong proficiency in SQL and Python - Experience with modern cloud data platforms and lakehouse architectures - Hands-on experience with big data technologies such as Apache Spark or Databricks - Strong knowledge of data warehousing concepts - Experience with build, test and deployment automation - Proven leadership capability leading or mentoring data engineering ...

JumpStart, prompt engineering, RAG architectures, vector databases, and 2) **Data Platforms****:** AWS Glue, SageMaker Unified Studio, Databricks on AWS, Snowflake on AWS, Redshift, EMR, Apache Iceberg, Delta Lake.• Position AWS solutions effectively against other cloud platforms' offerings in both generative AI (Azure OpenAI, Vertex AI) and data platforms (Azure … governance, data quality.* Proficiency in Python, SQL, and Spark with hands-on experience in:* Generative AI: LangChain, vector databases, embedding models.* Data Engineering: PySpark, Apache Iceberg/Delta Lake, orchestration tools.* A proven ability to articulate both visionary AI possibilities and practical data platform requirements to diverse audiences.#LI ...

scalable ELT/ETL flows (batch and streaming) Interface between Data Analysts and Data Scientists Enrich data and load into big data environment (Apache Hadoop on Cloudera) Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Experience in data modeling (relational databases and Apache Hadoop … Know-how of core technologies such as SQL (MS SQL Server), Apache Hadoop (Kafka, NiFi, Flink, Scala and/or Java, Python) and Linux Showing interest in working with high-frequency data processing in a near-realtime environment Wir bieten State-of-the-Art Technologies We understand the usage ...

analytics tools Required Experience 5+ years in professional Java backend development Core Tech Stack Java, Spring Boot, JPA/Hibernate, MySQL (or other RDBMS), Apache Kafka, Linux Preferred/Plus Tech Directed Acyclic Graphs, Graph Databases, FFmpeg, CI/CD systems, Spring Cloud, Swagger, Snowflake, Apache Doris, Debezium … Database Management: Solid understanding of MySQL (or other major RDBMS) along with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working ...

requirements 3+ years of Python in production environments Strong AWS experience across core services Strong SQL skills for querying, transformation, and optimisation Experience with Apache Spark or serverless architectures Core responsibilities and skills Build and maintain real-time and batch ETL pipelines using Python on large, complex datasets Write … across large data volumes Model and transform data into well-structured, reusable datasets for downstream use Work with distributed data processing tools such as Apache Spark to handle high-volume workloads Improve existing pipelines by identifying bottlenecks and refactoring code and queries Develop and maintain data workflows, scheduling ...