251 to 275 of 392 Permanent Apache Jobs

technology environment is important but this is not expected to be a hands on role • This role is responsible for platforms built using Java, Apache Nifi, Kafka, SpringBoot, Angular 7 and Oracle, experience with some of these technologies is important • Continuous Integration and Deployment is achieved using a combination ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

with downstream systems, including trader‐facing tools. Experience 5+ years software engineering experience in building distributed systems. Excellent Java skills. Experience with streaming technologies (Apache Flink preferred; Kafka Streams, Spark Streaming, etc.). Solid understanding of event‐driven architecture and asynchronous processing patterns. Experience handling data consistency challenges such ...

responsibility and commitment to qualitySelf-driven, motivated work ethicEnergetic and enthusiastic personalityWhat makes you stand out:IMC or another investment management qualificationExperience with Apache AirflowExperience with DatabricksExperience with asset management dataPassion for design and architectureWhy join our team:We help you be your best through professional development opportunities, interesting ...

manage multiple projects and stakeholdersFunctional and object-oriented programming skills with expertise in Scala, Java, and Python, and open-source frameworks such as Apache SparkFamiliarity with software engineering and project management tools such as Git, Jira, and AgileExperience leading adoption of agentic AI-enabled engineering practices (using enterprise-authorized ...

3+ years experience working in version control environments using platforms such as Gitlab or Github 2+ years experience working with job orchestration tools like Apache Airflow, both as a pipeline developer and reviewer 2+ years experience with data ingestion and transformation frameworks (e.g., dbt, Fivetran, or custom/ ...

practitioner, you will collaborate with architects, engineers, and analysts to deliver secure, scalable, and high-performing migration solutions, leveraging technologies such as AWS Glue, Apache Iceberg, Python/PySpark, SQL, and YAML-based configurations.You will thrive in a collaborative, client-facing environment, with a passion for solving complex data … target cloud architecturesData Pipeline Testing & Validation (Core Focus)Test end-to-end ETL data solutions running on AWS services, including AWS Glue and Apache IcebergValidate data feed pipeline migrations transitioning to new AWS Data Lakehouse architecturesTest pipelines underpinned by:AI ETL acceleratorsPython/PySpark transformationsSQL-based logicYAML configuration-driven ...

Data Analytics & Business Intelligence (BI) Experience: 5-10 years Location: United Kingdom - Glasgow, London Skills: Apache Airflow, AWS, Data Lake/Lakehouse, Databricks Certified (Data Engineer, ML), DBT, Python, SQL We are seeking a highly skilled Сonsultant Data Engineer to be the driving force behind this massive architectural shift. … PySpark, governed cataloging). Modern Data Stack: Strong proficiency in dbt (Core or Cloud) for data transformation and understanding of modern table formats, specifically Apache Iceberg. Orchestration: Experience building and maintaining data pipelines using Apache Airflow (Astronomer experience is a strong plus). Languages: Expert‐level SQL (ability ...

Data Analytics & Business Intelligence (BI) Experience 5-10 years Location United Kingdom - Glasgow, London Skills Apache Airflow, AWS, Data Lake/Lakehouse, Databricks Certified (Data Engineer, ML), DBT, Python, SQL We are seeking a highly skilled Сonsultant Data Engineer to be the driving force behind this massive architectural shift. … PySpark, governed cataloging). Modern Data Stack: Strong proficiency in dbt (Core or Cloud) for data transformation and understanding of modern table formats, specifically Apache Iceberg. Orchestration: Experience building and maintaining data pipelines using Apache Airflow (Astronomer experience is a strong plus). Languages: Expert-level SQL (ability ...

reconciliation and root-cause analysis.Experience building or supporting production data pipelines in a collaborative engineering environment.Experience working with distributed data processing frameworks such as Apache Spark.Working knowledge of common data formats such as JSON, Avro and Parquet.Technology EnvironmentThe role will involve working with a modern and evolving data stack. … should bring relevant experience and the ability to work across comparable technologies.Examples of technologies in scope include:Data processing and logic: ANSI SQL, Apache Spark, KafkaData formats: JSON, Avro, ParquetPlatforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQEngineering and deployment: CI/CD tooling, containerised ...

root-cause analysis. Experience building or supporting production data pipelines in a collaborative engineering environment. Experience working with distributed data processing frameworks such as Apache Spark. Working knowledge of common data formats such as JSON, Avro and Parquet. Technology EnvironmentThe role will involve working with a modern and evolving … should bring relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, KafkaData formats: JSON, Avro, ParquetPlatforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQEngineering and deployment: CI/CD tooling ...

Learning, or AI workloads. Experience with MLOps tooling such as MLflow, Kubeflow, Vertex AI, or similar technologies. Knowledge of workflow orchestration platforms such as Apache Airflow. Experience with data processing technologies such as Pandas, Apache Beam, Spark, or similar frameworks. Strong SQL skills and experience with analytical databases ...

focusing on building and delivering high-quality, data-intensive solutions.Proven experience with the internals of streaming or data integration frameworks, with strong preference for Apache Kafka (or similar pub/sub systems), Kafka Connect, Apache Flink or Apache Beam.Experience developing or extending connectors, sinks, or sources … least one streaming processing framework such as Apache Flink, Beam, or Kafka Connect, with preference for experience building or maintaining production-grade streaming connectors.Hands-on experience with Apache Kafka or similar distributed messaging systems (e.g., Pulsar, Kinesis), including topic design, consumer groups, and performance tuning.Strong understanding of database ...

building and delivering high-quality, data-intensive solutions. Proven experience with the internals of streaming or data integration frameworks, with strong preference for Apache Kafka (or similar pub/sub systems), Kafka Connect, Apache Flink or Apache Beam. Experience developing or extending connectors, sinks, or sources … least one streaming processing framework such as Apache Flink, Beam, or Kafka Connect, with preference for experience building or maintaining production-grade streaming connectors. Hands-on experience with Apache Kafka or similar distributed messaging systems (e.g., Pulsar, Kinesis), including topic design, consumer groups, and performance tuning. Strong understanding ...

coding skills (any version, but we use Oracle) Experience coding in at least one dynamic scripting language (e.g., Python, Node JS, PowerShell or Apache Groovy) Business reporting intelligence experience (using tools like BIRT, Tableau or Power BI) Knowledge of REST APIs and standard HTTP methods and data migration; either ...

automation, and data architects. The role focuses on building scalable data pipelines, migrating hundreds of Teradata scripts to dbt models, and orchestrating workflows with Apache Airflow (Astronomer). #J-18808-Ljbffr ...

ideal candidate will have more than 10 years of experience in backend development and data platform engineering, with strong expertise in Java and Apache Spark. The role offers competitive compensation and benefits, reflecting the company's commitment to employee well-being. #J-18808-Ljbffr ...

similar). Experience with source control systems (e.g., Git). Comfortable working in Visual Studio Code or similar IDEs. Knowledge of web servers (Apache or Nginx). If this is you and you want to know more, please send me your CV and we can arrange a suitable time ...

similar). Experience with source control systems (e.g., Git). Comfortable working in Visual Studio Code or similar IDEs. Knowledge of web servers (Apache or Nginx). If this is you and you want to know more, please send me your CV and we can arrange a suitable time ...

strong skills in several of the following Modern JavaScript GitLab CI/CD Observability Technologies Web API Integration GitLab Version Control Database Technologies OpenShift Apache NiFi Message Broker Technologies Java Web Auth Distributed Architecture Kubernetes SecDevOps Cloud Native Technologies The Interview Process We believe in keeping the interview process ...

some of the following technologies on both Windows and Linux: C++ Javascript Python XML JSON HTML CSS Web backend servers (Angular, Django, NodeJS, React, Apache or similar) Web Sockets Docker TCP-IP/UDP SQL or other databases Dev tools (Wireshark, system log interrogation etc..) Databases Cyber Security Desirable ...

field. Experience with LLM agents, autonomous multi-step reasoning systems, meta-learning, or self-improving ML pipelines. Experience with large-scale data pipelines (e.g., Apache Beam) or foundation model training and fine-tuning at scale. Experience working in research environments or track record of published research in relevant ...

field. Experience with LLM agents, autonomous multi-step reasoning systems, meta-learning, or self-improving ML pipelines. Experience with large-scale data pipelines (e.g., Apache Beam) or foundation model training and fine-tuning at scale. Experience working in research environments or track record of published research in relevant ...

specific area or have broad knowledge across the systems engineering lifecycle, your skills matter. Your Impact Protecting RAF aircraft like Typhoon and Apache Advancing next-gen air combat with Team Tempest and GCAP Developing future electronic warfare systems Harnessing AI/ML to unlock intelligence from vast data What ...