1 to 25 of 277 Apache Jobs

build and manage scalable data pipelines and data analytic solutions that support strategic, ad hoc, and AI-driven data analytics using technologies such as Apache Spark, Apache Flink, Unity Catalog, Apache Hive, Databricks, Apache Iceberg, and Delta Tables. Innovation and Research: Drive innovation by researching … building high-throughput, low-latency systems to support short- and long-running processes at scale. Hands-on experience with event-driven platforms like Apache Kafka, RabbitMQ, Apache Pulsar, and other messaging systems for system integrations and real-time data streaming. Strong background in processing large batch and streaming ...

build and manage scalable data pipelines and data analytic solutions that support strategic, ad hoc, and AI-driven data analytics using technologies such as Apache Spark, Apache Flink, Unity Catalog, Apache Hive, Databricks, Apache Iceberg, and Delta Tables. Innovation and Research: Drive innovation by researching … building high-throughput, low-latency systems to support short- and long-running processes at scale. Hands-on experience with event-driven platforms like Apache Kafka, RabbitMQ, Apache Pulsar, and other messaging systems for system integrations and real-time data streaming. Strong background in processing large batch and streaming ...

build and manage scalable data pipelines and data analytic solutions that support strategic, ad hoc, and AI-driven data analytics using technologies such as Apache Spark, Apache Flink, Unity Catalog, Apache Hive, Databricks, Apache Iceberg, and Delta Tables. Innovation and Research: Drive innovation by researching … building high-throughput, low-latency systems to support short- and long-running processes at scale. Hands-on experience with event-driven platforms like Apache Kafka, RabbitMQ, Apache Pulsar, and other messaging systems for system integrations and real-time data streaming. Strong background in processing large batch and streaming ...

design, scalability, and clean coding practices. Familiarity with application monitoring solutions Data Engineering 5+ years building scalable and reliable data pipelines using Databricks and Apache Spark. We need both. Experience with cloud data warehouse/data lake architectures and tooling. Experience building solutions using cloud providers, preferably Azure ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

experience in cloud-based data services. Proficiency in SQL and Python for data manipulation and transformation. Experience with modern data engineering tools, including Apache Spark, Kafka, and Airflow. Strong understanding of data modelling, schema design, and data warehousing concepts. Familiarity with data governance, privacy, and compliance frameworks (e.g., GDPR ...

have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology in the stack includes: FastAPI ...

have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology in the stack includes: FastAPI ...

/or Azure (Data Lake, Synapse). Programming & Scripting:Proficiency in Python, SQL, PySpark etc. ETL/ELT & Streaming:Expertise in technologies like Apache Airflow, Glue, Kafka, Informatica, EventBridge etc. Industrial Data Integration:Familiarity with OT data schema originating from OSIsoft PI, SCADA, MES, and Historian systems. Information Modeling ...

Lead, Data Engineering Manager etc. Proven success with modern data infrastructure: distributed systems, batch and streaming pipelines Hands-on knowledge of tools such as Apache Spark, Kafka, Databricks, DBT or similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in the likes ...

Lead, Data Engineering Manager etc. Proven success with modern data infrastructure: distributed systems, batch and streaming pipelines Hands-on knowledge of tools such as Apache Spark, Kafka, Databricks, DBT or similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in the likes ...

Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands ...

Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands ...

Java and Spring or are willing to learn on the job. Have strong familiarity with SQL Experience with the following tools and frameworks: Apache Airflow and or data pipelines. Celery FastAPI and/or Flask Postgres (AWS Aurora Ideally) DynamoDB Have experience working in the FinTech industry, particularly ...

Java and Spring or are willing to learn on the job. Have strong familiarity with SQL Experience with the following tools and frameworks: Apache Airflow and or data pipelines. Celery FastAPI and/or Flask Postgres (AWS Aurora Ideally) DynamoDB Have experience working in the FinTech industry, particularly ...

Java and Spring or are willing to learn on the job. Have strong familiarity with SQL Experience with the following tools and frameworks: Apache Airflow and or data pipelines. Celery FastAPI and/or Flask Postgres (AWS Aurora Ideally) DynamoDB Have experience working in the FinTech industry, particularly ...

Java and Spring or are willing to learn on the job. Have strong familiarity with SQL Experience with the following tools and frameworks: Apache Airflow and or data pipelines. Celery FastAPI and/or Flask Postgres (AWS Aurora Ideally) DynamoDB Have experience working in the FinTech industry, particularly ...

Java and Spring or are willing to learn on the job. Have strong familiarity with SQL Experience with the following tools and frameworks: Apache Airflow and or data pipelines. Celery FastAPI and/or Flask Postgres (AWS Aurora Ideally) DynamoDB Have experience working in the FinTech industry, particularly ...

Java and Spring or are willing to learn on the job. Have strong familiarity with SQL Experience with the following tools and frameworks: Apache Airflow and or data pipelines. Celery FastAPI and/or Flask Postgres (AWS Aurora Ideally) DynamoDB Have experience working in the FinTech industry, particularly ...

Java and Spring or are willing to learn on the job. Have strong familiarity with SQL Experience with the following tools and frameworks: Apache Airflow and or data pipelines. Celery FastAPI and/or Flask Postgres (AWS Aurora Ideally) DynamoDB Have experience working in the FinTech industry, particularly ...

Java and Spring or are willing to learn on the job. Have strong familiarity with SQL Experience with the following tools and frameworks: Apache Airflow and or data pipelines. Celery FastAPI and/or Flask Postgres (AWS Aurora Ideally) DynamoDB Have experience working in the FinTech industry, particularly ...

Java and Spring or are willing to learn on the job. Have strong familiarity with SQL Experience with the following tools and frameworks: Apache Airflow and or data pipelines. Celery FastAPI and/or Flask Postgres (AWS Aurora Ideally) DynamoDB Have experience working in the FinTech industry, particularly ...

Java and Spring or are willing to learn on the job. Have strong familiarity with SQL Experience with the following tools and frameworks: Apache Airflow and or data pipelines. Celery FastAPI and/or Flask Postgres (AWS Aurora Ideally) DynamoDB Have experience working in the FinTech industry, particularly ...

Java and Spring or are willing to learn on the job. Have strong familiarity with SQL Experience with the following tools and frameworks: Apache Airflow and or data pipelines. Celery FastAPI and/or Flask Postgres (AWS Aurora Ideally) DynamoDB Have experience working in the FinTech industry, particularly ...