101 to 123 of 123 Remote/Hybrid Apache Jobs

engineer with strong experience in streaming technologies, event-driven architecture, and distributed data systems. The Role Design and build real-time data pipelines using Apache Flink , Apache Kafka , and AWS Kinesis Develop scalable event-driven and streaming solutions Integrate data from source systems including Oracle, MySQL, and Sybase … enrichment, and quality capabilities Deliver low-latency data into enterprise data platforms Create and manage infrastructure using Terraform Skills & Experience Strong commercial experience with Apache Flink Strong experience with Apache Kafka Experience with AWS Kinesis Advanced SQL skills and strong relational database knowledge Experience working with Oracle, MySQL ...

help strengthen pre and post-change validation, enhance observability, and support the continuous improvement of automation capabilities. Technology Stack Linux/UNIX Python Ansible Apache Airflow Prometheus Grafana Loki VMware F5 What We're Looking For We're looking for engineers with: Strong Linux/UNIX administration fundamentals Experience ...

software development lifecycleSolid background in Java/Scala and a scripting language like Python. Experience building large scale data pipelinesStrong familiarity with the Apache Hadoop ecosystem including : Spark, Kafka, Flink, Iceberg/Delta Lake/Hive, Apache Presto/Trino, etc. Experience with relational SQL and NoSQL databases ...

organisation. Responsibilities: Build scalable ETL and ELT pipelines within AWS Develop and optimise data models in Amazon Redshift Create and manage workflows using Apache Airflow Integrate NetSuite and other Finance data sources Establish trusted data-quality, monitoring and validation processes Own solutions from initial requirements through to production Experience … Required: Strong commercial Python and SQL experience Hands-on experience with AWS data services Amazon Redshift or comparable cloud data-warehouse experience Apache Airflow or similar orchestration experience Strong ETL/ELT, data-modelling and production pipeline knowledge The confidence to work directly with Finance and technical stakeholders Experience ...

governance frameworks covering data ownership, stewardship, classification (PII, sensitive, public), and retention policies Establish data lineage and cataloguing standards, working with tooling such as Apache Atlas, Collibra, or Snowflake Horizon Catalog Design and enforce data quality rules and SLAs at ingestion, transformation, and consumption layers Collaborate with the Risk … documentation, incremental strategies Application Databases Data Integration AWS – S3, RDS, Aurora, Redshift (migration context), Glue, Lake Formation, IAM, VPC Data Governance Data lineage, cataloguing (Apache Atlas/Collibra/Snowflake Horizon), GDPR, BCBS 239, MDM AI/ML Data Query & Performance SQL optimisation, clustering keys, partitioning, query profiling, cost ...

Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one Deep experience with distributed computing with Apache SparkTM and knowledge of Spark runtime internals Familiarity with CI/CD for production deployments Working knowledge of MLOps, ML/AI models … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

transparency. Skills & Experience Essential Proven in-depth commercial experience in the following key areas: Databricks – Lakehouse architecture, Spark, Delta Lake, workflows and performance tuning. Apache Spark & Scala – High-performance distributed data processing and optimisation. Cloud Data Engineering (AWS) – Cloud-native data platforms and distributed computing. Data Services Architecture & Engineering … knowledge of client core business functions Demonstrated leadership, project management, and development skills Relationship and consensus building skills Preferred Kafka/Event-Driven Architecture Apache Iceberg/Delta Lake Python AI/ML & LLM integration Financial Services/Capital Markets Education Bachelor’s degree/University degree or equivalent ...

Development Contribute hands-on as a primary engineer utilizing our modern tech stack: Core Java (multi-threading, concurrency, memory optimization), CouchbaseDB, Kafka, and Apache Storm. Solve complex real-time risk calculation requirements, handling heavy stream processing and highly concurrent data flows. Required Experience extensive development experience, with a strong … including multi-threading, memory management, garbage collection tuning, and concurrency utilities. Solid experience with real-time stream processing and distributed data architectures (e.g., Kafka, Apache Storm, CouchbaseDB/NoSQL, Spring). Familiarity with modern infrastructure paradigms, such as containerization (OpenShift/Kubernetes) and cloud platforms (GCP/ ...

Development Contribute hands-on as a primary engineer utilizing our modern tech stack: Core Java (multi-threading, concurrency, memory optimization), CouchbaseDB, Kafka, and Apache Storm. Solve complex real-time risk calculation requirements, handling heavy stream processing and highly concurrent data flows. Required Experience extensive development experience, with a strong … including multi-threading, memory management, garbage collection tuning, and concurrency utilities. Solid experience with real-time stream processing and distributed data architectures (e.g., Kafka, Apache Storm, CouchbaseDB/NoSQL, Spring). Familiarity with modern infrastructure paradigms, such as containerization (OpenShift/Kubernetes) and cloud platforms (GCP/ ...

lake. Translate architectural designs into implementation plans, work packages and practical technical delivery approaches. Lead API-based, file-based, legacy and bespoke integrations using Apache NiFi and AWS services. Manage the onboarding of source systems, including interface analysis, data mapping, transformation rules and security considerations. Define and coordinate unit … Significant experience leading enterprise-scale data engineering or integration programmes. Strong, hands-on AWS delivery experience, including secure engineering practices and operational observability. Strong Apache NiFi experience, including pipelines, processors, controller services, flow governance and operational monitoring. Proven experience delivering API integrations, file-based integrations, legacy system interfaces ...

Spark/Scala data processing (also some Flink), Kubernetes and AWS native tooling.**What You'll Do:*** Write highly fault-tolerant Java code within Apache Spark to produce platform products used by our customers to query our event pipelines/ingestion for insight into active threat trends and related … between backend/cloud development and data platform engineering roles* 5+ years of experience building data platform product(s) or features with (one of) Apache Spark, Flink or Iceberg, or with comparable tools in GCP* 5+ years of experience programming with Java, Scala or Kotlin.* Proven experience owning robust ...

common technical standards and ways of working, and presenting these to the community Here's a snapshot of the technologies that we use: Scala Apache Spark Databricks Apache Parquet Azure Cloud Platform Azure DevOps (Test plans, Backlogs, Pipelines) GIT What we're looking for We'd love ...

common technical standards and ways of working, and presenting these to the community Here’s a snapshot of the technologies that we use: Scala Apache Spark Databricks Apache Parquet Azure Cloud Platform Azure DevOps (Test plans, Backlogs, Pipelines) GIT What we’re looking for We’d love ...

strong focus on cost efficiency, scalability, and operational excellence. Key Responsibilities Design and build scalable, real‐time data processing systems using technologies such as Apache Flink and Kafka. Develop high‐quality, maintainable code for Apache Flink (Java) data processing and .NET APIs. Lead and contribute to collaborative system … cost. What We’re Looking For Excellent collaboration and communication skills. Strong experience in distributed systems and event‐driven architectures. Hands‐on experience with Apache Flink (or similar stream processing frameworks) and Kafka or other messaging systems. Strong proficiency in .NET or Java. Experience building systems that are highly ...

Spark/Scala data processing (also some Flink), Kubernetes and AWS native tooling. What You'll Do: Write highly fault-tolerant Java code within Apache Spark to produce platform products used by our customers to query our event pipelines/ingestion for insight into active threat trends and related … combined between backend/cloud development and data platform engineering roles5+ years of experience building data platform product(s) or features with (one of) Apache Spark, Flink or Iceberg, or with comparable tools in GCP5+ years of experience programming with Java, Scala or Kotlin. Proven experience utilizing AI technologies ...

strong focus on cost efficiency, scalability, and operational excellence. Key Responsibilities Design and build scalable, real-time data processing systems using technologies like Apache Flink, Kafka. Develop high-quality, maintainable code for Apache Flink (Java) data processing and .NET APIs. Lead and contribute to collaborative system design, while … cost. What We’re Looking For Excellent collaboration and communication skills. Strong experience in distributed systems and event-driven architectures. Hands-on experience with: Apache Flink (or similar stream processing frameworks) Kafka or other messaging systems. Strong Proficiency in .NET or Java. Experience building systems that are highly observable ...

intersection of consulting, technology, innovation, and strategic alliances and you will bring deep expertise in the Databricks Data Intelligence Platform, Lakehouse architecture, Delta Lake, Apache Spark, Unity Catalog, MLflow, Mosaic AI, data engineering, machine learning, GenAI and cloud-native delivery. As a key leader within our AI & Data Practice … translate business needs into Databricks-led solution designs, build prototypes and proof points. • Shape end-to-end solutions using Databricks Intelligence Platform, Delta Lake, Apache Spark, Unity Catalog, Databricks Workflows, Delta Live Tables/Lakeflow-style pipelines, MLflow, Feature Store, Model Serving and Mosaic AI capabilities. Team Leadership & Delivery ...

intersection of consulting, technology, innovation, and strategic alliances and you will bring deep expertise in the Databricks Data Intelligence Platform, Lakehouse architecture, Delta Lake, Apache Spark, Unity Catalog, MLflow, Mosaic AI, data engineering, machine learning, GenAI and cloud-native delivery. As a key leader within our AI & Data Practice … translate business needs into Databricks-led solution designs, build prototypes and proof points. Shape end-to-end solutions using Databricks Intelligence Platform, Delta Lake, Apache Spark, Unity Catalog, Databricks Workflows, Delta Live Tables/Lakeflow-style pipelines, MLflow, Feature Store, Model Serving and Mosaic AI capabilities. Build, lead, upskill ...

bespoke integration approaches for source-system onboarding. Define conceptual, logical and physical data models, including data flows, data domains and data ownership considerations. Specify Apache NiFi architecture patterns, flow standards, interface contracts and reusable ingestion components. Define governance, metadata, lineage, auditability, security monitoring and data quality requirements. Produce High … lake architectures on AWS. Strong knowledge of AWS security, IAM, networking, storage and data platform services relevant to secure data engineering. Extensive experience with Apache NiFi architecture, flow design, governance and operational considerations. Experience designing integrations using REST APIs, SOAP services, file transfers, batch ingestion, legacy adapters and bespoke ...

secure AWS data lake Designing secure integration patterns across multiple classifications and MOD operating environments Defining conceptual, logical and physical data models Specifying Apache NiFi architecture patterns, flow standards and reusable ingestion components Designing REST API, SOAP, file-based, batch, legacy and bespoke integrations Defining governance, metadata, lineage, auditability … experience designing secure AWS data platforms and data lake architectures Knowledge of AWS security, IAM, networking, storage and relevant data services Extensive experience with Apache NiFi architecture, flow design and governance Experience designing REST, SOAP, file, batch, legacy and bespoke integrations Knowledge of structured, semi-structured and unstructured data ...

processing at edge and implementing secure configuration distributionBuilding streaming ingestion, event pipelines, batch/stream processing workloads using both distributed event streaming technologies and Apache Flink and/or Apache Spark with clear SLA's and repeatable deployment Implementing metadata, lineage and catalogue capabilities and implementing policy-based ...

processing at edge and implementing secure configuration distributionBuilding streaming ingestion, event pipelines, batch/stream processing workloads using both distributed event streaming technologies and Apache Flink and/or Apache Spark with clear SLA's and repeatable deploymentImplementing metadata, lineage and catalogue capabilities and implementing policy-based security ...

with Oracle Database Management including upgrades for single-instance environments. Experience in installing and maintaining software on Solaris, Linux, or Windows Server. Deployment of Apache Tomcat-based web applications, enhancing web services capabilities. Strong aptitude in direct customer interaction via video, telephone, and email. Ability to troubleshoot and diagnose … ITSM process and ability to leverage modern ITSM tools like ServiceNow, Ivanti or similar. Eligibility for UK Security ClearanceDesirable Skills/Experience: Expertise in Apache Web Server configuration and management, optimizing web app performance. Proficiency in Unix shell scripting, streamlining administrative tasks and automation. Familiarity with Ansible ...