Responsibilities: Design and develop scalable, high-performance data processing applications using Scala. Build and optimize ETL pipelines for handling large-scale datasets. Work with Apache Spark, Kafka, Flink, and other distributed data frameworks to process massive amounts of data. Develop and maintain data lake and warehouse solutions using technologies … like Databricks Delta Lake, Apache Iceberg, or Apache Hudi. Write clean, maintainable, and well-documented code. Optimize query performance, indexing strategies, and storage formats (JSON, Parquet, Avro, ORC). Implement real-time streaming solutions and event-driven architectures. Collaborate with data scientists, analysts, and DevOps engineers to … Master’s degree in Computer Science Engineering, or a related field. 10+ years of experience in software development with Scala Hands-on experience with Apache Spark (batch & streaming) using Scala. Experience in developing and maintaining data lake and warehouses using technologies like Databricks Delta Lake, Apache Iceberg, or More ❯
practices include OWASP guidelines/top 10, SOC 2, and NCSC cloud security principles. Experience in data and orchestration tools including some of dbt, Apache Airflow, Azure Data Factory. Experience in programming languages including some of Python, Typescript, Javascript, R, Java, C#, producing services, APIs, Function Apps or Lambdas. More ❯
such as Relational and Columnar Databases, Data Integration (ETL), or API development. Familiarity with data formats like JSON, XML, and binary formats such as Avro or Google Protocol Buffers. Experience working with business and technical teams to develop Model Engineering solutions. Proficiency with tools like SQL, JavaScript, or Python More ❯
building and maintaining complex data pipelines. These pipelines ingest and transform data from diverse sources (e.g., email, CSV, ODBC/JDBC, JSON, XML, Excel, Avro, Parquet) using AWS technologies such as S3, Athena, Redshift, Glue, and programming languages like Python and Java (Docker/Spring). What You’ll More ❯
IIBA (International Institute of Business Analysis)
Databases, and/or Data Integration (ETL) or API development. Knowledge of some Data Formats such as JSON, XML, and binary formats such as Avro or Google Protocol Buffers. Experience collaborating with business and technical teams to understand, translate, review, and playback requirements and collaborate to develop Model Engineering More ❯
building and maintaining complex data pipelines. These pipelines ingest and transform data from diverse sources (e.g., email, CSV, ODBC/JDBC, JSON, XML, Excel, Avro, Parquet) using AWS technologies such as S3, Athena, Redshift, Glue, and programming languages like Python and Java (Docker/Spring) . What You’ll More ❯
building and maintaining complex data pipelines. These pipelines ingest and transform data from diverse sources (e.g., email, CSV, ODBC/JDBC, JSON, XML, Excel, Avro, Parquet) using AWS technologies such as S3, Athena, Redshift, Glue, and programming languages like Python and Java (Docker/Spring) . What You’ll More ❯
support for OpenLink and processes developed by the group Participate in capacity planning and performance/throughput analysis Consuming and publish transaction data in AVRO over Kafka Automation of system maintenance tasks, end-of-day processing jobs, data integrity checks and bulk data loads/extracts Release planning and More ❯
define all data at Bloomberg, complete with schema evolution, versioning, and true point in time semantics. We were the first team to introduce Kafka, Avro, company-wide Dataset Schema Registry, Mesos, Clustered MySQL, Vitess and Spark for ETL, at Bloomberg for designing this new data intensive platform that is More ❯
and web Team leadership and architecture experience Knowledge of stateless, functional models for system development Knowledge of data serialization techniques and libraries such as Avro, Google protocol buffers Passion for Motorsports and working in a high-pace environment Company Vehicle: Upon successful completion of a motor vehicle report review More ❯
and web Team leadership and architecture experience Knowledge of stateless, functional models for system development Knowledge of data serialization techniques and libraries such as Avro, Google protocol buffers Passion for Motorsports and working in a high-pace environment Company Vehicle: Upon successful completion of a motor vehicle report review More ❯
and web Team leadership and architecture experience Knowledge of stateless, functional models for system development Knowledge of data serialization techniques and libraries such as Avro, Google protocol buffers Passion for Motorsports and working in a high-pace environment Company Vehicle: Upon successful completion of a motor vehicle report review More ❯
and web Team leadership and architecture experience Knowledge of stateless, functional models for system development Knowledge of data serialization techniques and libraries such as Avro, Google protocol buffers Passion for Motorsports and working in a high-pace environment Company Vehicle: Upon successful completion of a motor vehicle report review More ❯
and web Team leadership and architecture experience Knowledge of stateless, functional models for system development Knowledge of data serialization techniques and libraries such as Avro, Google protocol buffers Passion for Motorsports and working in a high-pace environment Company Vehicle: Upon successful completion of a motor vehicle report review More ❯
and web Team leadership and architecture experience Knowledge of stateless, functional models for system development Knowledge of data serialization techniques and libraries such as Avro, Google protocol buffers Passion for Motorsports and working in a high-pace environment Company Vehicle: Upon successful completion of a motor vehicle report review More ❯
and web Team leadership and architecture experience Knowledge of stateless, functional models for system development Knowledge of data serialization techniques and libraries such as Avro, Google protocol buffers Passion for Motorsports and working in a high-pace environment Company Vehicle: Upon successful completion of a motor vehicle report review More ❯
and web Team leadership and architecture experience Knowledge of stateless, functional models for system development Knowledge of data serialization techniques and libraries such as Avro, Google protocol buffers Passion for Motorsports and working in a high-pace environment Company Vehicle: Upon successful completion of a motor vehicle report review More ❯
and web Team leadership and architecture experience Knowledge of stateless, functional models for system development Knowledge of data serialization techniques and libraries such as Avro, Google protocol buffers Passion for Motorsports and working in a high-pace environment Company Vehicle: Upon successful completion of a motor vehicle report review More ❯
and web Team leadership and architecture experience Knowledge of stateless, functional models for system development Knowledge of data serialization techniques and libraries such as Avro, Google protocol buffers Passion for Motorsports and working in a high-pace environment Company Vehicle: Upon successful completion of a motor vehicle report review More ❯
and web Team leadership and architecture experience Knowledge of stateless, functional models for system development Knowledge of data serialization techniques and libraries such as Avro, Google protocol buffers Passion for Motorsports and working in a high-pace environment Company Vehicle: Upon successful completion of a motor vehicle report review More ❯
and web Team leadership and architecture experience Knowledge of stateless, functional models for system development Knowledge of data serialization techniques and libraries such as Avro, Google protocol buffers Passion for Motorsports and working in a high-pace environment Company Vehicle: Upon successful completion of a motor vehicle report review More ❯
and web Team leadership and architecture experience Knowledge of stateless, functional models for system development Knowledge of data serialization techniques and libraries such as Avro, Google protocol buffers Passion for Motorsports and working in a high-pace environment Company Vehicle: Upon successful completion of a motor vehicle report review More ❯
and web Team leadership and architecture experience Knowledge of stateless, functional models for system development Knowledge of data serialization techniques and libraries such as Avro, Google protocol buffers Passion for Motorsports and working in a high-pace environment Company Vehicle: Upon successful completion of a motor vehicle report review More ❯
and web Team leadership and architecture experience Knowledge of stateless, functional models for system development Knowledge of data serialization techniques and libraries such as Avro, Google protocol buffers Passion for Motorsports and working in a high-pace environment Company Vehicle: Upon successful completion of a motor vehicle report review More ❯
and web Team leadership and architecture experience Knowledge of stateless, functional models for system development Knowledge of data serialization techniques and libraries such as Avro, Google protocol buffers Passion for Motorsports and working in a high-pace environment Company Vehicle: Upon successful completion of a motor vehicle report review More ❯
