1 to 25 of 32 Apache Avro Jobs in the UK

Microsoft Fabric Spark/PySpark Strong understanding of: Data Lake and Lakehouse architecture Hybrid cloud environments Enterprise integration patterns Modern data formats including Parquet, Avro, and ORC DevOps & Platform Engineering Experience implementing CI/CD pipelines and DevOps practices. Experience with infrastructure automation and environment management. Familiarity with: Docker ...

another messaging platform in high-throughput production environments.Experience building internal developer platforms, SDKs, or shared infrastructure services.Knowledge of schema registries, event contracts, protobuf, Avro, or JSON Schema.Experience with service mesh, API gateways, or service-to-service communication patterns.Familiarity with infrastructure as code tools such as Terraform, Pulumi, or similar.Experience ...

messaging platform in high-throughput production environments. Experience building internal developer platforms, SDKs, or shared infrastructure services. Knowledge of schema registries, event contracts, protobuf, Avro, or JSON Schema. Experience with service mesh, API gateways, or service-to-service communication patterns. Familiarity with infrastructure as code tools such as Terraform ...

experience designing schemas for relational databases, messaging, data lakes/lakehouses (Databricks, Snowflake, or equivalent), and API/message formats (JSON Schema, OpenAPI, Avro, Protobuf). Strong understanding of metadata and lineage management.• 5+ years of experience, or demonstrated delivery against requirements in data modelling, data architecture ...

experience designing schemas for relational databases, messaging, data lakes/lakehouses (Databricks, Snowflake, or equivalent), and API/message formats (JSON Schema, OpenAPI, Avro, Protobuf). Strong understanding of metadata and lineage management. 5+ years of experience, or demonstrated delivery against requirements in data modelling, data architecture ...

Databases, and/or Data Integration (ETL) or API development. Knowledge of some Data Formats such as JSON, XML, and binary formats such as Avro or Google Protocol Buffers. Experience collaborating with business and technical teams to understand, translate, review, and playback requirements and collaborate to develop Model Engineering ...

Columnar Databases, and/or Data Integration (ETL) or API development.Knowledge of some Data Formats such as JSON, XML, and binary formats such as Avro or Google Protocol Buffers.Experience collaborating with business and technical teams to understand, translate, review, and playback requirements and collaborate to develop Model Engineering solutions.Exposure ...

with data management technologies such as relational or columnar databases, data integration (ETL), or API development• Familiarity with data formats such as JSON, XML, Avro, or Google Protocol Buffers• Comfort engaging with the algorithms and mathematics behind languages, tooling, and data processing• Academic background paired with hands-on implementation ...

with data management technologies such as relational or columnar databases, data integration (ETL), or API development - Familiarity with data formats such as JSON, XML, Avro, or Google Protocol Buffers - Comfort engaging with the algorithms and mathematics behind languages, tooling, and data processing - Academic background paired with hands-on implementation ...

with data management technologies such as relational or columnar databases, data integration (ETL), or API development Familiarity with data formats such as JSON, XML, Avro, or Google Protocol Buffers Comfort engaging with the algorithms and mathematics behind languages, tooling, and data processing Academic background paired with hands‐on implementation ...

platforms.Solid Cloud and DevOps knowledge, including Linux/Unix, OpenShift/Kubernetes, and Ansible.Experience building and supporting reactive, event-sourced systems.Hands-on experience with Apache Spark and Apache Flink.Strong understanding of Apache HTTP, Envoy, and REST API design.Experience working with Protobuf, Avro, and Parquet data formats.Knowledge ...

reconciliation and root-cause analysis.Experience building or supporting production data pipelines in a collaborative engineering environment.Experience working with distributed data processing frameworks such as Apache Spark.Working knowledge of common data formats such as JSON, Avro and Parquet.For More Experienced CandidatesStronger ownership of technical design across multiple datasets … should bring relevant experience and the ability to work across comparable technologies.Examples of technologies in scope include:Data processing and logic: ANSI SQL, Apache Spark, KafkaData formats: JSON, Avro, ParquetPlatforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQEngineering and deployment: CI/CD tooling ...

root-cause analysis. Experience building or supporting production data pipelines in a collaborative engineering environment. Experience working with distributed data processing frameworks such as Apache Spark. Working knowledge of common data formats such as JSON, Avro and Parquet. Technology EnvironmentThe role will involve working with a modern … should bring relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, KafkaData formats: JSON, Avro, ParquetPlatforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQEngineering and deployment: CI/ ...

accountable.Additional exposure to the following is desired: – Tech Stack you will learn· Hadoop and Flink· RUST, Javascript, React, Redux, Flow· Linux, Jenkins· Kafka, Avro, Kubernetes, Puppet· Involvement in the Java communityMy client is based London. Home work is encouraged but you will need to be able to come ...

/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications• Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications• Advanced Data Management – Strong SQL design, query optimization, and database architecture ...

DevOps knowledge, including Linux/Unix, OpenShift/Kubernetes, and Ansible. Experience building and supporting reactive, event-sourced systems. Hands-on experience with Apache Spark and Apache Flink. Strong understanding of Apache HTTP, Envoy, and REST API design. Experience working with Protobuf, Avro, and Parquet data ...

root‐cause analysis. Experience building or supporting production data pipelines in a collaborative engineering environment. Experience working with distributed data processing frameworks such as Apache Spark . Working knowledge of common data formats such as JSON , Avro and Parquet . For More Experienced Candidates Stronger ownership of technical … should bring relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised ...

GWTHighly motivatedDelivery focused and accountable.Additional exposure to the following is desired: – Tech Stack you will learnHadoop and FlinkRUST, Javascript, React, Redux, FlowLinux, JenkinsKafka, Avro, Kubernetes, PuppetInvolvement in the Java communityMy client is based London. Home work is encouraged but you will need to be able to come ...

firm then don't worry. Additional exposure to the following is desired: – Tech Stack you will learnHadoop and FlinkRUST, Javascript, React, Redux, FlowLinux, JenkinsKafka, Avro, Kubernetes, PuppetInvolvement in the Java communityMy client is based London. Home work is encouraged but you will need to be able to come ...

firm then don't worry. Additional exposure to the following is desired: – Tech Stack you will learnHadoop and FlinkRUST, Javascript, React, Redux, FlowLinux, JenkinsKafka, Avro, Kubernetes, PuppetInvolvement in the Java communityMy client is based London. Home work is encouraged but you will need to be able to come ...

firm then don’t worry.Additional exposure to the following is desired: – Tech Stack you will learnHadoop and FlinkRUST, Javascript, React, Redux, FlowLinux, JenkinsKafka, Avro, Kubernetes, PuppetInvolvement in the Java communityMy client is based London. Home work is encouraged but you will need to be able to come ...

root‐cause analysis. Experience building or supporting production data pipelines in a collaborative engineering environment. Experience working with distributed data processing frameworks such as Apache Spark . Working knowledge of common data formats such as JSON , Avro and Parquet . Technology Environment The role will involve working with … should bring relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised ...

data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar). Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.). Strong understanding of data quality, security … etc.). Databricks or AWS certifications. Demonstrated proficiency in cloud-native development (e.g., cloud, artificial intelligence, machine learning). Experience with Parquet, JSON, CSV, Avro, Delta Lake file formats. #J-18808-Ljbffr ...

large-scale data processing.Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning.Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar).Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.).Strong understanding of data quality, security, and lineage best … Airflow, Step Functions, etc.).Databricks or AWS certifications.Demonstrated proficiency in cloud-native development (e.g., cloud, artificial intelligence, machine learning).Experience with Parquet, JSON, CSV, Avro, Delta Lake file formats.J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world’s most prominent corporations ...

data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar).Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.).Strong understanding of data quality, security, and lineage best … Step Functions, etc.).Databricks or AWS certifications. Demonstrated proficiency in cloud-native development (e.g., cloud, artificial intelligence, machine learning).Experience with Parquet, JSON, CSV, Avro, Delta Lake file formats.J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world's most prominent corporations ...