2 of 2 Apache Avro Jobs in Scotland

large-scale data processing.Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning.Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar).Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.).Strong understanding of data quality, security, and lineage best … Airflow, Step Functions, etc.).Databricks or AWS certifications.Demonstrated proficiency in cloud-native development (e.g., cloud, artificial intelligence, machine learning).Experience with Parquet, JSON, CSV, Avro, Delta Lake file formats.J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world’s most prominent corporations ...

Security Groups, CloudFormation, RDS, DynamoDB and Redshift, including secure and well-governed implementations. Data engineering and pipelines, building efficient batch and streaming solutions using Apache Spark and AWS services, and working with large-scale datasets in enterprise environments. Demonstrated technical problem-solving capability, with the ability to rapidly understand … tooling (e.g. GitLab) test-driven development, and delivery of production-ready solutions at scale. Data and streaming technologies, including working knowledge of JSON, Iceberg, Avro, and streaming platforms such as Kafka, MSK, Kinesis or Glue Streaming, alongside Big Data or Data Warehouse environments. You may be assessed ...