5 of 5 Permanent Redshift Spectrum Jobs in London

Develop and maintain SQL-based data integration, transformation, validation, and reconciliation processes. Integrate and support data services including AWS Glue Data Catalog, Athena, Redshift Spectrum, EMR Spark Perform data migration, testing, reconciliation, and unit testing activities to ensure data integrity and successful platform migration. Create ...

Firehose). Orchestrating pipelines using AWS Step Functions/Amazon MWAA/similar services. Designing and optimizing schemas and query performance on Amazon Redshift, including Spectrum and Serverless features. Querying large datasets interactively using Amazon Athena. Managing operational databases using Amazon RDS across engines such ...

live site monitoring Mentor team members through giving and receiving actionable feedback. Our tech stack AWS (Kinesis,Kafka, s3, DMS, Glue, EMR, EKS, Redshift, Spectrum), Apache Pinot, Apache Flink and Airflow. A continuous deployment process based on GitLab A little more about you A Bachelor … Scala, Python, Go, Typescript Experience of designing complex data processing pipeline Experience of data modeling (star schema, dimensional modeling etc) in AWS redshift Experience of query optimisation Experience of kafka is a plus Shipping and maintaining code in production You like sharing your ideas, and you're open ...

build controls that identify incomplete or incorrect data before it reaches the desk. The datasets you'll work with span the full spectrum, from megabyte-sized reference feeds to petabyte-scale alternative-data sources. You will work directly with traders, portfolio managers, and researchers to understand new data … 5+ years in data engineering, including ownership of data platforms, lakehouses, distributed systems, or backend services.- Experience with analytical databases such as Snowflake, Redshift, ClickHouse.- Strong Python and SQL skills.- Production experience with Java or Kotlin. We will also consider strong experience in another systems language.- Experience with ...

simultaneously — not cloud-only. Multi-cloud platform depth (AWS and GCP): hands-on experience with data services across one or both of AWS (Redshift, Glue, S3/Lake Formation, MSK, RDS) and GCP (BigQuery, Dataflow, Pub/Sub, Cloud Composer). Data flow mapping and optimisation: demonstrable experience … technical stakeholders; able to translate complex data architecture concepts into measurable business outcomes and defensible design decisions. Ability to operate across the full spectrum of architecture detail — from enterprise-level data strategy and standards through to the specifics of pipeline design and platform configuration. Proactive identification of data ...