1 to 25 of 59 Amazon Redshift Jobs

Ipswich (Onsite- 5 days) Type of Employment- Permanent Job Overview: We are seeking an experienced AWS Data Engineer with strong expertise in ETL pipelines, Redshift, Iceberg, Athena, and S3 to support large-scale data processing and analytics initiatives in the telecom domain . The candidate will work closely with … CDRs, mediation systems, CRM, billing, network logs . Optimize ETL workflows for large-scale telecom datasets (high volume, high velocity). 2. Data Warehousing (Redshift) Build and manage scalable Amazon Redshift clusters for reporting and analytics. Create and optimize schemas, tables, distribution keys, sort keys , and workload ...

evolving technological environments PREFERRED SKILLS · Airflow, dbt, Spark, Kafka, RabbitMQ, Redis. · Git, CI/CD pipelines. · Experience with data warehousing solutions such as Snowflake, Redshift, BigQuery, or Synapse. · Exposure to AI/ML workflows and model deployment. · Experience with streaming systems and real-time architecture. · Knowledge of event-driven ...

automation Support GenAI initiatives through data readiness, synthetic data generation, and prompt engineering. Mandatory Skills: Cloud Platforms:Deep experience with AWS (S3, Lambda, Glue, Redshift) and/or Azure (Data Lake, Synapse). Programming & Scripting:Proficiency in Python, SQL, PySpark etc. ETL/ELT & Streaming:Expertise in technologies like ...

have skills and experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (eg, S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise ...

have skills and experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (e.g., S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise ...

have skills and experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (e.g., S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise ...

ensure compliance with government security standards. Troubleshoot and resolve issues in complex cloud environments. Essential Skills Strong experience with AWS services (Glue, Lambda, S3, Redshift, IAM). Proficiency in Python and SQL for data engineering tasks. Knowledge of data modelling, ETL frameworks, and best practices. Familiarity with security ...

Spark or Hadoop. Experience with ETL/orchestration tools like Airflow, Talend or Azure Data Factory. Understanding of data warehousing solutions (Snowflake, BigQuery, Redshift or similar). Good understanding of data governance, GDPR and modern security practices. Strong problem solving skills and the ability to work with technical ...

Implement best practices for data security and compliance. Collaborate with stakeholders and external partners. Skills & Experience: Strong experience with AWS data technologies (e.g., S3, Redshift, Lambda). Proficient in Python, Apache Spark, and SQL. Experience in data warehouse design and data migration projects. Cloud data platform development and deployment. ...

Classification policies. Maintain data dictionary. Maintain business level data model. Recommending and introducing new technology where needed. Core: Cloud data platforms (e.g. Snowflake, BigQuery, Redshift) Data transformation technology such as DBT Visual Studio Code Python CI automation systems such as Jenkins A git-based source control system such ...

Classification policies. Maintain data dictionary. Maintain business level data model. Recommending and introducing new technology where needed. Core: Cloud data platforms (e.g. Snowflake, BigQuery, Redshift) Data transformation technology such as DBT Visual Studio Code Python CI automation systems such as Jenkins A git-based source control system such ...

Hands-on experience in data integration , including designing and optimising data pipelines (batch and streaming) and integrating cloud-based platforms (e.g., Azure Synapse, AWS Redshift, Google BigQuery ) with legacy systems, ensuring performance and scalability. Deep knowledge of ETL/ELT processes , leveraging tools like Apache Airflow, dbt, or Informatica ...

working arrangement is in place. About you To be successful in this role it's essential you have: Extensive experience with AWS (S3, Glue, Redshift, SageMaker) Experience of building and automating data pipelines in finance The ability to demonstrate, automate and manage data systems so they run smoothly ...

reconciliation checks Strong error handling, monitoring, and retry strategies in production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary indexes, streams, and performance optimization Amazon Redshift: foundational querying, integrations … performance considerations AWS Lambda for scalable data processing and orchestration Amazon EventBridge for event-driven and decoupled data pipelines Vector Databases & Embeddings Strong understanding of vector database concepts, indexing strategies, and performance trade-offs Design and implementation of embedding generation pipelines Optimization techniques for semantic search and retrieval accuracy ...

reconciliation checks Strong error handling, monitoring, and retry strategies in production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary indexes, streams, and performance optimization Amazon Redshift: foundational querying, integrations … performance considerations AWS Lambda for scalable data processing and orchestration Amazon EventBridge for event-driven and decoupled data pipelines Vector Databases & Embeddings Strong understanding of vector database concepts, indexing strategies, and performance trade-offs Design and implementation of embedding generation pipelines Optimization techniques for semantic search and retrieval accuracy ...

Assist with resolution of support issues. Requirements 4+ years of experience as a Data Engineer or on a similar role. Extensive experience with SQL, Amazon Redshift & ideally MySQL. Extensive experience with visualisation tools, ideally with Amazon QuickSight. Experience with AWS Glue and the ability to write Python … technologies. Knowledge of SAP Business Objects would be helpful but not necessary - currently in use but in the process of migrating to Redshift & QuickSight. ...

Assist with resolution of support issues. Requirements 4+ years of experience as a Data Engineer or on a similar role. Extensive experience with SQL, Amazon Redshift & ideally MySQL. Extensive experience with visualisation tools, ideally with Amazon QuickSight. Experience with AWS Glue and the ability to write Python … technologies. Knowledge of SAP Business Objects would be helpful but not necessary - currently in use but in the process of migrating to Redshift & QuickSight. ...

Build and maintain data pipelines integrating MDM with source/target systems on AWS. Work with AWS services such as: EC2, S3, RDS/Redshift, Lambda, Glue, CloudWatch, Step Functions (customize based on your environment) Implement CI/CD pipelines for MDM deployments using CodePipeline, Git, or similar. Unix ...

hybrid working arrangement is in place. About you To be successful in this role its essential you have: Extensive experience with AWS (S3, Glue, Redshift, SageMaker) Experience of building and automating data pipelines in finance The ability to demonstrate, automate and manage data systems so they run smoothly ...

managed ML platforms such as SageMaker, Vertex AI or Azure ML Data engineering and MLOps Experience with data warehouses such as Snowflake, BigQuery or Redshift Workflow orchestration using tools like Airflow or Dagster Experience with MLOps tools such as MLflow, Weights and Biases or similar Awareness of data ...

management role Excellent knowledge of data modelling, warehousing concepts, and large-scale distributed systems Hands-on experience with cloud-based data tools (AWS Redshift, Glue, EMR or similar) Proficiency in Python and SQL Understanding of DevOps principles, including CI/CD and IaC (e.g. Terraform) Clear communication skills ...

Kafka, .Net, Java, REST APIs, AWS, Terraform and DevOps Nice to have:experience in data pipping and modelling using SQL, DBT, ETL, Data Warehousing, Redshift and Python, and ecommerce and mobile applications background Additional Information Were a community here that cares as much about your life outside work ...

resolution of data/reporting issues. Requirements 4+ years' experience as a Data Engineer or similar role. Strong SQL skills; extensive experience with Amazon Redshift (and ideally MySQL). Experience with data visualisation tools (preferably Amazon QuickSight). Proficient in AWS Glue and Python for ETL. Strong ...

ability to collaborate across business and technology teams. Key Responsibilities Design, develop, and maintain ETL/ELT data pipelines using AWS services (Glue, EMR, Redshift, S3, Athena, Lambda, Step Functions Develop and optimize large-scale data processing workflows using Python and PySpark. Collaborate with business stakeholders to translate data … backlog grooming. Required Qualifications 10+ years of professional experience as a Data Engineer. Strong hands-on expertise in AWS Data Services: Glue, EMR, Redshift, Athena, S3, Lambda, Step Functions, CloudWatch. Proficiency in Python and PySpark for ETL, transformation, and automation. Strong experience in SQL and data modeling (star schema ...

error handling and retry logic. Develop incremental data processing patterns for large-scale datasets. Work with AWS services including Glue, Step Functions, S3, DynamoDB, Redshift, Lambda, and EventBridge. Build and optimise vector database solutions and embedding generation pipelines for semantic search. Implement document processing workflows (PDF parsing, OCR, metadata ...