1 to 25 of 80 Amazon Redshift Jobs

robust ETL/ELT data pipelines using Python and PySpark Build and optimize data models and schemas for analytics and reporting Work extensively with Amazon Redshift for data warehousing, performance tuning, and query optimization Develop complex SQL queries for data transformation and analysis Integrate data from multiple sources … experience with PySpark/Apache Spark Advanced proficiency in SQL (query optimization, window functions, CTEs) Experience with AWS data warehousing tools, including: o Amazon Redshift & RDS o AWS Glue, Lambda & Airflow o Amazon S3, EventBridge & Kinesis Solid understanding of data warehousing concepts (star/snowflake schemas, fact ...

Ipswich (Onsite- 5 days) Type of Employment- Permanent Job Overview: We are seeking an experienced AWS Data Engineer with strong expertise in ETL pipelines, Redshift, Iceberg, Athena, and S3 to support large-scale data processing and analytics initiatives in the telecom domain . The candidate will work closely with … CDRs, mediation systems, CRM, billing, network logs . Optimize ETL workflows for large-scale telecom datasets (high volume, high velocity). 2. Data Warehousing (Redshift) Build and manage scalable Amazon Redshift clusters for reporting and analytics. Create and optimize schemas, tables, distribution keys, sort keys , and workload ...

evolving technological environments PREFERRED SKILLS · Airflow, dbt, Spark, Kafka, RabbitMQ, Redis. · Git, CI/CD pipelines. · Experience with data warehousing solutions such as Snowflake, Redshift, BigQuery, or Synapse. · Exposure to AI/ML workflows and model deployment. · Experience with streaming systems and real-time architecture. · Knowledge of event-driven ...

have skills and experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (eg, S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise ...

have skills and experience in the following: Cloud Data Architecture: Strong knowledge of modern, cloud-based data architecture and tooling (e.g., S3, Glue, Redshift, Athena, Lake Formation, Iceberg/Delta). AWS Platform Build: Demonstrable experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise ...

various teams to align migration processes with organisational goals and regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data ...

ensure compliance with government security standards. Troubleshoot and resolve issues in complex cloud environments. Essential Skills Strong experience with AWS services (Glue, Lambda, S3, Redshift, IAM). Proficiency in Python and SQL for data engineering tasks. Knowledge of data modelling, ETL frameworks, and best practices. Familiarity with security ...

Spark or Hadoop. Experience with ETL/orchestration tools like Airflow, Talend or Azure Data Factory. Understanding of data warehousing solutions (Snowflake, BigQuery, Redshift or similar). Good understanding of data governance, GDPR and modern security practices. Strong problem solving skills and the ability to work with technical ...

inPython for automation, pipeline development, and data validation. Proven success with cloud-based data platforms such as Snowflake, Databricks, and AWS (e.g., S3, Glue, Redshift, Lambda, Secrets Manager Solid knowledge of data warehousing principles, including dimensional modeling, star schemas, slowly changing dimensions, and aggregate strategies. Experience working with unstructured ...

predictive and prescriptive insights. ETL & Data Engineering: Experience designing scalable ETL/ELT pipelines using modern tools and frameworks. Cloud Platforms: Familiarity with AWS (Redshift, Athena, S3) or Azure (Synapse, Data Lake, ADF). Data Governance: Understanding of GDPR, PII, and secure data management principles. Communication: Strong data storytelling ...

tools ( Streamsets, DBT etc.) >Hands on experience with Oracle RDBMS >Data Migration experience to Snowflake >Experience with AWS services such as S3, Lambda, Redshift, and Glue. >Strong understanding of data warehousing concepts and data modeling. >Excellent problem-solving and communication skills, with a focus on delivering high-quality solutions. ...

Classification policies. Maintain data dictionary. Maintain business level data model. Recommending and introducing new technology where needed. Core: Cloud data platforms (e.g. Snowflake, BigQuery, Redshift) Data transformation technology such as DBT Visual Studio Code Python CI automation systems such as Jenkins A git-based source control system such ...

Hands-on experience in data integration , including designing and optimising data pipelines (batch and streaming) and integrating cloud-based platforms (e.g., Azure Synapse, AWS Redshift, Google BigQuery ) with legacy systems, ensuring performance and scalability. Deep knowledge of ETL/ELT processes , leveraging tools like Apache Airflow, dbt, or Informatica ...

skills in Python and SQL for ELT/ETL and transformation workflows. Experience with cloud native storage and compute tools: S3, Data Lake, ADF, Redshift, Synapse, etc. Familiarity with CI/CD pipelines, test automation, and DevOps practices in data workflows. Stakeholder management Career & Development Opportunities Structured career progression ...

Functions. Skilled in modern programming, particularly Python, Java, Scala and PySpark. Solid knowledge of data storage and big data technologies, including data warehouses, databases, Redshift, RDS and Hadoop. Experience building and managing AWS data lakes on S3 for both structured and unstructured data. What happens next? To apply, please ...

term contract. The Role: Design, build, and maintain resilient, automated data pipelines using Talend Data Integration. Work with modern AWS technologies including S3, Glue, Redshift, and Spectrum. Optimise data workflows to ensure reporting, analytics, and performance management are powered by high-quality, trustworthy data. Collaborate with architects, Qlik developers ...

reconciliation checks Strong error handling, monitoring, and retry strategies in production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary indexes, streams, and performance optimization Amazon Redshift: foundational querying, integrations … performance considerations AWS Lambda for scalable data processing and orchestration Amazon EventBridge for event-driven and decoupled data pipelines Vector Databases & Embeddings Strong understanding of vector database concepts, indexing strategies, and performance trade-offs Design and implementation of embedding generation pipelines Optimization techniques for semantic search and retrieval accuracy ...

reconciliation checks Strong error handling, monitoring, and retry strategies in production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary indexes, streams, and performance optimization Amazon Redshift: foundational querying, integrations … performance considerations AWS Lambda for scalable data processing and orchestration Amazon EventBridge for event-driven and decoupled data pipelines Vector Databases & Embeddings Strong understanding of vector database concepts, indexing strategies, and performance trade-offs Design and implementation of embedding generation pipelines Optimization techniques for semantic search and retrieval accuracy ...

Assist with resolution of support issues. Requirements 4+ years of experience as a Data Engineer or on a similar role. Extensive experience with SQL, Amazon Redshift & ideally MySQL. Extensive experience with visualisation tools, ideally with Amazon QuickSight. Experience with AWS Glue and the ability to write Python … technologies. Knowledge of SAP Business Objects would be helpful but not necessary - currently in use but in the process of migrating to Redshift & QuickSight. ...

Assist with resolution of support issues. Requirements 4+ years of experience as a Data Engineer or on a similar role. Extensive experience with SQL, Amazon Redshift & ideally MySQL. Extensive experience with visualisation tools, ideally with Amazon QuickSight. Experience with AWS Glue and the ability to write Python … technologies. Knowledge of SAP Business Objects would be helpful but not necessary - currently in use but in the process of migrating to Redshift & QuickSight. ...

Build and maintain data pipelines integrating MDM with source/target systems on AWS. Work with AWS services such as: EC2, S3, RDS/Redshift, Lambda, Glue, CloudWatch, Step Functions (customize based on your environment) Implement CI/CD pipelines for MDM deployments using CodePipeline, Git, or similar. Unix ...

e.g., MySQL, PostgreSQL, MongoDB, Cassandra). Hands-on experience with cloud platforms (e.g., AWS, GCP, Azure) and their data services (e.g., Snowflake, S3, BigQuery, Redshift). Experience with containerisation and orchestration tools (e.g., Docker, Kubernetes). Familiarity with version control systems (e.g., Git) and CI/CD pipelines. Desirable ...

managed ML platforms such as SageMaker, Vertex AI or Azure ML Data engineering and MLOps Experience with data warehouses such as Snowflake, BigQuery or Redshift Workflow orchestration using tools like Airflow or Dagster Experience with MLOps tools such as MLflow, Weights and Biases or similar Awareness of data ...

managed ML platforms such as SageMaker, Vertex AI or Azure ML Data engineering and MLOps Experience with data warehouses such as Snowflake, BigQuery or Redshift Workflow orchestration using tools like Airflow or Dagster Experience with MLOps tools such as MLflow, Weights and Biases or similar Awareness of data ...

management role Excellent knowledge of data modelling, warehousing concepts, and large-scale distributed systems Hands-on experience with cloud-based data tools (AWS Redshift, Glue, EMR or similar) Proficiency in Python and SQL Understanding of DevOps principles, including CI/CD and IaC (e.g. Terraform) Clear communication skills ...