1 to 25 of 37 Permanent Amazon Athena Jobs in the UK excluding London

Data Factory.* Azure Data Engineer Associate and Databricks Certified Data Engineer Professional**AWS*** Proficiency with AWS Tools: Demonstrable experience using AWS Glue, AWS Lambda, Amazon Kinesis, Amazon EMR , Amazon Athena, Amazon DynamoDB, Amazon Cloudwatch, Amazon SNS and AWS Step Functions.* Programming Skills: Strong ...

slowly changing dimensions (SCD Types 1, 2, 3) Data analysis skills to identify root cause of issues within pipelines and data assets AWS services Amazon EMR - running Spark workloads and reviewing output logs Amazon Athena - ad hoc querying of data in S3 Amazon Textract and Comprehend ...

slowly changing dimensions (SCD Types 1, 2, 3) Data analysis skills to identify root cause of issues within pipelines and data assets AWS services Amazon EMR - running Spark workloads and reviewing output logs Amazon Athena - ad hoc querying of data in S3 Amazon Textract and Comprehend ...

architectures Ability to work directly with stakeholders and translate business requirements into scalable technical solutions Desirable Experience AWS Data Services (Glue, EMR, Lambda, S3, Athena, Redshift) Streaming technologies such as Kafka or Kinesis Data modelling and metadata management AI/ML data pipelines and feature engineering Geospatial, sensor, operational ...

Implement and deploy machine learning models and statistical analyses in production environments Architect and manage AWS cloud infrastructure for data workloads (S3, Lambda, Glue, Athena, SageMaker, Step Functions) Collaborate with domain experts to translate rail inspection requirements into technical solutions Write clean, tested, well-documented code following engineering best ...

Implement and deploy machine learning models and statistical analyses in production environments Architect and manage AWS cloud infrastructure for data workloads (S3, Lambda, Glue, Athena, SageMaker, Step Functions) Collaborate with domain experts to translate rail inspection requirements into technical solutions Write clean, tested, well-documented code following engineering best ...

pipelines Understanding of data quality, governance and security Experience with Microsoft Fabric and/or Azure Experience with AWS services such as S3, Glue, Athena, Lambda and Firehose Experience working with operational/observability data from CloudWatch Understanding of GDPR, NHS information governance and data minimisation principles #J ...

trusted insights. Responsibilities: Design & build scalable data pipelines of AWS Ingest, transform and model data from multiple source systems Work with S3, Glue, Lambda, Athena, Redshift and related AWS Services Support CI/CD and infrastructure as a code Requirements: Must have strong, commercial AWS (contract) Data Engineering experience ...

prescriptive insights. ETL & Data Engineering: Experience designing scalable ETL/ELT pipelines using modern tools and frameworks. Cloud Platforms: Familiarity with AWS (Redshift, Athena, S3) or Azure (Synapse, Data Lake, ADF). Data Governance: Understanding of GDPR, PII, and secure data management principles. Communication: Strong data storytelling skills, with ...

datasets Designing and developing ETL/ELT pipelines and modern data platforms Experience with AWS-based data platforms AWS services including Glue, Step Functions, Athena, S3 and serverless architectures Data modelling, transformation and orchestration tooling such as dbt Working with modern analytical storage formats including Parquet and Iceberg Building ...

prescriptive insights. ETL & Data Engineering: Experience designing scalable ETL/ELT pipelines using modern tools and frameworks. Cloud Platforms: Familiarity with AWS (Redshift, Athena, S3) or Azure (Synapse, Data Lake, ADF). Data Governance: Understanding of GDPR, PII, and secure data management principles. Communication: Strong data storytelling skills, with ...

including formats such as parquet, avro and JSON Write efficient SQL to query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services Implement data quality checks, validation processes, monitoring … delivery Support the performance tuning and optimisation of data pipelines, SQL workloads and integration services Work with AWS services such as S3, Glue, Lambda, Athena and Step Functions, or Azure equivalents including Data Lake Storage Gen2, Data Factory, Synapse, Azure Functions and Logic Apps Contribute to documentation, runbooks, data ...

cloud technologies. Strong experience with data orchestration tools: e.g. Apache Airflow, Dagster. Experience with big data storage and processing technologies: e.g. DBT, Spark, SQL, Athena/Trino, Redshift, Snowflake, RDBMSs (PostgreSQL/MySQL). Knowledge of event‐driven architectures and streaming technologies: e.g. Apache Kafka, Kafka Streams, Apache Flink. ...

Mosaic AI, Vector Search and Unity Catalog, or Azure OpenAI, Azure AI Foundry and Azure AI Search. AWS: Glue, Lambda, Step Functions, Kinesis, EMR, Athena, Redshift, S3 data lakes; and, for the AI edge, Amazon Bedrock, Knowledge Bases for Bedrock About Capgemini Hybrid working: The places that ...

looking for: Essential: Proven experience building data pipelines Strong understanding of data modelling and structures Hands-on experience with AWS services (EC2, RDS, Lambda, Athena, Glue) Knowledge of relational and NoSQL databases Python or equivalent scripting language Experience with test-driven development Familiarity with Agile delivery Clearance ...

data pipelines, ETL/ELT processes, and data integration frameworks. Develop andoptimizedata architectures using AWS services such as S3, Glue, Lambda, Redshift, Kinesis, EMR, Amazon OpenSearch Service, and graph databases such as Amazon Neptune, and related technologies. Ensure solutions follow AWS best practices for security, performance, cost optimization … development. Whatyou'llbring Considerable experiencein data engineeringfocused on AWS data platforms and services. Strong hands-on experience withAWS data servicesincluding S3, Glue, Lambda, Redshift, Athena, EMR, Kinesis, Amazon OpenSearch Service, and graph databases such as Amazon Neptune, and related technologies. Proficiencyin programming languages such asPythonandSQL fordata processing ...

looking for: Essential: Proven experience building data pipelinesStrong understanding of data modelling and structuresHands-on experience with AWS services (EC2, RDS, Lambda, Athena, Glue)Knowledge of relational and NoSQL databasesPython or equivalent scripting languageExperience with test-driven developmentFamiliarity with Agile deliveryClearance: Due to the nature of this role, candidates ...

technologies Practical experience developing Production-scale Cloud-native data engineering solutions in commercial environments Familiarity with Cloud Data engineering services (e.g., ETL, Glue, S3, Athena) and MLOps stack Ability to convey design choices and results clearly and communicate effectively to stakeholders of various backgrounds Preferred qualifications, capabilities, and skills ...

Delta; Dremio vs Trino vs Snowflake; streaming vs batch). Hands‐on experience with: Dremio, Snowflake, or Databricks AWS data services (S3, Glue, Athena, Lake Formation, or equivalent) NATS/Apache Kafka or similar, and CDC patterns (Debezium or equivalent) Stream processing (Apache Flink, Spark Structured Streaming, or equivalent ...

processes for ingesting, transforming and processing data from multiple sources Design and implement data solutions using AWS services such as S3, Glue, Lambda, Athena, Redshift, EMR and related technologies Design data models and storage approaches appropriate to analytical and operational requirements Develop solutions using Python, SQL and modern data … within complex enterprise environments Strong experience designing and delivering data solutions on AWS Strong knowledge of AWS data services such as S3, Glue, Lambda, Athena, Redshift and EMR, with experience selecting the appropriate services for different requirements Strong Python and SQL skills Experience designing and building scalable ETL/ ...

reconciliation, and audit controls across betting, trading, and customer data domains. Develop streaming and micro-batch data solutions using AWS Kinesis, Apache Kafka, or Amazon MSK to support real-time sportsbook and in-play data feeds. Build and maintain data solutions using AWS services including S3, Glue, Lambda, Athena … cloud without losing fidelity or uptime You're strong on AWS data engineering AWS is your primary cloud — you're confident across Glue, Lambda, Athena, S3, Redshift, RDS, Kinesis, MSK, and Step Functions You've built real-time or near-real-time pipelines using streaming frameworks — Kinesis Data Streams ...

Experience - essential - AWS Glue ETL - AWS Glue Data Quality - AWS Lambda - AWS Lake Formation - Medallion Architecture based ETL processes using S3, Iceberg and Athena - Azure DevOps/AWS CodeCommit/AWS CodePipeline - AWS Step functions - Athena SQL ; Spark SQL ; Python - AWS CLI - Release management (CI/CD) - Knowledge ...

design of solutions for data platform, ETL, integration and analysis solutions. Our toolset includes AWS hosted databases (postgres, S3 based data lake, MySQL, Athena), integration services (AWS API gateway, lambda functions), ETL services (AWS Glue, Step functions, AWS Batch), infrastructure a management tool such as Terraform and extensive … unstructured datasets. Excellent SQL experience on various platforms (SQL, PostgresSQL, PL/SQL etc) Experience of several of MySQL, Oracle, SQL, Postgres, RDS, Aurora, Athena or other similar large scale database technologies. Experience working with AI framework such as LangChain/LlamaIndex Experience with Vector databases (Pinecone, Weaviate, FAISS ...

Strong Power BI and/or Tableau skills Strong SQL skills and experience working with large datasets Experience with AWS services such as S3, Athena and DynamoDB Experience integrating multiple data sources for reporting and visualisation Strong stakeholder engagement and requirements-gathering skills The ability to work independently ...

experience in SQL-based data analysis across complex datasets Strong SQL skills Experience using Tableau or Power BI Experience with AWS services, ideally S3, Athena and DynamoDB Experience identifying data quality issues and supporting remediation activities Strong data validation and reconciliation experience Excellent stakeholder management and communication skills ...