Job ID: Amazon Web Services Australia Pty Ltd Are you a Senior Data Analytics and GenAI consulting specialist? Do you have real-time Data Analytics, Data Warehousing, Big Data, Modern Data Strategy, Data Lake, Data Engineering and GenAI experience? Do you have senior stakeholder engagement experience to support pre-sales and deliver consulting engagements? Do you like to … learn and use services such as AWS Glue, Amazon S3, Amazon DynamoDB, Amazon Relational Database Service (RDS), AmazonElastic Map Reduce (EMR), Amazon Kinesis, Amazon Redshift, Amazon Athena, AWS Lake Formation, Amazon DataZone, Amazon SageMaker, Amazon Quicksight and Amazon … to apply. If your career is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying. Why AWS? Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating - that's why customers from the most More ❯
Sunbury-On-Thames, London, United Kingdom Hybrid / WFH Options
BP Energy
PySpark for data processing and automation. Strong command of SQL for data querying, transformation, and performance tuning. Deep experience with cloud platforms , preferably AWS (e.g., S3, Glue, Redshift, Athena, EMR, Lambda). Experience with Azure or GCP is a plus. Experience building and managing data lakes and data warehouses. Strong understanding of distributed systems and big data processing. Experience More ❯
sunbury, south east england, united kingdom Hybrid / WFH Options
BP Energy
PySpark for data processing and automation. Strong command of SQL for data querying, transformation, and performance tuning. Deep experience with cloud platforms , preferably AWS (e.g., S3, Glue, Redshift, Athena, EMR, Lambda). Experience with Azure or GCP is a plus. Experience building and managing data lakes and data warehouses. Strong understanding of distributed systems and big data processing. Experience More ❯
guildford, south east england, united kingdom Hybrid / WFH Options
BP Energy
PySpark for data processing and automation. Strong command of SQL for data querying, transformation, and performance tuning. Deep experience with cloud platforms , preferably AWS (e.g., S3, Glue, Redshift, Athena, EMR, Lambda). Experience with Azure or GCP is a plus. Experience building and managing data lakes and data warehouses. Strong understanding of distributed systems and big data processing. Experience More ❯
data processing) Apache Spark Streaming, Kafka or similar (for real-time data streaming) Experience using data tools in at least one cloud service - AWS, Azure or GCP (e.g. S3, EMR, Redshift, Glue, Azure Data Factory, Databricks, BigQuery, Dataflow, Dataproc) Would you like to join us as we work hard, have fun and make history? Apply for this job indicates More ❯
Responsibilities Proven experience as a Data Architect or Lead Data Engineer in AWS environments Deep understanding of cloud-native data services: S3, Redshift, Glue, Athena, EMR, Kinesis, Lambda Strong hands-on expertise in data modelling, distributed systems, and pipeline orchestration (Airflow, Step Functions) Background in energy, trading, or financial markets is a strong plus Excellent knowledge of Python, SQL More ❯
Proven experience as a Data Architect or Lead Data Engineer in AWS environments* Deep understanding of cloud-native data services: S3, Redshift, Glue, Athena, EMR, Kinesis, Lambda* Strong hands-on expertise in data modelling, distributed systems, and pipeline orchestration (Airflow, Step Functions)* Background in energy, trading, or financial markets is a strong plus* Excellent knowledge of Python, SQL, and More ❯
the following: Python, SQL, Java Commercial experience in client-facing projects is a plus, especially within multi-disciplinary teams Deep knowledge of database technologies: Distributed systems (e.g., Spark, Hadoop, EMR) RDBMS (e.g., SQL Server, Oracle, PostgreSQL, MySQL) NoSQL (e.g., MongoDB, Cassandra, DynamoDB, Neo4j) Solid understanding of software engineering best practices - code reviews, testing frameworks, CI/CD, and code More ❯
Secret clearance Bachelor's degree Nice If You Have: Experience deploying analytics workloads on a platform as a service ( PaaS ) and sof tware as a service ( SaaS ) , including AWS EMR, Redshift, SageMaker, Databricks, SQL Data Warehouse, or machine learning service Experience with distributed or parallel programming frameworks, including Apache Spark or NVIDIA CUDA Experience with infrastructure as code frameworks More ❯
in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB . Essential requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in More ❯
Manchester, Lancashire, England, United Kingdom Hybrid / WFH Options
Lorien
junior engineers and sharing best practices Staying ahead of the curve with emerging data technologies What You'll Bring: Solid hands-on experience with AWS (Glue, Lambda, S3, Redshift, EMR) Strong Python, SQL, and PySpark skills Deep understanding of data warehousing and lakehouse concepts Problem-solving mindset with a focus on performance and scalability Excellent communication skills across technical More ❯
Shell scripting Experience with a public cloud, including AWS, Micro sof t Azure, or Google Cloud Experience with distributed data or computing tools, including Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka Experience working on real-time data and streaming applications Experience with NoSQL implementation, including MongoDB or Cassandra Experience with data warehousing using AWS Redshift, MySQL, or Snowflake More ❯
Scala Experience with a public cloud, including AWS, Micro sof t Azure, or Google Cloud Experience with distributed data or computing tools such as Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka Experience working on real-time data and streaming applications Experience with NoSQL implementation using MongoDB or Cassandra Experience with data warehousing, including AWS Redshift, MySQL, or Snowflake More ❯
Shell scripting Experience with a public cloud, including AWS, Micro sof t Azure, or Google Cloud Experience with distributed data or computing tools, including Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka Experience working on real-time data and streaming applications Experience with NoSQL implementation, including MongoDB or Cassandra Experience with data warehousing using AWS Redshift, MySQL, or Snowflake More ❯
Hadoop. Solid understanding of data governance principles, data modeling, data cataloging, and metadata management. Hands-on experience with cloud platforms like AWS or Azure, including relevant services like S3, EMR, Glue, Data Factory, etc. Proficiency in SQL and one or more programming languages (Python, Scala, or Java) for data manipulation and transformation. Knowledge of data security and privacy best More ❯
Overview The Amazon Web Services Professional Services (ProServe) team is seeking a skilled Delivery Consultant to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS solutions that meet their technical requirements and business objectives. You'll be a key player in … and scalable AI solutions for business problems Interact with customers directly to understand the business problem, assist in the implementation of their ML ecosystem Leverage Foundation Models on Amazon Bedrock and Amazon SageMaker to meet performance needs Analyze large historical data to automate and optimize key processes Communicate clearly with attention to detail, translating rigorous mathematical … compelling customer proposals and present to executives; proficient English communication in technical and business settings Preferred Qualifications Experience with AWS services (Amazon SageMaker, Amazon Bedrock, EMR, S3, EC2); AWS Certification (Solutions Architect Associate, ML Engineer Associate) preferred Knowledge of AI/ML, generative AI; hands-on prompt engineering and deploying hosting Large Foundational Models Experience More ❯
Scala Experience with a public cloud, including AWS, Micro sof t Azure, or Google Cloud Experience with distributed data or computing tools such as Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka Experience working on real-time data and streaming applications Experience with NoSQL implementation using MongoDB or Cassandra Experience with data warehousing, including AWS Redshift, MySQL, or Snowflake More ❯
Chantilly, Virginia, United States Hybrid / WFH Options
The DarkStar Group
documentation for each project including ETL mappings, code use guide, code location and access instructions. Design and optimize Data Pipelines using tools such as Spark, Apache Iceberg, Trino, OpenSearch, EMR cloud services, NiFi and Kubernetes containers Ensure the pedigree and provenance of the data is maintained such that the access to data is protected Clean and preprocess data to More ❯
Herndon, Virginia, United States Hybrid / WFH Options
The DarkStar Group
documentation for each project including ETL mappings, code use guide, code location and access instructions. Design and optimize Data Pipelines using tools such as Spark, Apache Iceberg, Trino, OpenSearch, EMR cloud services, NiFi and Kubernetes containers Ensure the pedigree and provenance of the data is maintained such that the access to data is protected Clean and preprocess data to More ❯
data pipelines and services • Ingest, transform, and model structured and unstructured data for analytics and ML • Work with technologies like Apache Spark, Apache Iceberg, Trino, NiFi, OpenSearch, and AWS EMR • Ensure data integrity, lineage, and security across the entire lifecycle • Collaborate with DevOps to deploy containerized data solutions using Kubernetes • Support Agile delivery, version control, and data governance activities More ❯
solutions for highly sensitive system DESIRED QUALIFICATIONS AWS Certification: Solutions Architect Professional or equivalent Demonstrated experience with cloud technologies used with ETL and big data pipelines such as Glue, EMR, HIVE, Spark, S3, SQS, and SNS Demonstrated experience with Kubernetes or EKS Demonstrated experience using the AWS CDK A candidate must be a US Citizen and requires an active More ❯
Arlington, Virginia, United States Hybrid / WFH Options
CGI
with using the Joint Enterprise Modeling and Analytics (JEMA) framework or Apache NiFi to develop data processing workflows • Experience in AWS services including but not limited to Sagemaker, S3, EMR, and IAM. CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various More ❯
J2ee (Spring, Hibernate, MVC) Experience working on Microservices. Good experience on AWS Cloud, MSK, Kinesis, Lamda Good hands-on experience on AWS Glue using Apache Spark, AmazonEMR Good experience on container orchestration system like Kubernetes, ECS Good working knowledge in SPRING Framework & Spring Boot Good experience in Kafka and other messaging systems like RabbitMQ Hands on More ❯
Engineer role Required Skills: Experience with big data tools: Hadoop, Spark, etc. Experience with relational SQL and NoSQL databases, including Postgres Experience with AWS cloud or remote services: EC2, EMR, RDS, Redshift Experience with stream-processing systems: Kafka, Storm, Spark-Streaming, etc. Experience with object-oriented/object function scripting languages: Python, Julia, Java, C++, Scala, etc. Experience with More ❯
Milton Keynes, Buckinghamshire, South East, United Kingdom
Upbeat Ideas UK Ltd
and ensure consistency across various data sources. Document test results and provide detailed reports on data quality findings. Required Skills and Experience: Proven experience with AWS services such as EMR, Lambda, Redshift, Firehose, S3, Iceberg, Athena, and DynamoDB. Strong understanding of data ingestion, parsing, aggregation, and schema validation processes. Proficiency in SQL for data querying and validation. Experience with More ❯