Live Tables, PyTest, Great Expectations (or similar). Building and orchestrating data and analytical processing for streaming data with technologies such as Kafka, AWS Kinesis or Azure Stream Analytics. Building data solutions for embedded analytics and/or SaaS product platforms. Knowledge of data governance, privacy regulations (e.g. GDPR More ❯
an agile environment Solid grasp of data security, access control, and compliance principles Exposure to real-time or streaming systems such as Kafka or Kinesis Knowledge of ML infrastructure or working with data for predictive modelling Comfort with infrastructure automation tools like Terraform or Kubernetes If this role interests More ❯
an agile environment Solid grasp of data security, access control, and compliance principles Exposure to real-time or streaming systems such as Kafka or Kinesis Knowledge of ML infrastructure or working with data for predictive modelling Comfort with infrastructure automation tools like Terraform or Kubernetes If this role interests More ❯
of stakeholders. Desirable: Experience using Terraform and Github specifically for CI/CD. Experience with AWS Data Lakes including Lake Formation. Experience with AWS Kinesis/Firehose for real-time data pipelines. Experience of rail, airline or leisure industry. What you'll get: Free travel on LNER + More ❯
Gateshead, Tyne And Wear, United Kingdom Hybrid / WFH Options
SaleCycle
AWS managed services Maintaining and enhancing existing services written in Node, Java, and Kotlin Developing scalable, high-performance applications using AWS cloud technologies, including Kinesis for real-time data streaming Building and maintaining front-end applications using React (or similar frameworks) and TypeScript Writing clean, maintainable, and efficient code … in Golang for backend development Experience with AWS-managed services, particularly event-driven architectures, serverless, and real-time data processing (Lambda, SQS, SNS, DynamoDB, Kinesis, etc.) Strong understanding of RESTful microservice architectures Hands-on experience with React and TypeScript (or similar front-end frameworks) Familiar with git or other More ❯
AWS, GCP, Snowflake, Databricks) and Big Data processing (e.g., Apache Spark, Beam). Proficiency in key technologies like BigQuery, Redshift, Synapse, Pub/Sub, Kinesis, Event Hubs, Kafka, Dataflow, Airflow, and ADF. Strong ETL and data modeling skills. Proven ability to design and implement effective database solutions, ensure compliance More ❯
AWS, GCP, Snowflake, Databricks) and Big Data processing (e.g., Apache Spark, Beam). Proficiency in key technologies like BigQuery, Redshift, Synapse, Pub/Sub, Kinesis, Event Hubs, Kafka, Dataflow, Airflow, and ADF. Strong ETL and data modeling skills. Proven ability to design and implement effective database solutions, ensure compliance More ❯
in Databricks , Spark , Python , PySpark , and Delta Live Tables . Experience designing and delivering scalable data pipelines and streaming data processing (e.g., Kafka , AWS Kinesis , or Azure Stream Analytics ). Background in cloud environments such as AWS , Azure , or GCP . Familiarity with DevOps tools: Terraform , GitHub , CI/ More ❯
in Databricks , Spark , Python , PySpark , and Delta Live Tables . Experience designing and delivering scalable data pipelines and streaming data processing (e.g., Kafka , AWS Kinesis , or Azure Stream Analytics ). Background in cloud environments such as AWS , Azure , or GCP . Familiarity with DevOps tools: Terraform , GitHub , CI/ More ❯
code review). Big Data Eco-Systems, Cloudera/Hortonworks, AWS EMR, GCP DataProc or GCP Cloud Data Fusion. Streaming technologies and processing engines, Kinesis, Kafka, Pub/Sub and Spark Streaming. Experience of working with CI/CD technologies, Git, Jenkins, Spinnaker, GCP Cloud Build, Ansible etc. and More ❯
The data platform team ensures consistent, timely, and accurate data delivery to consumers, while maintaining scalable and efficient pipelines. Our stack consists of: AWS Kinesis Databricks DLT PowerBI/Fabric SQL Server On a day-to-day basis, you will: Develop and maintain new and existing data pipelines. Collaborate More ❯
Are you passionate about building cloud-native solutions and driving innovation through automation? Join a forward-thinking team within NS2 Mission where you'll play a key role in transforming and enhancing our DevOps infrastructure. We're looking for a More ❯
e.g., Airflow, dbt) Solid grasp of cloud platforms (AWS/GCP/Azure) and data warehouses (e.g., BigQuery, Snowflake) Familiarity with streaming technologies (Kafka, Kinesis, etc.) Passion for clean, maintainable code and robust data systems Previous experience in a fintech or regulated environment is a plus Benefits: Join a More ❯
london, south east england, United Kingdom Hybrid / WFH Options
Block MB
e.g., Airflow, dbt) Solid grasp of cloud platforms (AWS/GCP/Azure) and data warehouses (e.g., BigQuery, Snowflake) Familiarity with streaming technologies (Kafka, Kinesis, etc.) Passion for clean, maintainable code and robust data systems Previous experience in a fintech or regulated environment is a plus Benefits: Join a More ❯
pipeline to deliver high-velocity, production-ready systems This Role Requires: Strong Java skills Experience with live-streaming technologies such as Kafka, Flink or Kinesis Solid understanding of event-driven architecture Experience with CI/CD practices and tools Familiarity with microservices and modern cloud-based platforms Exposure to More ❯
Experience in communicating both written and verbally to clients and associates Desired qualifications/non-essential skills required: Azure Data Factory AWS Glue AWS Kinesis AWS Data Pipeline Data Governance Data Integration CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range More ❯
Security Detection Engineer, AWS Security Job ID: Amazon Data Services Ireland Limited Come and build innovative services that protect our cloud from advanced security threats! As a Security Engineer on our team, you'll help build and manage services that detect and automate the mitigation of cybersecurity threats across … Amazon's infrastructure, including advanced persistent threats. You'll work with data scientists, software development engineers, and other security engineers across multiple teams to develop innovative security solutions at a massive scale. Our services protect the AWS cloud for all customers and help preserve our customers' trust in us. … Develop detection prototypes for these security problems to enhance detection capabilities Identify opportunities to prevent security issues at scale About the team Diverse Experiences Amazon Security values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates More ❯
Containers). Integration Gateway: API Gateway (REST). Database and Storage: DynamoDB (NoSql), Aurora (Relational) and S3 (Object). Events and Messaging: Event Bridge, Kinesis Data Streams, Kinesis Firehouse, SQS and SNS. Additional Preferred Skills: Strong familiarity with the following AWS Service groupings: Identity & Security: IAM, KMS, Okta More ❯
Facilities Management, Research and Development, Science and Pharmaceutical Role: Professional Contract Type: Permanent Hours: Full Time DESCRIPTION Have you ever ordered a product on Amazon and when that box-with-the-smile arrives, you wonder how it got to you so fast? Ever wondered where it came from and … how much it cost Amazon? Wondered how Amazon designs its transportation network to scale and reliably deliver hundreds of millions of packages to customer's doorsteps? If so, Amazon's EU Fulfillment Optimization team is for you. We use mathematical models, business analytics, algorithm design and statistics … to improve decision-making capabilities across Operations and Amazon Logistics. Our objective is to create a reference for what the ideal transportation network looks like and build scalable audit mechanisms to assess and reduce the gap to the current network. We do so by treating system defects as gifts More ❯
Have you ever ordered a product on Amazon and when that box-with-the-smile arrives, you wonder how it got to you so fast? Ever wondered where it came from and how much it cost Amazon? Wondered how Amazon designs its transportation network to scale and … reliably deliver hundreds of millions of packages to customer's doorsteps? If so, Amazon's Trans Systems Analytics & Customer Experience (TSA & CX) team is for you. We use mathematical models, business analytics, algorithm design and statistics to improve decision-making capabilities across Operations and Amazon Logistics. Our objective … environment. - Experience diving into data to discover hidden patterns and conducting error/deviation analysis. - Experience with AWS services including S3, Redshift, Sagemaker, EMR, Kinesis, Lambda, and EC2. - Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high More ❯
Data Engineer II, Amazon Last Mile - Routing and Planning - DE As part of the Last Mile Science & Technology organization, you'll partner closely with Product Managers, Data Scientists, and Software Engineers to drive improvements in Amazon's Last Mile delivery network. You will leverage data and analytics to … scientist) with a track record of manipulating, processing, and extracting value from large datasets Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions Experience with non-relational databases/data stores (object storage, document or key-value stores, graph databases More ❯
Have you ever ordered a product from Amazon and been amazed at how fast it gets to you? Every day Amazon engineers are relentlessly working to decrease the time between Click to Deliver for your products. The Amazon Fulfillment Technologies (AFT) team owns all of the software … and infrastructure which powers Amazon's world-class fulfillment engine. Our team is building complex, massive data systems to capture data during every step in the automated pipeline and use that data to proactively predict efficiency and cost improvements to deliver the packages fast to our customers. As an … use it to deliver the data as service which will have an immediate influence on day-to-day decision-making at About the team Amazon Fulfillment Technologies (AFT) powers Amazon's global fulfillment network. We invent and deliver software, hardware, and data science solutions that orchestrate processes, robots More ❯
Security Engineer - Hardware, Firmware, Virtualization, Secure Hardware And Foundational Technologies Team Job ID: Amazon Development Centre (London) Limited At Amazon, security is central to maintaining customer trust and delivering delightful customer experiences. Our organization is responsible for creating and maintaining a high bar for security across all of … Amazon's products and services. Help us protect not only the Amazon Security (AmSec) cloud computing environment but all of our customers as well! Since 2006, our great team at AmSec has been enabling our customers to bring great ideas to life in ways that aren't possible … traditional IT environments. With AmSec you can flexibly harness compute, storage, security, and other services from across the globe as your business demands them. Amazon Security is working on security issues for a wide variety of platforms and technologies including cloud services, Internet of Things (IoT), identity and access More ❯
Development Engineers to build large-scale data intelligence systems? Are you interested to work in a team that positively impacts different key pillars of Amazon like Pricing, Promotions, Advertising, Auto inventory purchasing, Auto inventory removal, Inventory placement? Are you interested in working for a team that builds cool systems … work-life balance? Profit intelligence systems measure, predict true profit(/loss) for each item as a result of a specific shipment to an Amazon customer. Profit Intelligence is all about providing intelligent ways for Amazon to understand profitability across retail business. What are the hidden factors driving … Storage (Redshift Data Shares, S3 data lakes), Orchestration (Step Functions, Glue, and Internal Java Based Orchestration Tools), Processing (Spark & Flink - KDA), Streaming services (AWS Kinesis) and real-time large scale event aggregation stores. Build and scale our ingestion pipeline for scale, speed, reliability, and multi-tenancy. Read from a More ❯
Knowledge of distributed systems as it pertains to data storage and computing PREFERRED QUALIFICATIONS Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions Experience with non-relational databases/data stores (object storage, document or key-value stores, graph databases … please visit this link for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner. Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. More ❯