services (Apache Spark, Beam or equivalent). • In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. • Excellent consulting experience and ability to design and build solutions, actively contribute more »
reporting. • Specialised in AWS cloud technologies for ETL, data warehouse, and data lake design. • Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. • Capable of processing large volumes of structured and unstructured data on AWS. • Familiarity with AWS best practices in data engineering, data science more »
Greater London, England, United Kingdom Hybrid / WFH Options
Anson McCade
Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Proficiency more »
Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Proficiency more »
operates at peak performance, scalability, and reliability. Technical Skills required: RedShift Glue (inc. Glue Studio, Glue Data Quality, Glue DataBrew) Step Functions Athena Lambda Kinesis Python, Spark, Pyspark, SQL Your contributions as a Data Engineer will directly impact the organization's operations and revenue. In addition to a competitive more »
and Snowflake. Experience with various programming languages, such as Python and Java. Familiarity with streaming/event-driven architecture, including tools like Kafka and Kinesis/Firehose. Expertise in data ingestion techniques, encompassing both stream and batch processing. Proficiency using tools like Terraform for Infrastructure-as-Code and AWS more »
similar regulated environment. Technologies they use: Cloud: AWS with a preference for native and serverless services (e.g., API Gateway, AWS Lambda, AWS Step Functions, Kinesis, DynamoDB) Programming languages: Python for software engineering, Terraform, AWS SAM, and Cloud Formation for IaC Database: SQL (Postgres) and NoSQL (DynamoDB) APIs: Primarily RESTful …/CD: GitHub Actions, AWS CodePipeline, Jenkins, and tools such as Trivy, Bandit, Sonarqube, Dependabot, etc. Big data: AWS services like S3, Redshift, Glue, Kinesis The role is mostly remote but there is a requirement to head to either their London or North office once a week (some weeks more »
Implement Data Solutions: Develop scalable and efficient data architecture solutions on AWS. Create and maintain data pipelines using AWS services such as Glue, Lambda, Kinesis, and Data Pipeline. Design data models and databases using AWS RDS, Redshift, DynamoDB, and other relevant technologies. Data Integration and Management: Integrate various data … Information Technology, or a related field. Master’s degree preferred. Technical Expertise: Proven experience with AWS data services including S3, Redshift, RDS, Glue, Lambda, Kinesis, and Athena. Strong understanding of data modeling, ETL processes, and data warehousing. Proficiency in SQL and experience with database management systems. Familiarity with data more »
Data Architect will design and implement solutions using a range of AWS infrastructure, including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, RDS, Athena, Kinesis, Quicksight. We also widely use other tech such as Snowflake, DBT, Databricks, Informatica, Matillion, Airflow, Tableau, Power BI etc. The Lead Data Architect will … aligned to the functional and non-functional requirements Work closely with other members of agile deployment team Selection & configuration of appropriate, base technologies (eg Amazon Redshift, RDS) Selection & application of appropriate standards & principles Capture & implementation of functional & non-functional requirements Expert in data modelling and latest data trends including more »
Grabyo is the video platform built for live, social and mobile. The amazon web services hosted platform removes the traditional complexities of professional video production and distribution. Grabyo is trusted by major sports teams, federations and broadcasters such as ITV, the Premier League and UFC to name only a … the team architecting our platform to improve our path to microservices. Java, JavaScript, Go, NoSQL, serverless architectures, microservices, auto-scaling and auto-recovery, AWS Kinesis, ECS Fargate, DynamoDB, media processing, Terraform - these are a few of the state-of-the-art techs you will be working with. To make more »
London, England, United Kingdom Hybrid / WFH Options
Jobleads-UK
requirements are well understood and stakeholders have accurate expectations on dates and functionality Requirements Experience building a data platform with streaming tech (Pulsar, Kafka, Kinesis) Design, build and launch highly available and distributed systems data extraction, transformation and loading of datasets Excellent communication and leadership skills. Including the ability … custom data frameworks and platforms Agile and Continuous Delivery Continuous integration pipelines Strong Python AWS or Azure with large-scale streaming data (Pulsar, Kafka, Kinesis, etc) ETL management; structured or custom (Airflow, Luigi, etc) Bonus Robust experience managing and developing an engineering team Delta lake or Iceberg Trino or more »
Technical Skills Architecture & Design Enterprise Architecture and good knowledge of object-oriented programming and design patterns AWS services: API gateway, Lambda, SNS, SQS, DynamoDB, Kinesis, EC2, Athena, Elastic Beanstalk REST API Design and specification using Swagger/OpenAPI Programming Experience of both functional programming and object-orientated programming Excellent … and building R/Python-based REST APIs, and API specifications using Swagger/OpenAP Functional programming and object-orientated programming AWS services (including Kinesis, ECR, Lambdas, SageMaker and DynamoDb) or other cloud services Sound understanding of risk and risk mitigation design in relevant areas, including (but not limited more »
features across their estate of cloud native software products and services. The DevOps Engineer will have deep knowledge of the AWS data engineering stack: Kinesis, Redshift, Glue, EMR and be passionate about writing high-quality code that not only solves problems but improves the overall estate. The role will … organisation going forward. Required DevOps Engineer experience. AWS skills. Docker, Kubernetes skills. knowledge across the AWS data engineering stack including but not limited to: Kinesis, Redshift, Glue, EMR, Databricks. of the software development lifecycle and the role DevOps plays within it. working in autonomous agile teams and environments. to more »
