for the clients product Optimize data storage and retrieval processes to enhance system performance and scalability. AWS: Utilize AWS services (S3, Redshift, EMR, Lambda, Kinesis) to build and manage scalable data infrastructure. Implement best practices for security, monitoring, and cost management within the AWS ecosystem. Collaborate with DevOps teams more »
for the clients product Optimize data storage and retrieval processes to enhance system performance and scalability. AWS: Utilize AWS services (S3, Redshift, EMR, Lambda, Kinesis) to build and manage scalable data infrastructure. Implement best practices for security, monitoring, and cost management within the AWS ecosystem. Collaborate with DevOps teams more »
build, and maintain large scale data solutions and applications using AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. Your team members will look to you as a trusted expert and will expect you to define the end-to-end software more »
driven serverless architectures using AWS services such as Lambda, S3, Step Functions, API Gateway, DynamoDB, and EventBridge Familiarity with streaming technologies, such as AWS Kinesis or Kafka Familiarity with search engines like Elasticsearch or OpenSearch Familiar with Infrastructure as code tools, such as, Terraform, AWS CDK, Cloudformation, etc. #LI more »
optimisation Be an advocate of infrastructure as code (IAC) and cloud best practices Excellent familiarity of AWS services such as S3, Lambda, Glue, Aurora, Kinesis Experience with containerisation and orchestration (Docker, K8, Helm) Familiarity with different approaches to ETL processes, both in an out of AWS Experience managing and more »
Employment Type: Permanent
Salary: £65000 - £75000/annum (plus company benefits & bonuses)
and apply that knowledge. Desirable skills: Familiarity with containerisation and Kubernetes. Practical production knowledge of service-oriented architectures. Experience with streaming technologies (e.g., AWS Kinesis, Kafka, etc.). What we offer: This is a secure role in a highly impressive business with a great track record. In this market more »
Belfast, Northern Ireland, United Kingdom Hybrid / WFH Options
Abacus Professional Recruitment
and scrum methodologies Advanced ETL tool or solution development Preferred: Knowledge of data processing frameworks for example (but not limited to) Apache Kafka, AWS Kinesis or Spark Knowledge of scheduling tools for example (but not limited to) Airflow, Oozie etc. 1+ years experience with Hadoop 1+ years experience with more »
with Agile and Scrum methodologies. Advanced ETL tool or solution development skills. Preferred Qualifications: Knowledge of data processing frameworks such as Apache Kafka, AWS Kinesis, or Spark. Familiarity with scheduling tools like Airflow or Oozie. 1+ years experience with Hadoop. 1+ years experience with Python. Experience using APIs to more »
of using AWS (or other public cloud) to migrate, store, query, transform and present data, AWS Glue, Data Brew, Athena, Step Functions, Sage Maker, Kinesis, MSK, EMR, LakeFormation, etc. Extensive experience of MS SQL Server, PostGreSQL, Oracle and other SQL databases Solid understanding of data engineering tools to help more »
managing regional SRE/DevOps teams. Flexible as there will be need of working in odd hours and weekends. AWS hands on (primarily Glue, Kinesis, EC2/ECS, Lambda, DynamoDB, Cloud-watch) Managing local team and stakeholders, Driving and resolving production issues, Managing problems and changes, writing pipelines and more »
South West London, London, United Kingdom Hybrid / WFH Options
Xcede UK
Big Data Engineer - Fully Remote in Africa/EU As a Big Data Engineer you will have a strong understanding of big data technologies with an exceptional ability to code. You'll be providing technical leadership, working closely with the more »
