Central London, London, United Kingdom Hybrid / WFH Options
167 Solutions Ltd
and lakehouse solutions for analytics, reporting, and machine learning. Implement ETL/ELT processes using tools such as Apache Airflow, AWS Glue, and Amazon Athena . Work with cloud-native technologies to support scalable, serverless architectures. Collaborate with data science teams to streamline feature engineering and model deployment. More ❯
DESIRED QUALIFICATIONS AWS Certification: Solutions Architect Professional or equivalent Demonstrated experience with cloud technologies used with ETL and big data pipelines such as Glue, EMR, HIVE, Spark, S3, SQS, and SNS Demonstrated experience with Kubernetes or EKS Demonstrated experience using the AWS CDK More ❯
skills You have experience with big data frameworks and tools including Spark You have a good knowledge of AWS data services (e.g. S3, Redshift, EMR, Glue) You have strong analytical, problem solving and critical thinking skills You have excellent communication skills and experience of working across teams What's More ❯
South East London, London, United Kingdom Hybrid / WFH Options
Client Server
skills You have experience with big data frameworks and tools including Spark You have a good knowledge of AWS data services (e.g. S3, Redshift, EMR, Glue) You have strong analytical, problem solving and critical thinking skills You have excellent communication skills and experience of working across teams What's More ❯
london, south east england, United Kingdom Hybrid / WFH Options
Client Server
skills You have experience with big data frameworks and tools including Spark You have a good knowledge of AWS data services (e.g. S3, Redshift, EMR, Glue) You have strong analytical, problem solving and critical thinking skills You have excellent communication skills and experience of working across teams What's More ❯
6+ years of software development experience with secure coding practices. Programming Languages: Java, Scala, Python. Big Data Technologies: Spark, Scala. AWS Services: Experience with EMR, Apache Airflow, Lambda, Glue, ECS; support for existing production applications. Additional Information We celebrate our people and focus on DEI, work/life balance More ❯
Preferred Qualifications: Domain knowledge in Financial Industry and Capital Markets is a plus. Working knowledge in AWS cloud (EC2, ECS, Load Balancer, Security Group, EMR, Lambda, S3, Glue, etc.). Experience in DevOps development and deployment using Docker and containers. Python experience is a plus. About S&P Global More ❯
Kafka and Kinesis DataHub ML Flow and Airflow Docker and Terraform Kafka, Spark, Kafka Streams and KSQL DBT AWS, S3, Iceberg, Parquet, Glue and EMR for our Data Lake Elasticsearch and DynamoDB More information: Enjoy fantastic perks like private healthcare & dental insurance, a generous work from abroad policy More ❯
Chantilly, Virginia, United States Hybrid / WFH Options
The DarkStar Group
ETL mappings, code use guide, code location and access instructions. Design and optimize Data Pipelines using tools such as Spark, Apache Iceberg, Trino, OpenSearch, EMR cloud services, NiFi and Kubernetes containers Ensure the pedigree and provenance of the data is maintained such that the access to data is protected More ❯
Herndon, Virginia, United States Hybrid / WFH Options
The DarkStar Group
ETL mappings, code use guide, code location and access instructions. Design and optimize Data Pipelines using tools such as Spark, Apache Iceberg, Trino, OpenSearch, EMR cloud services, NiFi and Kubernetes containers Ensure the pedigree and provenance of the data is maintained such that the access to data is protected More ❯
personnel. (Mandatory) Demonstrated experience with AWS cloud services, including long-term storage options, and cloud-based database services such as Databricks or ElasticMapReduce (EMR). (Mandatory) Demonstrated experience with SQL database structures and mapping between SQL databases. (Mandatory) Demonstrated experience in large-scale data migration efforts. (Mandatory) Demonstrated More ❯
HBase, MapReduce, and Spark. ETL processes u?lizing Linux shell scrip?ng, Perl, Python, and Apache Airflow. AWS services such as CloudWatch, CloudTrail, ELB, EMR, KMS, SQS, SNS, and Systems Manager. Experience in suppor?ng, maintaining, and migra?ng JavaFX applica?ons to modern cloud-na?ve solu?ons. More ❯
HBase, MapReduce, and Spark. ETL processes u?lizing Linux shell scrip?ng, Perl, Python, and Apache Airflow. AWS services such as CloudWatch, CloudTrail, ELB, EMR, KMS, SQS, SNS, and Systems Manager. Experience in suppor?ng, maintaining, and migra?ng JavaFX applica?ons to modern cloud-na?ve solu?ons. More ❯
preferred; other languages include Java, Scala, TypeScript, C++, C#). Experience using big data technologies in cloud environments to build data pipelines (e.g. Spark, EMR, Lambda, etc.). Excellent communication, organization, and prioritization skills, with a strong ability to deliver results within tight timelines. Passionate about working with small More ❯
NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with AWS cloud services: EC2, EMR, RDS, Redshift. Experience with stream-processing systems: Storm, Spark-Streaming, etc. Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala More ❯
with other languages including Java, Scala, TypeScript, C++, C#). Experience using big data technologies in cloud environments to build data pipelines (e.g. Spark, EMR, Lambda etc.). Excellent communication, organisation and prioritisation skills, and have a strong ability to deliver results within tight timelines. Passionate to work with More ❯
Basic Knowledge of User Interface design & development using Angular, React, HTML5, XML & CSS Working knowledge in AWS cloud (EC2, ECS, Load Balancer, Security Group, EMR, Lambda, S3, Glue, etc.) Experience in DevOps development and deployment using docker and containers. Domain knowledge in Financial Industry and Capital Markets is a More ❯
Basic Knowledge of User Interface design & development using Angular, React, HTML5, XML & CSS Working knowledge in AWS cloud (EC2, ECS, Load Balancer, Security Group, EMR, Lambda, S3, Glue, etc.) Experience in DevOps development and deployment using docker and containers. Domain knowledge in Financial Industry and Capital Markets is a More ❯
use AWS services such as AmazonElastic Compute Cloud (EC2), S3, AWS Glue, DynamoDB NoSQL, Relational Database Service (RDS), Elastic Map Reduce (EMR) and Amazon Redshift. Solutions: Deliver on-site technical engagements with partners and customers. This includes participating in pre-sales on-site visits … is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying. Why AWS? Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating - that's … in working with data lakes, modern data architectures, Lambda type architectures Proficiency in writing and optimizing SQL Knowledge of AWS services including S3, Redshift, EMR, Kinesis and RDS Experience with Open Source Data Technologies (Hadoop, Hive, Hbase, Pig, Spark, etc.) Ability to write code in Python, Ruby, Scala or More ❯
2. (Mandatory) Demonstrated experience with AWS cloud services, including long-term storage options, and cloud-based database services such as Databricks or ElasticMapReduce (EMR). 3. (Mandatory) Demonstrated experience with SQL database structures and mapping between SQL databases. 4. (Mandatory) Demonstrated experience in large-scale data migration efforts. More ❯
2. (Mandatory) Demonstrated experience with AWS cloud services, including long-term storage options, and cloud-based database services such as Databricks or ElasticMapReduce (EMR). 3. (Mandatory) Demonstrated experience with SQL database structures and mapping between SQL databases. 4. (Mandatory) Demonstrated experience in large-scale data migration efforts. More ❯
of an Agile engineering or development team. Strong hands-on experience and understanding of working in a cloud environment such as AWS. Experience with EMR (Elastic Map Reduce), Spark. Strong experience with CI/CD pipelines with Jenkins. Experience with the following technologies: SpringBoot, Gradle, Terraform, Ansible, GitHub/ More ❯
