Birmingham, England, United Kingdom Hybrid / WFH Options
Xpertise Recruitment
machine learning models in production environments. AWS cloud services, especially in building and managing data pipelines and machine learning workflows: S3, Redshift, Lambda, Glue, EMR, EKS (Kubernetes) Familiarity with MLOps/DevOps concepts and practices, including version control, CI/CD, and model monitoring. Proficiency in Python and relevant more »
Newcastle Upon Tyne, England, United Kingdom Hybrid / WFH Options
Xpertise Recruitment
machine learning models in production environments. AWS cloud services, especially in building and managing data pipelines and machine learning workflows: S3, Redshift, Lambda, Glue, EMR, EKS (Kubernetes) Familiarity with MLOps/DevOps concepts and practices, including version control, CI/CD, and model monitoring. Proficiency in Python and relevant more »
to ingest, transform and load the datasets. Your Profile Key skills/knowledge/experience: Good understanding of AWS cloud data platform services: EC2, EMR, RDS, Redshift, Glue. Ability to work with object-oriented scripting languages: Python, Pyspark. Knowledge of data pipeline and workflow management and their tools such more »
Chicago, Illinois, United States Hybrid / WFH Options
Request Technology - Robyn Honquest
AWS CLI and IAM etc. (required) Experience with distributed message brokers using Kafka (required) Experience with high speed distributed computing frameworks such as AWS EMR, Hadoop, HDFS, S3, MapReduce, Apache Spark, Apache Hive, Kafka Streams, Apache Flink etc. (required) Experience working with various types of databases like Relational, NoSQL more »
Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience more »
Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience more »
Greater London, England, United Kingdom Hybrid / WFH Options
CommuniTech Recruitment Group
Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience more »
Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience more »
AWS CLI and IAM etc. (required) Experience with distributed message brokers using Kafka (required) Experience with high speed distributed computing frameworks such as AWS EMR, Hadoop, HDFS, S3, MapReduce, Apache Spark, Apache Hive, Kafka Streams, Apache Flink etc. (required) Working knowledge of DevOps tools. Eg Terraform, Ansible, Jenkins, Kubernetes more »
AWS CLI and IAM etc. (required) Experience with distributed message brokers using Kafka (required) Experience with high speed distributed computing frameworks such as AWS EMR, Hadoop, HDFS, S3, MapReduce, Apache Spark, Apache Hive, Kafka Streams, Apache Flink etc. (required) Working knowledge of DevOps tools. Eg Terraform, Ansible, Jenkins, Kubernetes more »
have an understanding of Data modelling Principles & best practices and also needs prior experience leading a data engineering team. Key Tech: - AWS (S3, Glue, EMR, Athena, Lambda) - Snowflake, Redshift - DBT (Data Build Tool) - Programming: Python, Scala, Spark, PySpark or Ab Initio - Data pipeline orchestration (Apache Airflow) - Knowledge of SQL more »
onto the cloud platforms, one of the key strategies for the division in which you’ll get exposure to technologies like AWS S3, Snowflake, EMR etc. These are great roles playing a role on some really big interesting projects. more »
Proven familiarity with NLP approaches like Word2Vec or BERT, including identifying the right KPIs and objective functions. Experience working with big data systems (Spark, EMR, Kafka, S3, Airflow) and programming languages (Java, Scala, or Python). Experience building in-production Machine Learning systems Good understanding of system architecture, including more »
of Database development experience and a background in an OO language. This role offers the chance to gain exposure in the following technology AWS EMR, Redshift, Kafka Angular/Java (making changes to reflect changes in the data warehouse) By applying to this job you are sending us your more »
Bristol, England, United Kingdom Hybrid / WFH Options
Aviva
Spark (e.g., PySpark, Spark tuning, Spark UI); Data Engineering technologies and principles (e.g., Data Lakes, Batch/Streaming); Cloud technologies and principles (e.g., Kubernetes, EMR, S3) Understanding of ML principles (e.g., feature engineering, training/testing, hyperparameters, deep learning, model management) Agile mindset and experience with JIRA and Confluence more »
across a wide range of AWS services with the ability to demonstrate working on large engagements * Experience of AWS tools (e.g. Athena, Redshift, Glue, EMR) * Java, Scala, Python, Spark, SQL * Experience of developing enterprise grade ETL/ELT data pipelines. * Deep understanding of data manipulation/wrangling techniques * Demonstrable … applying Data Engineering best practices (coding practices to DS, unit testing, version control, code review). * Big Data Eco-Systems, Cloudera/Hortonworks, AWS EMR, GCP DataProc or GCP Cloud Data Fusion. * NoSQL Databases. Dynamo DB/Neo4j/Elastic, Google Cloud Datastore. * Snowflake Data Warehouse/Platform * Streaming more »
role, you'll spearhead backend and data engineering and mentor team members. Tech stack: Athena; Python, Flask, Redis, Postgres, React, Plotly, Docker, SQL, Athena & EMR Spark, ECS and Temporal. This is a 60/40 split between tech and leadership. Your background: 8 years+ coding experience, 4+ years Python more »
London - 3x a week Length: Initial 6 months Contract, Inside IR35 Delivery of AWS-based data & analytics capabilities, built on foundational services such as EMR, Glue, MWAA, Dynamo, Kinesis, Kafka and Sagemaker AWS Cloud Data Platforms Architecture and AWS Cloud Security & Infrastructure Insurance or Regulated Financial Services Industries Solutioning more »
Greater London, England, United Kingdom Hybrid / WFH Options
Humand Talent
8+ with experience in Laravel/Symfony desired. JavaScript/TypeScript proficiency with NodeJS and React.JS. Familiarity with AWS Services (Aurora, MSK Kafka, ECS, EMR). 3+ years of database experience, ideally with MySQL. Hands-on experience with various data storage paradigms (e.g., RDMS + Document + KV Stores more »
similar). Experience using modern build tools such as Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL and data modeling Experience with building large-scale more »
similar). Experience using modern build tools such as Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL and data modeling Experience with building large-scale more »
PHP 8+ Experience with Laravel/Symfony framework Strong grasp of JavaScript/TypeScript Familiarity with AWS services including Aurora, MSK Kafka, ECS, and EMR Solid understanding of SQL Key Responsibilities: Collaborate with a talented team to conceptualise, develop, and deploy scalable web applications Write clean, efficient, and maintainable more »
Have you ever ordered a product on Amazon and when that box with the smile arrived you wondered how it got to you so fast? Have you wondered where it came from and how much it cost Amazon to deliver it to you? If so, the … operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets - Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce more »
strong emphasis on Java and EMR. Implement and optimise data models and algorithms to extract valuable insights from large datasets. Utilise AWS services, including EMR, Glue, and Iceberg, for data storage, processing, and ingestion. Ensure data quality and integrity by implementing robust validation and monitoring processes. Collaborate with cross … engineering, with a focus on managing and processing financial data. Proficiency in Python and Java, with a strong preference for Java, and experience with EMR for data processing. Solid understanding of data modelling concepts and experience with relevant modelling languages. Hands-on experience with AWS services, including but not … limited to EMR, Glue, and S3. Prior experience with Iceberg for data storage and Glue for data ingestion is highly desirable. Strong SQL skills and experience with relational databases. Proven track record of delivering high-quality data solutions in a fast-paced environment. Excellent communication and collaboration skills, with more »