wrangling, visualization, and reporting. Specialised in AWS cloud technologies for ETL, data warehouse, and data lake design. Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. Capable of processing large volumes of structured and unstructured data on AWS. Familiarity with AWS best practices in data more »
South East London, England, United Kingdom Hybrid / WFH Options
Maclean Moore
in orchestrating data pipelines using Apache AirflowProficiency in Git based version control toolsProficiency with Linux commands and Bash ScriptingWorking experience in AWS Bigdata services (EMR, Glue, Data Pipelines, Athena, S3, Step Functions etc.) & AWS CLIExperience with CI/CD tools such as JenkinsExperience working with relational and/or more »
as Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT.Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.),Experience on RDBMS like PostgreSQL would be a plus.Experience building more »
native distributed PyTorch/Tensorflow, Spark-based distributor libraries, or Horovod.TECH STACK:Python, Flask, Redis, Postgres, React, Plotly, Docker. Temporal; AWS Athena SQL, Athena & EMR Spark, ECS Fargate; Azure Synapse/Data Lake Analytics, HDInsight.KEY RESPONSIBILITIESLead the productionisation of Monolith’s ML models and data processing pipelines, both mid more »
South East London, London, United Kingdom Hybrid / WFH Options
Stepstone UK
English Bachelor's degree in Computer Science or a related field (Master's degree preferred) Nice to have: experience with LLMs, Vector Databases, AWS EMR, Spark, and Python Our commitment: Equal opportunities are important to us. We believe that diversity and inclusion at The Stepstone Group are critical to more »
similar). Experience using modern build tools such as Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL and data modeling Experience with building large-scale more »
Watford, England, United Kingdom Hybrid / WFH Options
Noir
PHP 8+ Experience with Laravel/Symfony framework Strong grasp of JavaScript/TypeScript Familiarity with AWS services including Aurora, MSK Kafka, ECS, and EMR Solid understanding of SQL Key Responsibilities: Collaborate with a talented team to conceptualise, develop, and deploy scalable web applications Write clean, efficient, and maintainable more »
with a strong emphasis on Java and EMR.Implement and optimise data models and algorithms to extract valuable insights from large datasets.Utilise AWS services, including EMR, Glue, and Iceberg, for data storage, processing, and ingestion.Ensure data quality and integrity by implementing robust validation and monitoring processes.Collaborate with cross-functional teams … data engineering, with a focus on managing and processing financial data.Proficiency in Python and Java, with a strong preference for Java, and experience with EMR for data processing.Solid understanding of data modelling concepts and experience with relevant modelling languages.Hands-on experience with AWS services, including but not limited to … EMR, Glue, and S3.Prior experience with Iceberg for data storage and Glue for data ingestion is highly desirable.Strong SQL skills and experience with relational databases.Proven track record of delivering high-quality data solutions in a fast-paced environment.Excellent communication and collaboration skills, with the ability to work effectively in more »
Job DescriptionSenior Data EngineerHybrid - London £70,000 - £80,000We're currently partnered with a leading technology-driven company specialising in digital solutions that enhance user experience across various platforms. With over 15,000 5-star reviews and partnerships with companies more »
South East London, England, United Kingdom Hybrid / WFH Options
Durlston Partners
a massively distributed cloud-hosted data platform that would be used by the entire firm.Tech Stack: Python/Java, Dremio, Snowflake, Iceberg, PySpark, Glue, EMR, dbt and Airflow/Dagster.Cloud: AWS, Lambdas, ECS servicesThis role would focus on various areas of Data Engineering including:End to End ETL pipeline … quality tooling.Requirements:Strong Python/Java Software Engineering skillsExcellent AWS knowledge, ideally with exposure to Airflow, Glue, Iceberg and SnowflakePrevious experience with Dremio, dbt, EMR or DagsterGood Computer Science fundamentals knowledge with strong knowledge of software and data architecture.If you would like more information on the above, please apply more »
