wrangling, visualization, and reporting. • Specialised in AWS cloud technologies for ETL, data warehouse, and data lake design. • Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. • Capable of processing large volumes of structured and unstructured data on AWS. • Familiarity with AWS best practices in data more »
Greater London, England, United Kingdom Hybrid / WFH Options
Anson McCade
a Senior Data Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and more »
a Principal Data Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and more »
years of professional experience. A good understanding of modern lakehouse architectures and corresponding technologies, such as Dremio, Snowflake, Iceberg, (Py)Spark/Glue/EMR, dbt and Airflow/Dagster. Experience with Cloud providers. Familiarity with AWS S3, ECS and EC2/Fargate would be considered particularly beneficial. Extensive more »
Greater London, England, United Kingdom Hybrid / WFH Options
CommuniTech Recruitment Group
Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience more »
of NLP algorithms and techniques Experience with Large Language Models (fine tuning, RAG, agents) Our technology stack Python PySpark for processing big data AWS: EMR, ECS, Athena, etc. DevOps: Terraform, Docker, Airflow, MLFlow Additional Information Why should you jump on board? We pay special attention to learning and development more »
South East London, London, United Kingdom Hybrid / WFH Options
Stepstone UK
English Bachelor's degree in Computer Science or a related field (Master's degree preferred) Nice to have: experience with LLMs, Vector Databases, AWS EMR, Spark, and Python Our commitment: Equal opportunities are important to us. We believe that diversity and inclusion at The Stepstone Group are critical to more »
and data lakes using AWS and Azure cloud technologies. Utilize AWS and Azure data and analytics services (or their open-source equivalents) such as EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks. Design and deploy production data pipelines using languages like Java, Python, Scala, Spark, and SQL. Integrate … Ideally Have: A minimum of 2 years’ experience with AWS and Azure cloud technologies. Proficiency in AWS and Azure data and analytics services, including EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks. A solid foundation in data engineering, data science, and product development, with experience in both stream more »
data engineering experience. Proficiency in Python and Java 11+. Familiarity with modern data technologies such as Dremio, Snowflake, Iceberg, (Py)Spark/Glue/EMR, dbt, and Airflow/Dagster. Hands-on experience with AWS. Ability to work effectively with both business and technical stakeholders, owning end-to-end more »
delivering projects using relevant Data Architectural paradigms such as Kimball, Data Vault, Data Mesh, Lakehouse • Demonstrable knowledge of key AWS services such as S3, EMR, Redshift, Athena, Lambda • Excellent stakeholder management skills To be successfully appointed to this role, it is a requirement to obtain Security Check (SC) clearance. more »
our tech stack is not essential, but it would make things easier. The main technologies we use include: Elixir, Erlang, Python, Terraform, Ansible, Packer, EMR/Spark, Apache Spark, Apache Druid, BigQuery and Redis Familiarity with cloud technologies. Ideally AWS and technologies such as EC2, ECS, EMR, AWS more »
Position: Software Engineer - Data & AWS We are seeking a Software Engineer to build and optimize data platforms leveraging AWS and key technologies like CDAP, Snowflake, and Databricks. You will design and implement robust and scalable data pipelines, ETL, and analytics more »
designing and managing large-scale, distributed data platforms, particularly using data lakes or similar technologies. Expertise in developing cloud data architectures, particularly with Amazon Web Services (AWS) as a must-have, and preferably with Google Cloud Platform (GCP … and Microsoft Azure. Hands-on programming experience building and managing data pipelines and supporting systems, primarily using Python, AWS Services like Redshift, Lambda, Athena, EMR, SQS, Data pipelines, Glue etc., Shell scripting, SQL, and NoSQL. Experience in utilizing both open source and proprietary cloud data tools like Airflow, Glue more »
boundaries through multiple data centers and AWS regions. Your Profile Key skills/knowledge/experience: Experience of AWS Data platform experience including AWS-EMR Cluster Platform, Glue, EC2, S3, VPC, IAM, RDS, Redshift, Sagemaker, Lake formation and Glue catalogue. Data Storage Fundamentals. Cloud specific patterns and technologies. AWS … DevSecOps pipelines. Experience in data security areas in AWS like IAM, Cloudwatch, Cloudtrail, Inspector. Hands on experience in architecture of the data workloads in EMR\Clusters. Designs system architecture to integrate easily with other AWS services. Strong background in technologies like Spark, Hive and Pyspark. Key Experience: Experience of more »
JOB TITLE: Mid Level Software Engineer LOCATION: Hertfordshire SALARY: Up to £80,000 WAY OF WORKING: Full Time Hybrid Permanent THE BUSINESS: C4S Search are proud to be working a fast growing, ambitious marketing, and technology company in the more »