Position: Software Engineer - Data & AWS We are seeking a Software Engineer to build and optimize data platforms leveraging AWS and key technologies like CDAP, Snowflake, and Databricks. You will design and implement robust and scalable data pipelines, ETL, and analytics more »
Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience more »
Apache Iceberg & Spark. Exposure to Apache Airflow, Prefect, Dagster, DBT. Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub, OpenDataDiscovery, Marquez, etc.), Experience on RDBMS like PostgreSQL would be a plus. Experience more »
Blackpool, Lancashire, North West, United Kingdom Hybrid / WFH Options
DWP Digital
direction, building and maintaining networks and collaborating across teams with a diverse range of stakeholders You have a deep understanding of AWS, Azure, Athena, EMR processing, relational & non-relational databases, and understand how these fit into the wider technical landscape You have experience designing, coding and testing data solutions more »
and focus on our AWS Analytics and ML service offerings such Amazon Kinesis, AWS Glue, Amazon Redshift, AmazonEMR, Amazon Athena, Amazon Sagemaker and more. Help our customers to remove the constraints that prevent them from leveraging their data … leverages deep knowledge in the use of services like Amazon Kinesis, Apache Kafka, Apache Spark, Amazon Sagemaker, AmazonEMR, NoSQL technologies and other 3rd parties Develop and define key business questions and to build data sets that answer those questions. You should be … implement them as part of data pipeline IT platform implementation experience Experience with one or more relevant tools ( Flink, Spark, Sqoop, Flume, Kafka, Amazon Kinesis) Experience developing software code in one or more programming languages (Java, JavaScript, Python, etc) Current hands-on implementation experience required Preferred Qualifications Masters more »
Key Responsibilities Help customers learn and use AWS services such as Athena, Glue, Lambda, S3, DynamoDB, NoSQL, Relational Database Service (RDS), AmazonEMR and Amazon Redshift Deliver on-site technical engagements with customers. This includes understanding customer requirements, and creating packaged Data & Analytics service offerings more »
validation, hyperparameter tuning, model performance metrics, effective code and notebook documentation. Experience of working in a Cloud environment (we use AWS to run an EMR based platform), including experience of scaling ML solutions using Spark. Experience across common supervised, unsupervised, semi-supervised, reinforcement machine learning techniques What technical skills more »
existing SDE Bartek What will you be doing? Bartek is redeveloping our teams data platform from a legacy system to one based on AWS EMR, with Amazon RDS and DynamoDB ingestion converted to Parquet files, interrogatable through Spark and MapReduce. This modern platform will support rapid data … flows (including building out source-to-target mappings) to testing and service optimisation.) Good familiarity with our developing key services/applications - AmazonRDS, Amazon DynamoDB, AWS Glue, MapReduce, Hive, Spark, YARN, Airflow. Ability to work with a range of structured, semi-structured and unstructured file formats including Parquet more »
Hybrid, On-site 2 days p/w £600-£700 p/d Outside IR35 3-6 month contract We are currently seeking an experienced AWS Cloud Architect to design AWS reference architecture for our services-led client. Responsibilities: Design more »
estate of cloud native software products and services. The DevOps Engineer will have deep knowledge of the AWS data engineering stack: Kinesis, Redshift, Glue, EMR and be passionate about writing high-quality code that not only solves problems but improves the overall estate. The role will involve operating and … Required DevOps Engineer experience. AWS skills. Docker, Kubernetes skills. knowledge across the AWS data engineering stack including but not limited to: Kinesis, Redshift, Glue, EMR, Databricks. of the software development lifecycle and the role DevOps plays within it. working in autonomous agile teams and environments. to degree level or more »
the adoption of best practices (agile methodologies, continuous improvement) in software engineering and product development. Design and lead software integration with external vendors (PACS, EMR) and business partners. Manage translation, user interface, and user documentation, adhering to human factors engineering principles and usability testing. Collaborate with leadership to align … performing product development teams across the entire lifecycle. Experience managing software development, UI/UX/workflow design, testing, SaaS security, and PACS/EMR integration. Worked with Cloud based SaaS (ideally AWS) Ideally some familiarity with Ai/ML for diagnosis Benefits Competitive salary, with share options and more »
Leeds, West Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
DWP Digital
direction, building and maintaining networks and collaborating across teams with a diverse range of stakeholders You have a deep understanding of AWS, Azure, Athena, EMR processing, relational & non-relational databases, and understand how these fit into the wider technical landscape You have experience designing, coding and testing data solutions more »
Sheffield, South Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
DWP Digital
direction, building and maintaining networks and collaborating across teams with a diverse range of stakeholders You have a deep understanding of AWS, Azure, Athena, EMR processing, relational & non-relational databases, and understand how these fit into the wider technical landscape You have experience designing, coding and testing data solutions more »
Manchester, North West, United Kingdom Hybrid / WFH Options
DWP Digital
direction, building and maintaining networks and collaborating across teams with a diverse range of stakeholders You have a deep understanding of AWS, Azure, Athena, EMR processing, relational & non-relational databases, and understand how these fit into the wider technical landscape You have experience designing, coding and testing data solutions more »
Newcastle upon Tyne, Tyne and Wear, High Heaton, Tyne & Wear, United Kingdom Hybrid / WFH Options
Department of Work & Pensions
direction, building and maintaining networks and collaborating across teams with a diverse range of stakeholders You have a deep understanding of AWS, Azure, Athena, EMR processing, relational & non-relational databases, and understand how these fit into the wider technical landscape You have experience designing, coding and testing data solutions more »
Birmingham, West Midlands, United Kingdom Hybrid / WFH Options
DWP Digital
direction, building and maintaining networks and collaborating across teams with a diverse range of stakeholders You have a deep understanding of AWS, Azure, Athena, EMR processing, relational & non-relational databases, and understand how these fit into the wider technical landscape You have experience designing, coding and testing data solutions more »
Yes Responsibilities: Help customers learn and use AWS services such as Athena, Glue, Lambda, S3, DynamoDB, NoSQL, Relational Database Service (RDS), AmazonEMR and Amazon Redshift Deliver on-site technical engagements with customers. This includes understanding customer requirements, and creating packaged Data & Analytics service offerings more »
Northamptonshire, England, United Kingdom Hybrid / WFH Options
Capgemini
enhance their I&D Consulting career. What you’ll do and bring: Proficiency in AWS services relevant to data engineering such as S3, Glue, EMR, Athena, and Lambda. Hands-on experience with Snowflake, Redshift cloud data warehousing solutions. Familiarity with DBT (Data Build Tool) for managing transformations in the more »
Knutsford, England, United Kingdom Hybrid / WFH Options
Capgemini
enhance their I&D Consulting career. What you’ll do and bring: Proficiency in AWS services relevant to data engineering such as S3, Glue, EMR, Athena, and Lambda. Hands-on experience with Snowflake, Redshift cloud data warehousing solutions. Familiarity with DBT (Data Build Tool) for managing transformations in the more »
have an understanding of Data modelling Principles & best practices and also needs prior experience leading a data engineering team. Key Tech: - AWS (S3, Glue, EMR, Athena, Lambda) - Snowflake, Redshift - DBT (Data Build Tool) - Programming: Python, Scala, Spark, PySpark or Ab Initio - Data pipeline orchestration (Apache Airflow) - Knowledge of SQL more »
similar). Experience using modern build tools such as Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL and data modeling Experience with building large-scale more »
Watford, England, United Kingdom Hybrid / WFH Options
Noir
PHP 8+ Experience with Laravel/Symfony framework Strong grasp of JavaScript/TypeScript Familiarity with AWS services including Aurora, MSK Kafka, ECS, and EMR Solid understanding of SQL Key Responsibilities: Collaborate with a talented team to conceptualise, develop, and deploy scalable web applications Write clean, efficient, and maintainable more »
wrangling, visualization, and reporting. • Specialised in AWS cloud technologies for ETL, data warehouse, and data lake design. • Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. • Capable of processing large volumes of structured and unstructured data on AWS. • Familiarity with AWS best practices in data more »
Greater London, England, United Kingdom Hybrid / WFH Options
Anson McCade
a Senior Data Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and more »