AWS data tooling, helping to solve complex data challenges that have wide-reaching impact across multiple business domains. Key Requirements: Strong experience in AWS data engineering tools (e.g., Glue, Athena, PySpark, Lake Formation) Solid skills in Python and SQL for data processing and analysis Deep understanding of data governance, quality, and security A passion for building scalable, secure, and More ❯
complex data pipelines. These pipelines ingest and transform data from diverse sources (e.g., email, CSV, ODBC/JDBC, JSON, XML, Excel, Avro, Parquet) using AWS technologies such as S3, Athena, Redshift, Glue, and programming languages like Python and Java (Docker/Spring) . What You’ll Do Lead the design and development of scalable data pipelines and ETL processes … for at least 5 years. What We’re Looking for Proven experience leading data engineering teams and delivering technical solutions Strong background in cloud data platforms, especially AWS (Redshift, Athena, EC2, IAM, Lambda, CloudWatch) Proficiency in automation tools and languages (e.g., GitHub/GitLab, Python, Java). Skilled in stakeholder engagement and translating requirements into actionable insights. Ability to More ❯
AWS data tooling, helping to solve complex data challenges that have wide-reaching impact across multiple business domains. Key Requirements: Strong experience in AWS data engineering tools (e.g., Glue, Athena, PySpark, Lake Formation) Solid skills in Python and SQL for data processing and analysis Deep understanding of data governance, quality, and security A passion for building scalable, secure, and More ❯
Milton Keynes, England, United Kingdom Hybrid / WFH Options
Santander
need to be successful in this role: Experience developing, testing, and deploying data pipelines, data lakes, data warehouses, and data marts using ideally AWS services such as S3, Glue, Athena, EMR, Kinesis, and Lambda Understanding of the principles behind designing and implementing data lake, lake house and/or data mesh architecture Problem solving skill with basic knowledge of … Clear and effective communication skills to interact with team members, stakeholders and end users conveying technical concepts in a comprehensible manner Skills across the following data competencies: SQL (AWS Athena/Hive/Snowflake) Hadoop/EMR/Spark/Scala Data structures (tables, views, stored procedures) Data Modelling - star/snowflake Schemas, efficient storage, normalisation Data Transformation DevOps More ❯
of consolidating data sources, creating pipelines, and ideally a software engineering mindset. Excellent experience with Containers. Strong knowledge of Python, Airflow, SQL, and Linux. Proficient in AWS Lambda, ECS, Athena, S3, Kinesis, Glue, CloudWatch/Terraform/CDK, Tableau Online. They are particularly keen on Senior Data Engineers who utilize good AI-based tooling for productivity, such as Co More ❯
AWS data tooling, helping to solve complex data challenges that have wide-reaching impact across multiple business domains. Key Requirements: Strong experience in AWS data engineering tools (e.g., Glue, Athena, PySpark, Lake Formation) Solid skills in Python and SQL for data processing and analysis Deep understanding of data governance, quality, and security A passion for building scalable, secure, and More ❯
Cucumber) Linux environments AWS environment experience MariaDB, Oracle, MySQL, AWS Aurora (2 or more) 2+ years in MySQL scripting within cloud Data Migration projects AWS data migration testing, including Athena, Data Migration Service, or similar tools Additional skills include: Self-management and proactive decision-making with risk assessment Ability to translate technical concepts for non-technical stakeholders Knowledge sharing More ❯
like AWS, Azure, or GCP You demonstrate ability to work collaboratively across multiple technology teams Preferred Qualifications, Capabilities, and Skills: You have prior experience with Sell-Side analytics platforms (Athena, SecDB, etc.) #J-18808-Ljbffr More ❯
experience using data processing frameworks such as Kafka, NoSQL, Airflow, TensorFlow, or Spark. Finally, experience with cloud platforms like AWS or Azure, including data services such as Apache Airflow, Athena, or SageMaker, is essential for the is a fantastic opportunity for a Data Engineer to join a rapidly expanding start-up at an important time where you will have More ❯
and mentoring practice teams. Skills & Experience Required: 13-18 years of overall Data and Analytics experience. At least 10+ years in AWS data platform including AWS S3, Glue, Redshift, Athena, Sagemaker, Quicksight, and MLOPS. Expertise in Snowflake DWH architecture, Snowpipe, Data Sharing, Polaris catalog, and data governance. Knowledge of additional technologies such as Python, Streamlit, Matillion, DBT, Atlan, Terraform More ❯
Your critical and statistical thinking skills and passion for solving complex problems will be invaluable. You are proficient in SQL and Python, with experience in AWS services such as Athena, S3, Glue, and Spark, and you are adept at handling big data technologies and orchestration tools. If this sounds like you and you're keen to learn more, apply More ❯
Salisbury, England, United Kingdom Hybrid / WFH Options
Tedaisy Insurance Group
for someone who: Can demonstrate a strong technical data skillset in regard to Python, Spark, Pandas, SQL, NoSQL. Has strong experience working with modern database platforms such as Cosmos, Athena, and MySQL. Is comfortable with both NoSQL and relational database design. Able to use Airflow to a high skill level. Enjoys working independently in a small team. Has a More ❯
experience using data processing frameworks such as Kafka, NoSQL, Airflow, TensorFlow, or Spark. Finally, experience with cloud platforms like AWS or Azure, including data services such as Apache Airflow, Athena, or SageMaker, is essential. This is a fantastic opportunity for a Data Engineer to join a rapidly expanding start-up at an important time where you will have great More ❯
of our core data & AI platform powering our SaaS product, mentoring team members, and optimizing software engineering practices for long-term success. Our tech stack includes AWS and Azure, Athena, Synapse, Spark, Kubernetes, Temporal, Python, Redis, Postgres, React, and Docker. Key Responsibilities: Split workload: approximately 60% on technical design and implementation, 40% on managerial responsibilities. Design of our technical More ❯
driven architectures. Proficient in SQL. Familiarity with one scripting language, preferably Python. Experience with Apache Airflow & Apache Spark. Solid understanding of cloud data services: AWS services such as S3, Athena, EC2, RedShift, EMR (Elastic MapReduce), EKS, RDS (Relational Database Services) and Lambda. Nice to have: Understanding of ML Models. Understanding of containerisation and orchestration technologies like Docker/Kubernetes. More ❯
London, England, United Kingdom Hybrid / WFH Options
LoyaltyLion
every $1 spent on the platform. Currently, LoyaltyLion works with over 10,000 small and medium-sized retailers. Our mission is to help them succeed in the age of Amazon by offering a better customer experience where customers feel valued, rather than just another number. It’s been an incredible two years for LoyaltyLion. We closed significant funding last More ❯
disruption. Collaborate with various teams to align migration processes with organisational goals and regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure Data Factory More ❯
disruption. Collaborate with various teams to align migration processes with organisational goals and regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2, and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure Data Factory More ❯
SaaS product. Beyond that, you'll spearhead backend & data engineering, mentor team members, and optimize software engineer practices for long-term success. Our Tech stack: AWS and Azure, including Athena, Synapse, Spark, Kubernetes. Temporal, Python, Redis, Postgres, React and Docker. Key Responsibilities: We'd expect this role to be split between 60% on the Tech side with the remaining More ❯
hands on experience in AWS Cloud serverless components and ability to build and maintain cloud data processing systems (i.e. ECS, EKS, S3, Lambda, SQS/SNS, PostgreSQL, Dynamo, Sagemaker, Athena, etc.) Experience using relational and object databases and web service development standards and practices, including RESTful APIs, micro-services, and services Experience working in an agile development environment using More ❯
Manchester, England, United Kingdom Hybrid / WFH Options
Smart DCC
TrustedAdvisor, Inspector and Systems Manager. Serverless platforms such as Lambda, SQS, Fargate, and API Gateway. RDS experience and exposure to DataLake/LakeHouse platforms such as RedShift, Glue, and Athena and IAM roles and policies. Deep experience and strong skills with Terraform and Git. Experience troubleshooting server and software configuration issues on both Windows and Linux, including Red Hat More ❯
London, England, United Kingdom Hybrid / WFH Options
Trainline
data. Communicate clearly and enjoy presenting your ideas and work to both technical and non-technical colleagues. Nice to have Experience with SQL using databases such as MySQL, PostgreSQL, Athena, and Redshift. Familiarity with cloud-based platforms like AWS and CI/CD processes using tools like GitHub Actions. Some knowledge of geospatial analysis techniques, using network graphs and More ❯
Chester, England, United Kingdom Hybrid / WFH Options
Forge Holiday Group Ltd
/scrum development environment Experience using JIRA and Bitbucket or GitHub Other Useful Experience: Experience with Apache Kafka (or any other data streaming technologies) Experience with AWS products (S3, Athena, etc) Experience with SQL Server data warehousing (SQL Server, SSIS and SSAS). Forge Holiday Groups Company Benefits Annual STIP Company-wide Bonus Scheme offering up to an additional More ❯
London, England, United Kingdom Hybrid / WFH Options
Tasman
available budget. Some of the products and platforms that you are likely to come across at Tasman are: AWS, GCP and Azure cloud environments; Airflow and Prefect; Snowflake, BigQuery, Athena, and Redshift; Airbyte, Stitch, Fivetran, and Meltano; dbt (both Cloud and Core); Looker, Metabase, Tableau and Hollistics; Docker and Kubernetes; Snowplow, Segment, Rudderstack, and mParticle; Metaplane and other observability More ❯
Royal Leamington Spa, England, United Kingdom Hybrid / WFH Options
Verisk
Join to apply for the Principal Software Architect role at Verisk 1 day ago Be among the first 25 applicants Join to apply for the Principal Software Architect role at Verisk Get AI-powered advice on this job and more More ❯