with a focus on AWS Aurora (PostgreSQL/MySQL) . Utilize a broad suite of AWS services including Aurora, RDS, S3, Glue, Lambda, and Redshift to develop cloud-native data solutions. Define and maintain database schemas optimized for performance, consistency, and long-term maintainability. 2. ETL and Data Pipeline More ❯
new technologies Develop new tools and infrastructure using Python (Flask/Fast API) or Java (Spring Boot) and relational data backend (AWS - Aurora/Redshift/Athena/S3) Support users and operational flows for quantitative risk, senior management and portfolio management teams using the tools developed Qualifications/ More ❯
processes and database management systems (e.g., MySQL, PostgreSQL, MongoDB). Hands-on experience with AWS services for data processing, storage and analysis (e.g., S3, Redshift, EMR, Glue). Familiarity with programming languages such as Python or Java. Understanding of data warehousing concepts and data modeling techniques. Experience working with More ❯
kits (APIs). Optimise performance, data storage and retrieval processes for efficiency and scalability. Ensure the data lake and Online Analytical Processing DB (OLAP - Redshift or similar) is able to handle large volumes and highly concurrent data acess. Ensure data quality, security, and compliance with industry standards. Requirements: Proven More ❯
Cardiff, Wales, United Kingdom Hybrid / WFH Options
Creditsafe
and encourage applications from those with transferable experience. You’ll ideally bring: Experience building ETL pipelines in Python. Familiarity with analytical data warehouses (e.g. Redshift preferred, or Snowflake/BigQuery). Understanding of orchestration tools such as AWS Step Functions, Airflow, or AWS Batch. Experience working with Agile methodologies. More ❯
analytical and problem-solving skills with an ability to work in agile development environment independently. Experience with data warehouse platforms (e.g., Snowflake, Azure Synapse, Redshift, BigQuery, or similar). Ability to work independently and manage multiple projects simultaneously. Excellent communication and collaboration skills. Preferred Qualifications: Exposure to Agile/ More ❯
with distributed frameworks like Apache Spark, data modeling, database systems, and SQL optimization. Experience with cloud platforms (AWS, Azure, GCP) and services like S3, Redshift, BigQuery. Additional desirable qualities: Knowledge of UK broadcast industry & digital marketing. Familiarity with data design for classification, regression, A/B testing, and statistical More ❯
testing across our software, infrastructure, and data pipelines. Key requirements: Technical Skills Proven experience with AWS services (S3, Glue, Lambda, Athena, EMR, Step Functions, Redshift, etc.). Proficient in Terraform, CloudFormation, or AWS SAM for Infrastructure as Code. Skilled in Docker, containerization, and virtualization. Hands-on experience with CI More ❯
Azure SQL Azure DataBricks Microsoft Fabric Azure data lake Exposure to other data engineering and storage tools: Snowflake AWS tools - Kinesis/Glue/Redshift Google tools - BigQuery/Looker Experience working with open datasets - ingesting data/building API based queries Our benefits Here at North Northamptonshire Council More ❯
platforms and cloud data solutions . Hands-on experience designing data solutions on Azure (e.g., Azure Data Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with More ❯
Azure SQL Azure DataBricks Microsoft Fabric Azure data lake Exposure to other data engineering and storage tools: Snowflake AWS tools – Kinesis/Glue/Redshift Google tools – BigQuery/Looker Experience working with open datasets – ingesting data/building API based queries Our benefits Here at North Northamptonshire Council More ❯
server) Data Integration Tools: Knowledge of platforms like Airflow, Apache NiFi, or Talend. Data Storage and Modelling: Experience with data warehousing tools (e.g. Snowflake, Redshift, BigQuery) and schema design. Version Control and CI/CD: Familiarity with Git, Docker, and CI/CD pipelines for deployment. Experience 2+ years More ❯
platforms and cloud data solutions . Hands-on experience designing data solutions on Azure (e.g., Azure Data Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with More ❯
platforms and cloud data solutions . Hands-on experience designing data solutions on Azure (e.g., Azure Data Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with More ❯
platforms and cloud data solutions . Hands-on experience designing data solutions on Azure (e.g., Azure Data Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with More ❯
platforms and cloud data solutions . Hands-on experience designing data solutions on Azure (e.g., Azure Data Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with More ❯
platforms and cloud data solutions . Hands-on experience designing data solutions on Azure (e.g., Azure Data Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with More ❯
platforms and cloud data solutions . Hands-on experience designing data solutions on Azure (e.g., Azure Data Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with More ❯
platforms and cloud data solutions . Hands-on experience designing data solutions on Azure (e.g., Azure Data Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with More ❯
platforms and cloud data solutions . Hands-on experience designing data solutions on Azure (e.g., Azure Data Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with More ❯
platforms and cloud data solutions . Hands-on experience designing data solutions on Azure (e.g., Azure Data Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with More ❯
platforms and cloud data solutions . Hands-on experience designing data solutions on Azure (e.g., Azure Data Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with More ❯
platforms and cloud data solutions . Hands-on experience designing data solutions on Azure (e.g., Azure Data Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with More ❯
platforms and cloud data solutions . Hands-on experience designing data solutions on Azure (e.g., Azure Data Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with More ❯
platforms and cloud data solutions . Hands-on experience designing data solutions on Azure (e.g., Azure Data Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with More ❯
