Manchester, Lancashire, England, United Kingdom Hybrid/Remote Options
Spectrum IT Recruitment
CI/CD pipelines. Able to think commercially i.e. cost of scaling vs utilisation of existing infrastructure. Beneficial Experience Knowledge of Nginx, PHP, MySQL. Knowledge of NoSQL solutions, RabbitMQ, SOLR, Couchbase. Good understanding of Networking concepts and solutions. Ability to work with, devise, and implement CI/CD pipelines and practices. A solid understanding of networking concepts, technologies, and More ❯
an agile team on applications, APIs, and services used globally. Develop in one or more core technology areas: NoSQL (MongoDB, DocumentDB) Graph databases (GraphDB, Neo4j) Search technologies (ElasticSearch, OpenSearch, SOLR) ML/AI frameworks (SageMaker, Bedrock) Cloud-based data engineering (AWS) Build and maintain cloud-native data pipelines, ensuring data quality, accuracy, and reliability. What We're Looking For More ❯
Amazon Redshift (query tuning, distribution/sort keys, workload management) Data modelling (normalisation, dimensional) dbt (modeling, testing, documentation, deployment) Building scalable ETL/ELT pipelines with Python Workflow Orchestration: Apache Airflow (DAG design, scheduling, monitoring, scaling) Best practices for dependency management, retries, and alerting Cloud & Serverless: AWS Lambda (Python-based serverless pipelines, event-driven processing) IAM roles, policies, and … solutions. Understanding of Cloud security frameworks (specifically on the AWS Cloud) including appropriate data encryption Desirable Utilising AI within data engineering to drive performance Facilitating search tools such as Solr MLOps experience including familiarity with tools such as DVC & mlflow Full data engineering cycle knowledge (tools and skills) for stream data The Person You are someone who: Takes ownership More ❯
