20 of 20 Permanent ETL Jobs in Manchester

Python development experience, including technologies such as PySpark, Pandas and PyArrow. Expertise in distributed data processing frameworks, particularly Apache Spark. Experience building and maintaining ETL pipelines using technologies such as Apache Airflow, AWS Step Functions or Apache NiFi. Cloud platform experience across AWS, Azure and/or GCP. Knowledge ...

and Python development skills. Experience managing and developing SQL data warehouses. Strong experience with Microsoft SQL Server, SSIS and SSRS. Experience building production-grade ETL and data pipelines. Experience working with financial data and supporting reporting or planning functions. Excellent communication skills with the ability to work closely with both ...

and non-technical stakeholders to translate business requirements into scalable data capabilities. Required Experience: Proven experience designing and delivering enterprise-scale data pipelines and ETL/ELT solutions. Strong hands-on expertise with Microsoft Fabric, Azure Data Services and cloud-based data platforms. Advanced SQL and data modelling skills. Experience ...

Skills and Competencies 3+ years of experience within a data engineering or software development team Hands‐on experience designing and developing data integration/ETL pipelines from diverse data sources and formats Hands‐on experience with Apache Airflow, dbt, and Python Strong database skills with Postgres SQL, DynamoDB, Snowflake, and ...

grows Must have: Cloud data engineering on AWS – this is non-negotiable People management and team leadership experience Strong SQL and T-SQL ETL/ELT pipelines, SSIS, Matillion or similar Data visualisation Infrastructure as Code awareness, Terraform or similar Stakeholder management Nice to have: Real-time and event-driven ...

code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/CD, Infrastructure as Code Container technologies Experience working in secure or regulated environments Security Requirement: Applicants must be eligible to obtain ...

integration, data platforms and AI-enabled products and services within a complex enterprise environment. Strong understanding of modern data engineering practices, including data pipelines, ETL/ELT, data modelling, data governance, security, privacy and access management. Experience working with data platforms and technologies such as Snowflake, SQL-based data environments ...

data validation and investigation Experience with data profiling, reconciliation, and quality assessments Proven track record of root cause analysis and remediation Understanding of ETL processes and Data Warehouse environments Experience defining data quality metrics, KPIs, and dashboards Knowledge of Data Governance and Data Stewardship practices Exposure to Azure Purview, Collibra ...

automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside ...

data-driven decision making Strong SQL and Python skills Knowledge of analytics platforms such as Google Analytics or similar tools Understanding of data modelling, ETL processes, and data engineering fundamentals Ability to communicate complex analytical concepts clearly to technical and non-technical stakeholders Experience influencing senior decision-makers through insight ...

both greenfield initiatives and the enhancement of existing data capabilities. Key Responsibilities Design, build and maintain a modern cloud-based data platform. Develop scalable ETL/ELT pipelines to integrate data from multiple operational systems, ERP platforms and high-volume transactional sources. Build reliable, high-performance data solutions for reporting … both relational and NoSQL databases. Experience building cloud-based data platforms using Azure, AWS, GCP or similar. Strong Python experience. Solid understanding of ETL/ELT processes and modern data warehousing principles. Experience with dimensional modelling, data governance and data architecture. Experience with Power BI and DAX. Experience integrating ...

customer engagement. You will analyse business requirements throughout the service life cycle and design modern data analytics platforms. Responsibilities include translating requirements, data modelling, ETL and data migration, data quality, MDM, and a strong focus on data science, AI and ML. Agile delivery and stakeholder management are key to success. ...

product analytics and user behaviour tracking tools, such as Google Analytics or similar platforms Advanced SQL skills and working knowledge of Python Understanding of ETL processes and core data engineering concepts Ability to translate complex analysis into clear business recommendations Experience delivering analytics projects within cross functional teams Proven capability ...

discovery and code reviews to map data flow from Retail systems into the data warehouse Produce high-level and granular architecture diagrams (cloud resources, ETL/ELT pipelines, third-party integrations) Author operational runbooks for troubleshooting, restart and maintenance of critical pipelines Audit and document the SQL logic behind ...

from Retail systems to the data warehouse. Architecture Mapping: Create high-level and granular visual diagrams of the current data infrastructure, including cloud resources, ETL/ELT pipelines, and third-party integrations. Operational Runbooks: Author operational manuals using Betfred documentation standards, create a set of documents that the team ...

reports which meet their needs Collaborating with data engineers and integration specialists within the team and across the wider business to deliver data pipelines, ETL processes and data models that meet requirements Developing and maintaining a suite of engaging Power BI dashboards including enterprise level semantic models along with user … communication and business partnering skills with the ability to translate business requirements into data solutions Experience of marketing orchestration platforms (e.g. Bloomreach) or reverse ETL tools (e.g. HighTouch) is desirable Knowledge of marketing and digital data (e.g. Google Analytics, BiqQuery) would be advantageous Change management using JIRA and Confluence would ...

TigerGraph, ArangoDB or similar RDF/LPG stores. Ontology and knowledge graph frameworks, reasoning tools, and production deployment experience. Data pipelines and entity work ETL/streaming or CDC pipelines feeding a knowledge graph. Entity resolution techniques, data cleansing, enrichment, and integration from many sources. Python + ML/ ...

Senior Data Engineer (AWS) - Manchester (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client is a global … enabling crucial business intelligence. We are seeking a Senior Data Engineer capable of taking ownership of designing, developing, and maintaining robust data pipelines and ETL processes using AWS services. You will also be contributing to Cloud migration and implementing architectural solutions, as well as ensuring data quality and integrity and ...

solutions and the production of specifications, Designing and implementing business intelligence & modern data analytics platform technical solutions, Data architecture design and implementation Data modelling, ETL, data integration and data migration design and implementation Master data management system and process design and implementation, Data quality system and process design and implementation … data extraction processes, including data warehouse and cloud infrastructure. Experience with multi-dimensional design, star schemas, facts and dimensions. Experience and demonstrated competencies in ETL development techniques. Experience in data warehouse performance optimization. Experience on projects across a variety of industry sectors an advantage, Comprehensive understanding of data management best ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...