1 to 25 of 52 ETL Jobs in the North West

DevOps best practices, contribute to architectural decisions, and help mentor junior engineers as the team scales. Responsibilities Architect and write production-grade ELT/ETL data pipelines using PySpark and Python within Azure ecosystem. Build custom, reusable data processing frameworks and libraries in Python/Scala to streamline ingestion and ...

Lakehouse architectures to tools such as Power BI and Tableau. Hands-on experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. ...

application to our client in conjunction with this vacancy only. KEY SKILLS Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data ...

practices Proficiency with cloud platforms (AWS, Azure, GCP) and data technologies such as Snowflake, Databricks, or equivalent Experience with programming/scripting, data integration, ETL pipelines, and orchestration Knowledge of ML/AI frameworks, BI/analytics platforms, and semantic data modelling Strong client-facing skills with the ability ...

level deployments and licensing strategy. Solid knowledge of Azure data stack : Azure Data Factory, Data Lake, Azure SQL, and data warehousing. Ability to design ETL/ELT pipelines using visual tooling to move and transform data efficiently. Strong SQL and data modelling skills , with experience turning document-based databases (like ...

similar role. Strong Azure background, ideally including Data Factory, Data Lake, Databricks, Synapse (or similar). Solid understanding of SQL, Python, ETL/ELT, data warehousing, and data modelling. Experience integrating multiple systems into a centralised platform. Familiarity with ERP, CRM, and e-commerce environments. Power BI, DAX, and Dynamics ...

skills (joins, CTEs, window functions) and experience with SQL Server. Strong understanding of dimensional modelling and data warehouse principles. Experience building and maintaining ETL pipelines. Excellent analytical, problem solving, and troubleshooting skills. Strong communication skills, able to translate complex data concepts for non technical audiences. Desirable Skills Experience with Atlassian ...

expect to be involved in the following: Designing scalable data architecture that supports analytics, reporting, and ML workloads. Building and maintaining secure, repeatable ETL and ELT pipelines using Azure, Python, and SQL. Driving best practice, including CI/CD, observability, documentation, and automation. Creating datasets and reusable data models ...

shaping best practices and supporting the wider team. Specifically, you can expect to be involved in the following: Designing and building scalable ELT and ETL pipelines across a cloud environment. Developing curated data models to support analytics, reporting and operational use cases. Improving performance, cost efficiency and reliability ...

Line management and team leadership Real-time and event-driven data platforms Cloud data engineering on AWS Strong SQL and T-SQL SQL Server ETL/ELT pipelines, SSIS, Matillion or similar Data visualisation, Tableau or similar Infrastructure as Code awareness, Terraform or similar Stakeholder managemenT Useful but not essential ...

role with a small amount of hands on work possible. Key Responsibilities Lead and develop a team of data engineers Deliver largescale data pipelines (ETL/ELT) Design and optimise data architecture and workflows Partner with stakeholders to translate business needs Ensure data quality, governance and best practice Key Requirements ...

making sales learner outcomes efficiency Fast paced dynamic. Switch tasks balance projects requests multiple stakeholders. SKILLS Power BI report development dashboard creation Strong SQL ETL processes data pipelines Data modelling Power BI DAX Microsoft Power Platform Power Automate Power Apps End to end BI lifecycle requirements to insights Senior stakeholder ...

making sales learner outcomes efficiency Fast paced dynamic. Switch tasks balance projects requests multiple stakeholders. SKILLS Power BI report development dashboard creation Strong SQL ETL processes data pipelines Data modelling Power BI DAX Microsoft Power Platform Power Automate Power Apps End to end BI lifecycle requirements to insights Senior stakeholder ...

across multiple industries. Access professional development, including technical courses, certifications, mentoring, and coaching. Tech stack: AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement. Programming: Java, Python, Scala, Spark, SQL. Experience integrating and processing large-scale structured and unstructured datasets from ...

team Required Skills and Experience Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services ...

terms of learning milestones and certification pass rates. 3. Required Technical Background Legacy SQL Mastery: Deep understanding of SQL Server, T-SQL, and traditional ETL processes. Epic Ecosystem Knowledge: Familiarity with the Epic 3nd-tier architecture (Caché/IRIS, Clarity, Caboodle). Azure Infrastructure: Understanding of Azure SQL Managed Instances ...

issues. Key Responsibilities: Develop and maintain enterprise-grade Power BI reports, datasets, and data models (including star schemas and dimensional models). Lead ETL/ELT design and optimisation within Microsoft Fabric Lakehouse, including Data Pipelines, Notebooks, and cloud-based ingestion/transformation layers. Deliver complex SQL, Python, and PySpark ...

and integration levels, ensuring validation is integrated into CI/CD pipelines. Required Skills & Qualifications Data Testing : Proven experience testing data-intensive backend systems, ETL/ELT processes, and financial data feeds. SQL Mastery : Strong proficiency in relational databases, ideally Microsoft SQL Server , including writing and optimizing complex ...

and maintain data processing workloads using Python and PySpark, including notebook-based development where appropriate. Support the migration and modernisation of legacy databases and ETL processes to cloud-based architectures. Strong analytical and problem-solving skills with strong attention to detail Experienced Senior with mentorship and architectural experience The Benefits ...

Ensures high-quality, secure, and scalable data pipelines. Performs deep analytical work on diverse data sources and mentors junior Data Engineers. Design and develop ETL processes, database systems, and tools for real-time and offline analytics. Ensure data consistency and integrity; integrate large, complex datasets for business insights. Converts business ...

Ensures high-quality, secure, and scalable data pipelines. Performs deep analytical work on diverse data sources and mentors junior Data Engineers. Design and develop ETL processes, database systems, and tools for Real Time and offline analytics. Ensure data consistency and integrity; integrate large, complex datasets for business insights. Converts business ...

looking for from you: SQL technologies skills (e.g. MS SQL, Oracle...) noSQL technologies skills (e.g. MongoDB, InfluxDB, Neo4J...) Data exchange and processing skills (e.g. ETL, ESB, API...) Development (e.g. Python) skills Big data technologies knowledge (e.g. Hadoop stack) Knowledge in NLP (Natural Language Processing) Knowledge in OCR (Object Character Recognition ...

development projects. Advanced TypeScript skills and strong containerization experience (AKS). Hands-on expertise across Azure compute, storage, networking, and security. Exposure to Databricks, ETL, and analytics workflows. Strong leadership abilities: mentoring, code review, and collaborative solution-design. Excellent problem-solving skills and the ability to communicate technical concepts ...

supporting ongoing modernisation efforts by strengthening the way data is collected, processed, and made available across the business. Responsibilities Build, maintain, and improve scalable ETL/ELT pipelines using Azure Data Factory Model, manage, and optimise datasets within Azure SQL Use Python and Pandas for data preparation, transformation, and quality ...

successful SAP BI Developer will be able to demonstrate: Proven expertise in SAP BI tools and technologies. Strong understanding of data modelling and ETL processes. Experience in creating dashboards and reports for business applications. Excellent problem-solving and analytical skills. A collaborative approach to working with cross-functional teams. Strong ...