1 to 25 of 55 ETL Jobs in the North West

DevOps best practices, contribute to architectural decisions, and help mentor junior engineers as the team scales. Responsibilities Architect and write production-grade ELT/ETL data pipelines using PySpark and Python within Azure ecosystem. Build custom, reusable data processing frameworks and libraries in Python/Scala to streamline ingestion and ...

Lakehouse architectures to tools such as Power BI and Tableau. Hands-on experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. ...

application to our client in conjunction with this vacancy only. KEY SKILLS Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data ...

modern lakehouse environment, youll focus on automation, data quality, and performance, helping to drive efficient and scalable data operations. You will: Develop and maintain ETL/ELT pipelines to ingest data from multiple sources into Fabric/GCP Ensure pipelines follow medallion architecture (Bronze/Silver/Gold) standards Monitor ...

practices Proficiency with cloud platforms (AWS, Azure, GCP) and data technologies such as Snowflake, Databricks, or equivalent Experience with programming/scripting, data integration, ETL pipelines, and orchestration Knowledge of ML/AI frameworks, BI/analytics platforms, and semantic data modelling Strong client-facing skills with the ability ...

level deployments and licensing strategy. Solid knowledge of Azure data stack : Azure Data Factory, Data Lake, Azure SQL, and data warehousing. Ability to design ETL/ELT pipelines using visual tooling to move and transform data efficiently. Strong SQL and data modelling skills , with experience turning document-based databases (like ...

skills (joins, CTEs, window functions) and experience with SQL Server. Strong understanding of dimensional modelling and data warehouse principles. Experience building and maintaining ETL pipelines. Excellent analytical, problem solving, and troubleshooting skills. Strong communication skills, able to translate complex data concepts for non technical audiences. Desirable Skills Experience with Atlassian ...

expect to be involved in the following: Designing scalable data architecture that supports analytics, reporting, and ML workloads. Building and maintaining secure, repeatable ETL and ELT pipelines using Azure, Python, and SQL. Driving best practice, including CI/CD, observability, documentation, and automation. Creating datasets and reusable data models ...

focused on building a trusted, well-governed, and scalable data environment. The Role * Own the design, build, and optimisation of cloud-based ELT and ETL pipelines. * Shape the data warehouse architecture and ensure data is prepared for analytics, reporting, and operational use. * Improve existing processes and contribute to a modernised ...

shaping best practices and supporting the wider team. Specifically, you can expect to be involved in the following: Designing and building scalable ELT and ETL pipelines across a cloud environment. Developing curated data models to support analytics, reporting and operational use cases. Improving performance, cost efficiency and reliability ...

Line management and team leadership Real-time and event-driven data platforms Cloud data engineering on AWS Strong SQL and T-SQL SQL Server ETL/ELT pipelines, SSIS, Matillion or similar Data visualisation, Tableau or similar Infrastructure as Code awareness, Terraform or similar Stakeholder managemenT Useful but not essential ...

role with a small amount of hands on work possible. Key Responsibilities Lead and develop a team of data engineers Deliver largescale data pipelines (ETL/ELT) Design and optimise data architecture and workflows Partner with stakeholders to translate business needs Ensure data quality, governance and best practice Key Requirements ...

core components of platforms, collaborate with data scientists, delivery leads, and mentor more junior engineers. What You’ll Be Doing Design and implement scalable ETL/ELT pipelines and data models for enterprise platforms Build and operate event‐driven architectures (Kafka) and orchestrate workflows (Airflow) Implement data quality, testing and ...

strong data governance, including lineage, cataloguing, and eliminating shadow IT Set engineering standards across CI/CD, version control, and documentation Oversee pipeline orchestration (ETL/ELT) to ensure reliable, high-performing data flows Work cross-functionally with Finance, Data Science, and Architecture teams to deliver high-quality, trusted datasets ...

making sales learner outcomes efficiency Fast paced dynamic. Switch tasks balance projects requests multiple stakeholders. SKILLS Power BI report development dashboard creation Strong SQL ETL processes data pipelines Data modelling Power BI DAX Microsoft Power Platform Power Automate Power Apps End to end BI lifecycle requirements to insights Senior stakeholder ...

making sales learner outcomes efficiency Fast paced dynamic. Switch tasks balance projects requests multiple stakeholders. SKILLS Power BI report development dashboard creation Strong SQL ETL processes data pipelines Data modelling Power BI DAX Microsoft Power Platform Power Automate Power Apps End to end BI lifecycle requirements to insights Senior stakeholder ...

across multiple industries. Access professional development, including technical courses, certifications, mentoring, and coaching. Tech stack: AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement. Programming: Java, Python, Scala, Spark, SQL. Experience integrating and processing large-scale structured and unstructured datasets from ...

team Required Skills and Experience Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services ...

hands-on work expected). Key Responsibilities Lead, scale and develop multiple data engineering teams Own and deliver largescale data platform and pipeline initiatives (ETL/ELT) Define and implement data architecture aligned to AI and analytics strategy Partner with senior stakeholders across business and technology Drive data quality, governance ...

terms of learning milestones and certification pass rates. 3. Required Technical Background Legacy SQL Mastery: Deep understanding of SQL Server, T-SQL, and traditional ETL processes. Epic Ecosystem Knowledge: Familiarity with the Epic 3nd-tier architecture (Caché/IRIS, Clarity, Caboodle). Azure Infrastructure: Understanding of Azure SQL Managed Instances ...

issues. Key Responsibilities: Develop and maintain enterprise-grade Power BI reports, datasets, and data models (including star schemas and dimensional models). Lead ETL/ELT design and optimisation within Microsoft Fabric Lakehouse, including Data Pipelines, Notebooks, and cloud-based ingestion/transformation layers. Deliver complex SQL, Python, and PySpark ...

and integration levels, ensuring validation is integrated into CI/CD pipelines. Required Skills & Qualifications Data Testing : Proven experience testing data-intensive backend systems, ETL/ELT processes, and financial data feeds. SQL Mastery : Strong proficiency in relational databases, ideally Microsoft SQL Server , including writing and optimizing complex ...

and maintain data processing workloads using Python and PySpark, including notebook-based development where appropriate. Support the migration and modernisation of legacy databases and ETL processes to cloud-based architectures. Strong analytical and problem-solving skills with strong attention to detail Experienced Senior with mentorship and architectural experience The Benefits ...

Ensures high-quality, secure, and scalable data pipelines. Performs deep analytical work on diverse data sources and mentors junior Data Engineers. Design and develop ETL processes, database systems, and tools for real-time and offline analytics. Ensure data consistency and integrity; integrate large, complex datasets for business insights. Converts business ...

looking for from you: SQL technologies skills (e.g. MS SQL, Oracle...) noSQL technologies skills (e.g. MongoDB, InfluxDB, Neo4J...) Data exchange and processing skills (e.g. ETL, ESB, API...) Development (e.g. Python) skills Big data technologies knowledge (e.g. Hadoop stack) Knowledge in NLP (Natural Language Processing) Knowledge in OCR (Object Character Recognition ...