1 to 25 of 29 ETL Jobs in Manchester

data pipelines within Microsoft Fabric (Data Pipelines, Dataflows, OneLake, Lakehouse) Support the migration from SAP BW into a Fabric-based architecture Develop and optimise ETL/ELT processes using Fabric and/or Azure Data Factory Build and maintain scalable data models to support reporting and analytics Contribute ...

Google Deployment Manager) and DevOps practices, and familiarity with networking, security and identity management for AI Use Cases.* Modern Data Patterns: Solid understanding of ETL/ELT processes and modern architecture patterns such as Data Mesh and Data Fabric.* Migration & Transformation: Experience migrating legacy systems to cloud-native data stores. ...

3+ years Databricks experience (PySpark, Delta Lake, notebooks) 2+ years Python Experience Experience working with data warehouses and structured modelling concepts Strong understanding of ETL/ELT practices and data centric engineering Desirable Exposure to metadata driven or config driven engineering practices Basic PySpark optimisation or Delta Lake performance tuning ...

level deployments and licensing strategy. Solid knowledge of Azure data stack : Azure Data Factory, Data Lake, Azure SQL, and data warehousing. Ability to design ETL/ELT pipelines using visual tooling to move and transform data efficiently. Strong SQL and data modelling skills , with experience turning document-based databases (like ...

application to our client in conjunction with this vacancy only. KEY SKILLS Data Engineering, Databricks, Apache Spark, PySpark, SQL, Python, Kafka, AWS, Delta Lake, ETL, Data Pipelines, CI/CD, Big Data ...

strategic goals. What will make you successful? Extensive experience as an Enterprise Data Architect in a complex, regulated environment. Deep knowledge of data modelling, ETL, data warehousing, and cloud platforms (Azure, AWS, or GCP). Strong understanding of data governance, MDM, and regulatory compliance. Familiarity with aviation systems (e.g., AODB ...

quality frameworks and governance principles Experience working with data lifecycles, retention and compliance Ability to work closely with technical teams, comfortable discussing data models, ETL and workflows Strong stakeholder management, confident, proactive and able to own conversations Analytical mindset with experience investigating and resolving data issues Tech & Tools: SQL and ...

core components of platforms, collaborate with data scientists, delivery leads, and mentor more junior engineers. What You’ll Be Doing Design and implement scalable ETL/ELT pipelines and data models for enterprise platforms Build and operate event‐driven architectures (Kafka) and orchestrate workflows (Airflow) Implement data quality, testing and ...

projects, building scalable data platforms that support clinical insights, product development, and operational efficiency. Key Responsibilities Design, build, and maintain robust data pipelines and ETL/ELT processes Integrate data from a variety of sources including clinical systems, APIs, and third-party providers Collaborate with data scientists, analysts, and product ...

hands-on work expected). Key Responsibilities Lead, scale and develop multiple data engineering teams Own and deliver largescale data platform and pipeline initiatives (ETL/ELT) Define and implement data architecture aligned to AI and analytics strategy Partner with senior stakeholders across business and technology Drive data quality, governance ...

Expertise: 1-3 years of experience in Data Governance, MDM, or lifecycle management. Concepts: Strong understanding of Data Warehouse vs. Data Lake architectures and ETL workflows. Communication: Ability to translate technical data issues into actionable business insights for senior stakeholders. Randstad Technologies is acting as an Employment Business in relation ...

data scientists, and stakeholders to ensure data is accessible, reliable, and optimised for business use. Key Responsibilities Develop and maintain robust data pipelines and ETL processes Work with large datasets to ensure data quality, integrity, and performance Collaborate with cross-functional teams to support data-driven decision-making Optimise and ...

data sources. Stakeholder collaboration : Turning business questions into clear, actionable insights. Desired Skills Experience with SQL, PLSQL, Python or other scripting languages. Knowledge of ETL processes or data transformation concepts. Familiarity with IFS or other ERP systems. An interest in data-driven technology environments. Desired Experience Strong Excel skills and ...

skills for querying, transformation, and optimisation Experience with Apache Spark or serverless architectures Core responsibilities and skills Build and maintain real-time and batch ETL pipelines using Python on large, complex datasets Write clean, scalable Python code for data ingestion, transformation, and processing Design and optimise SQL queries for performance ...

Data Warehousing Developer or Business Intelligence Developer. Knowledge, Training & Experience Essential Advanced experience of Azure infrastructure or other cloud computing platforms, including Data Factory, ETL processes, Databricks and Data Lake technologies Advanced knowledge of Azure infrastructure or other cloud computing platforms, including Data Factory, ETL processes, Databricks and Data Lake … Advanced knowledge of Microsoft SQL Server (Indexes, Performance tuning & query optimization, complex Stored procedures/views/functions) Knowledge of supporting & developing Microsoft Azure ETL pipeline solutions, triggers, connections/data lake, data bricks, power apps/automate. Experience of supervising/mentoring junior members of the team. Desirable Experience ...

Responsibilities • Define and implement data architectures aligned with organisational and enterprise-wide strategies. • Develop and maintain architecture artefacts, including entity relationship models, data dictionaries, ETL/ELT definitions, and data lineage models. • Act as a trusted advisor to clients, taking ownership of architectural decisions and solution design rationale. • Establish governance … systems to cloud-based architectures. • Knowledge of OLTP and OLAP systems and their implementation. • Experience developing and managing entity relationship models, data dictionaries, and ETL/ELT processes. • Strong SQL proficiency; familiarity with SQL Server tools (SSMS, SSIS, SSRS) is advantageous. • Experience with data visualisation tools such as Power ...

enabling data-driven decision-making across operations. Ideal candidates will have extensive experience in a regulated environment and strong knowledge of data modelling and ETL processes. The position offers hybrid working arrangements and benefits like free parking and subsidised transport. #J-18808-Ljbffr ...

Description Role: Database Engineer Salary: £45,000 - £50,000 depending on experience. Technology - SQL, ETL, SQL Server Location: Wigan Working Pattern: Hybrid - 3 days a week in the office. The Role: In the short term, the successful candidate will take ownership of modernising legacy application databases. This will involve designing ...

platform, contributing to shared tooling, best practice, and mentoring more junior engineers where needed. Key Responsibilities Design, build, and maintain scalable data pipelines and ETL processes using AWS services including Glue, Lambda, and S3. Support the migration of an existing data warehouse into AWS and Redshift. Design and implement data … pipeline development. Hands-on experience with AWS, particularly Glue, Lambda, and S3. Strong SQL skills and experience working with data warehouses. Solid understanding of ETL/ELT design and data pipeline optimisation. Experience with big data frameworks such as Apache Spark, and exposure to streaming technologies like Kafka. Strong problem ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...

industry. THE ROLE As a Senior Data Engineer, you will sit within a high calibre data engineering team, owning and evolving core ETL pipelines that underpin the entire data platform. The focus is on building reliable, well-modelled data assets that can scale with the business. Specifically, you can expect … involved in the following: ETL pipelines for data ingestion and data modelling Using AWS to store and process data, with Snowflake as the data warehouse Use of Python and SQL Data orchestration and use of Terraform SKILLS AND EXPERIENCE The successful Senior Data Engineer will have the following skills and ...

Data & SQL Write and optimise MS SQL queries, stored procedures, and views to support automation logic and data transformations Work with relational databases to extract, validate, and manipulate data for workflow use Ensure data integrity and consistency across integrated systems Technical Delivery & Support Translate functional and financial requirements into robust …/SOAP), object and dimension structures, and financial data flows (AP, AR, GL, Projects, etc.) Familiarity with financial processes and accounting principles Exposure to ETL tools or data integration platforms Knowledge of cloud platforms (Azure, AWS) and modern integration patterns Experience with version control and deployment pipelines for automation assets ...

and data products as a Senior Data Engineer. • Own the full data product lifecycle, from initial design through to decommissioning. • Build and maintain robust ETL/ELT pipelines using SQL, Python, and modern tooling. • Collaborate closely with product managers, architects, and engineers to solve complex technical and business challenges. … strong preference for GCP (BigQuery), within a Data Mesh architecture. Key Requirements: • 5+ years’ experience as a Data Engineer with a strong focus on ETL/ELT. • Advanced SQL and Python development skills. • Hands-on experience with DBT, GIT, Terraform, Docker, IAM, and Airflow (Composer). • Proven experience working ...

focused roles Responsibilities: You will play a key role in maintaining and evolving our Microsoft SQL Server-based environment, supporting data migrations, building and optimizing ETL processes, and ensuring data is reliable, secure, and performant for downstream analytics, software … and reporting. Support database migrations, upgrades, and schema changes with minimal downtime Design, build, and maintain robust ETL/ELT pipelines to ingest, transform, and load data from multiple sources Maintain and Support SSRS reporting solutions and infrastructure Maintain and Support Power BI datasets, Document data flows, schemas, transformations, and ...

and processes. Responsibilities: You will play a key role in maintaining and evolving our Microsoft SQL Server-based environment, supporting data migrations, building and optimizing ETL processes, and ensuring data is reliable, secure, and performant for downstream analytics, software and reporting. … Lead and support database migrations, upgrades, and schema changes with minimal downtime Design, build, and maintain robust ETL/ELT pipelines to ingest, transform, and load data from multiple sources Perform database maintenance activities, including restores, indexing, patching, monitoring, replication, migrations, and performance tuning Maintain and Support SSRS reporting solutions ...