151 to 175 of 196 ETL Jobs in the North of England

Senior Data Engineer (AWS) - Manchester (Senior Data Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data Engineer, Data Engineer) Our client is a global … enabling crucial business intelligence. We are seeking a Senior Data Engineer capable of taking ownership of designing, developing, and maintaining robust data pipelines and ETL processes using AWS services. You will also be contributing to Cloud migration and implementing architectural solutions, as well as ensuring data quality and integrity and ...

and support the development of other engineers. Key responsibilities Developing high-quality, production-ready Python applications and services Building and maintaining data pipelines, including ETL/ELT and batch/streaming workloads Working with cloud platforms including AWS, Azure or GCP Designing and integrating APIs, databases and data services Applying …/CD and automated testing Knowledge of databases and data processing Experience building or working with APIs, services or data pipelines Understanding of ETL/ELT and data engineering principles Experience with Terraform or another Infrastructure as Code tool Experience working in modern Agile engineering environments Strong communication skills and ...

experience leading,developingand managing Data Engineering teams. A strongtrack recordof designing and delivering enterprise-scale data platforms,solutionsand architectures. A thorough understanding of modern ETL/ELT practices and experience designing scalable,reliableand maintainable data pipelines. Advanced working knowledge of SQL and Python. Experience working with modern cloud data platforms … explain technical decisions,risksand trade-offs to both technical and non-technical audiences. Nice tohaveexperience: Experience integrating data with operational systems, including reverse ETL into platforms such as Salesforce. Understanding ofthe DataScience/Machine Learning lifecycle andMLOps. Experience using Infrastructure as Code approaches and tools such as Terraform or CloudFormation. ...

guarantee that our service delivery is second to none. What you will be doing Design, build, and maintain scalable and efficient data pipelines and ETL processes. Implement data engineering best practices and methodologies, ensuring data integrity, security, and quality. Work with structured and unstructured data sources, transforming them into valuable … SparkSQL) for data manipulation, transformation, and querying. Solid understanding and practical application of Data Vault and Kimball data modelling methodologies. Experience designing and optimising ETL/ELT workflows for large-scale data processing. Strong understanding of data governance, data security, and compliance best practices. Our values We understand that ...

hands-on, focusing on building, operating, and maintaining data services while mentoring team members. You will work across modern cloud stacks, design scalable ETL/ELT pipelines, and collaborate with analysts, scientists and stakeholders to unlock value from data. #J-18808-Ljbffr ...

interface de données. Excellentes capacités d’analyse et de communication. Compétences Conception de logiciels (architecture, UX/UI) Bases de données (SQL Server) reporting, ETL Méthodologies projet Rigoureux, impliqué et autonome Bonne expression écrite et orale Flexibilité pour travailler en télétravail ou au bureau Opportunités d’évolution Société internationale ...

overall vulnerability attack surface of the Bank. Leverage Python, SQL, and other languages/platforms to automate data ingestion, transformation, enrichment, and quality validation (ETL). Develop and maintain visualizations and reports in Power BI or MS‐Reporting Services (SSRS)/SQL Server Integration Services (SSIS) that support operational teams … Experience with SQL Server Integration Services (SSIS), including: DevOps integration, scripting tasks, packaging, deployment, and conditional workflows Hands on experience with data ingestion and ETL pipelines (batch and near real time) Python development experience used for automation, data processing, and integration Experience with SSRS, including subscriptions, report management, Tablix, matrix ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...

doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise data architecture, balancing scalability, performance, security and maintainability. Partner with stakeholders … PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions. Solid grounding in data architecture, modelling and modern data platform design. Cloud experience, preferably AWS, and familiarity with CI/CD and ...

native software solutions utilizing AWS services such as Lambda, ECS, RDS, S3, SQS, API Gateway, and CloudWatch. Design, develop, and maintain data pipelines and ETL workflows using technologies such as Glue, Spark/PySpark, Kafka, or similar platforms. Implement and maintain Infrastructure as Code (IaC) using Terraform or equivalent tools. … systems, APIs, and microservices architectures. Extensive experience developing cloud‐native applications and services within AWS environments. Strong background in data engineering, including data modeling, ETL development, pipeline design, and large‐scale data processing. Demonstrated experience building and deploying production‐grade AI agents and agentic systems that solve real‐world business ...

Finance, you'll turn business requirements into reliable data solutions and help shape how critical financial information flows through the organisation. Responsibilities: Build scalable ETL and ELT pipelines within AWS Develop and optimise data models in Amazon Redshift Create and manage workflows using Apache Airflow Integrate NetSuite and other Finance … experience Hands-on experience with AWS data services Amazon Redshift or comparable cloud data-warehouse experience Apache Airflow or similar orchestration experience Strong ETL/ELT, data-modelling and production pipeline knowledge The confidence to work directly with Finance and technical stakeholders Experience with NetSuite, ERP integration or financial data ...

Data QA strategy across our data platforms and products. Designing and introducing scalable automated testing frameworks for data solutions. Developing testing approaches for ETL/ELT pipelines, data transformations, and integrations. Creating and maintaining robust test data strategies and test scenarios. Working closely with Data Engineering teams to embed quality … practices. About you Significant experience in Data QA, Data Testing, Quality Engineering, or SDET roles. Strong experience testing modern data platforms, data pipelines, and ETL/ELT processes. Excellent SQL skills with the ability to interrogate, validate, and troubleshoot complex datasets. Experience building and implementing test automation frameworks. Strong understanding ...

initiatives, specifically enterprise adoption of Generative and Agentic AI workflows (e.g., Claude, ChatGPT, Cursor, n8n). Preferred/Desirable Qualifications Expertise in Data Productivity & ETL/ELT: Direct knowledge of Matillion’s Data Productivity Cloud/Matillion ETL, or primary competitive data integration platforms. Big Data & Analytics Ecosystems: Experience with ...

Finance, you'll turn business requirements into reliable data solutions and help shape how critical financial information flows through the organisation. Responsibilities: Build scalable ETL and ELT pipelines within AWS Develop and optimise data models in Amazon Redshift Create and manage workflows using Apache Airflow Integrate NetSuite and other Finance … experience Hands‐on experience with AWS data services Amazon Redshift or comparable cloud data‐warehouse experience Apache Airflow or similar orchestration experience Strong ETL/ELT, data‐modelling and production pipeline knowledge The confidence to work directly with Finance and technical stakeholders Experience with NetSuite, ERP integration or financial data ...

across the organisation. You'll work closely with technical and business stakeholders to build high-performing data pipelines, ensure data quality, and deliver reliable ETL processes. This role requires someone who can provide technical leadership, contribute to key architectural decisions, and collaborate effectively across multiple teams while mentoring junior engineers. … Responsibilities Design, develop, and maintain scalable data engineering solutions. Build and optimise data pipelines to support large-scale data processing. Implement ETL processes to migrate, transform, and deploy data across multiple platforms. Ensure the quality, accuracy, and reliability of data across the estate. Collaborate with cross-functional teams to understand ...

across the organisation. You'll work closely with technical and business stakeholders to build high-performing data pipelines, ensure data quality, and deliver reliable ETL processes. This role requires someone who can provide technical leadership, contribute to key architectural decisions, and collaborate effectively across multiple teams while mentoring junior engineers. … Responsibilities Design, develop, and maintain scalable data engineering solutions. Build and optimise data pipelines to support large-scale data processing. Implement ETL processes to migrate, transform, and deploy data across multiple platforms. Ensure the quality, accuracy, and reliability of data across the estate. Collaborate with cross-functional teams to understand ...

enjoys solving problems, working with data and collaborating with different teams to deliver effective solutions. Were looking for a Data Engineer with experience in ETL, databases, data warehousing and APIs, along with strong analytical and problem-solving skills. Whats in it for you? Join a company that offers excellent benefits … data and relevant qualifications or certifications in data integration, data management or cloud technologies , wed love to hear from you. Key skills: Experience with ETL and data integration technologies Strong database and data warehousing knowledge Experience with APIs and cloud technologies Excellent problem-solving and analytical skills Strong attention ...

working model Active SC required Up to £75k DoE + 6% pension, 30 days leave Experience required in Python, AWS, Git, CI/CD, ETL, Data Pipelines, IaC Role Opportunity Join a growing public sector technology consultancy delivering digital, data and technology transformation across central government. You'll take … Responsibilities: Build and maintain scalable data platforms, pipelines and services. Develop robust Python-based data solutions using modern engineering practices. Deliver batch, streaming, ETL/ELT and data transformation solutions. Implement CI/CD, IaC and DataOps across production environments. Translate client requirements into technical solutions and measurable outcomes. Provide ...

play a key role in supporting commercial modelling, pricing and underwriting teams. This role would suit someone with strong experience in data engineering, ETL processes, reporting and analytics, who is keen to develop their technical skills in a rapidly evolving data environment including AI. You'll have demonstratable experience working … join a central and highly visible team responsible for delivering innovative and effective data solutions across the business. The role focuses on ETL development, reporting and data analysis ensuring data is accurate, timely and fit for purpose. You will have a strong understanding of data governance and GDPR. Working closely ...

growing digital and data function based in central Leeds. This exciting opportunity will suit a talented data professional with strong experience across SQL Server, ETL, Data warehousing and modern data platform technologies. You will be joining an established data function of 18 professionals supporting a £650 million revenue organisation with … Hybrid (2 days in office) 15% Pension Private Healthcare Microsoft Certifications Lead SQL Developer Key skills SQL Server/SQL Data Warehousing ETL/ELT Processes Queries, stored procedures, scripts and database objects Data Reporting Microsoft Fabric Azure Data Factory Dataflows Data Lakehouse or Warehouse solutions Python Source Control ...

growing digital and data function based in central Leeds. This exciting opportunity will suit a talented data professional with strong experience across SQL Server, ETL, Data warehousing and modern data platform technologies. You will be joining an established data function of 18 professionals supporting a £650 million revenue organisation with … and professional development, including fully subsidised Microsoft certifications (DP-600/700 etc) Lead SQL Developer Key skills: * SQL Server/SQL * Data Warehousing * ETL/ELT Processes * Queries, stored procedures, scripts and database objects * Data Reporting * Microsoft Fabric * Azure Data Factory * Dataflows * Data Lakehouse or Warehouse solutions * Python * Source ...

will do Design, develop, and maintain reliable data ingestion and transformation pipelines Process time-series, event, telemetry, and operational datasets Build and operate ETL and ELT workflows Extract data from heterogeneous, incomplete, or sensitive sources Transform raw data into reliable, documented, and usable data models Maintain production data pipelines and … development skills Strong understanding of data modelling and data analysis Experience operating large time-series and/or event datasets Experience designing and operating ETL or ELT pipelines Experience working with data ingestion, transformation, storage, and delivery Experience diagnosing and resolving failures in production data systems Experience building dashboards, alerts ...

future of the organisation’s data capabilities. Key Responsibilities Design and develop scalable AWS-based data lake and data warehouse solutions Build and optimise ETL/ELT pipelines using Python and SQL Migrate data from legacy SQL environments into a cloud-native architecture Essential Skills SQL and Python Hands … experience with: Amazon S3 AWS Glue Amazon Redshift AWS Lambda Athena Data warehouse and data lake design experience ETL/ELT development and optimisation Data migration and integration expertise #J-18808-Ljbffr ...

role focuses on developing, implementing, and maintaining robust business intelligence solutions. You will utilise strong SQL expertise and knowledge of data structures to manage ETL processes for data analysis and reporting. You will also use SSRS and Power BI to design visually compelling, interactive dashboards that empower leadership to make … informed decisions. Key Responsibilities Gather business requirements and design technical BI solutions. Build and manage end-to-end ETL pipelines using SQL and SSIS. Develop data models to ensure efficient data storage and retrieval. Create and maintain interactive reports and dashboards in Power BI and SSRS. Troubleshoot data integrity, system ...

play a key role in supporting commercial modelling, pricing and underwriting teams. This role would suit someone with strong experience in data engineering, ETL processes, reporting and analytics, who is keen to develop their technical skills in a rapidly evolving data environment. You'll be comfortable working with a variety … join a central and highly visible team responsible for delivering innovative and effective data solutions across the business. The role focuses on ETL development, reporting and data analysis using tools such as Alteryx, Tableau and SQL, ensuring data is accurate, timely and fit for purpose. Working closely with pricing, underwriting ...