18 of 18 Permanent ETL Jobs in the North East

with Databricks and Delta Lakehouse architectures.Programming: Proficient in Python, Scala, and SQL for data engineering tasks.ETL Processes: Demonstrated expertise in designing, building, and maintaining ETL processes.Data Modelling: Experience in logical and physical data modelling with large datasets.Problem Solving: Strong analytical and problem-solving skills, with a focus on troubleshooting data ...

practices Skills & Experience * 3+ years' commercial experience in Data Engineering * Strong Java or Python development skills * Experience with Kafka, Flink or Spark * Experience building ETL/ELT or streaming data pipelines * Knowledge of AWS (Azure or GCP also considered) * Experience with Docker, Kubernetes and CI/CD tools * Familiarity with ...

knowledge and collaborate with colleagues in an agile engineering setting. Essential Skills & Experience Strong experience in data engineering, including Python. Experience working with AWS ETL services. Experience querying and managing data held within AWS S3 Experience managing API integrations and database connectivity. Familiarity with GitLab or similar source control and ...

business teams to deliver reliable data solutions. Participating in code reviews and continuous improvement initiatives. What We're Looking For Experience in data engineering, ETL development or data platform delivery. Strong programming skills in Java or Python. Exposure to modern data technologies such as Kafka, Spark or Flink. Experience working ...

performance management systems.Knowledge of Infor, Power BI, SQL, data warehouses, or reporting tools.Experience supporting finance transformation or systems implementation projects.Understanding of data mapping, ETL processes, and financial controls.Experience of working within a multi-site or retail environment.Knowledge of systems such as Pinewood, Keyloop, OneStream, Coupa or similar enterprise platforms.Core Benefits ...

Kafka, Flink, Spark Solid understanding of stream processing concepts Understanding of software engineering best practices: testing, design patterns, CI/CD, Git. Experience building ETL/ELT or streaming data pipelines. Exposure to microservices and distributed system concepts. Experience working with cloud platforms Understanding of distributed compute, large-scale data ...

master data, data quality and stewardship practices.Experience of working with modern cloud-based data platforms (e.g. Azure, Microsoft Fabric, Databricks) and data integration approaches (ETL/ELT).Strong stakeholder engagement skills, with the ability to influence senior leaders and translate complex business needs into practical data solutions.Proven ability to lead ...

experience with AWS * you are proficient in SQL and able to optimise complex queries * you have a solid understanding of data modelling concepts and ETL processes * you are familiar with Python or similar programming languages for data manipulation * you enjoy working collaboratively, and communicating clearly and professionally.This position ...

experience with AWS * you are proficient in SQL and able to optimise complex queries * you have a solid understanding of data modelling concepts and ETL processes * you are familiar with Python or similar programming languages for data manipulation * you enjoy working collaboratively, and communicating clearly and professionally.This position ...

processing, business intelligence, and integration with web and financial applications. Design and implement scalable data solutions for finance applications, including optimised data models and ETL (extract, transform, load) pipelines to ensure efficient data processing, storage, and reporting. Testing and Troubleshooting: collaborate with business partners and testers to define, coordinate, and ...

stakeholders, you'll play a key role in the ongoing evolution of the company's Azure-based data estate. Key Responsibilities Build and maintain ETL/ELT data pipelines Integrate data from multiple systems and external providers Develop scalable and reliable data models Improve monitoring, testing, and platform performance Support … Skills Strong SQL development skills Experience with Python or a similar programming language Data engineering or data integration experience Understanding of data modelling and ETL/ELT concepts Experience implementing data validation and testing processes Strong communication and stakeholder engagement skills Desirable Skills Azure Data Factory Databricks Synapse Analytics Microsoft ...

modern data engineering practices, cloud technologies, data modelling, and platform development, with plenty of opportunities for learning and progression. Key Responsibilities Build and support ETL/ELT data pipelines using modern cloud technologies. Assist with integrating and transforming data from multiple business systems. Help maintain a scalable, secure, and reliable … related subject, or equivalent commercial experience. Good SQL skills and experience with Python or another programming language. Understanding of databases, data modelling, and ETL/ELT concepts. Interest in cloud data technologies and modern data platforms. Exposure to Azure, Microsoft Fabric, Databricks, Data Factory, or similar technologies would be advantageous. ...

that power reporting, dashboards and self-service analytics across the business. Working closely with BI Developers and business stakeholders, you'll design and optimise ETL/ELT pipelines, develop curated data models, and translate business requirements into reliable backend data solutions. This is a fantastic opportunity for someone who enjoys … and wants to work with modern cloud technologies in a collaborative, forward-thinking environment. What you'll be doing Design, build and maintain scalable ETL/ELT pipelines that deliver reliable, high-quality data. Develop curated, business-ready datasets that support reporting, dashboards and self-service analytics. Optimise data models ...

/CD delivery practices. Ability to optimise data processing, storage, and queries to improve performance and data quality. Experience designing and automating ETL pipelines using PySpark and Spark SQL.A strong full stack development background with technologies that include .NET 4,8, C#, JavaScript, C++ and Java. You and your role … will design, build, maintain, and optimise scalable data products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with ...

Oversee test planning, execution, and reporting aligned with the Test strategy. - Defect Management: Manage defect lifecycle and ensure timely resolution and reporting. - Database/ETL Testing: Perform thorough testing of database systems and ETL processes to ensure data accuracy and reliability.QualificationsRequired Skills & Experience: - Proven experience in leading testing teams and … and leadership skills, with the ability to influence and mentor others. - Experience in Agile and DevOps environments. - AI tooling experience. - Expertise in database and ETL testing. - Familiarity with test management and defect tracking tools. - SC eligible preferred Additional InformationWhy Version 1 At Version 1, we believe in providing our employees ...

join our Debt Solutions team and help shape the future of data at DWP. You'll need experience of SQL-based data transformation, ETL pipeline development, and building user-facing dashboards and reports Our DWP Digital teams use fresh ideas and leading-edge tech to build and maintain digital solutions …/CD delivery practices. Ability to optimise data processing, storage, and queries to improve performance and data quality. Experience designing and automating ETL pipelines using PySpark and Spark SQL.A strong full stack development background with technologies that include .NET 4,8, C#, JavaScript, C++ and Java. You and your role ...

based predominantly onsite in Newcastle, working closely with colleagues across technology and the wider business. Key Responsibilities Design, build and optimise data pipelines and ETL processes. Lead complex data migration and integration initiatives across multiple platforms. Cleanse, transform and improve data quality within enterprise systems. Work closely with business stakeholders … internal capability. Collaborate with technical and non-technical teams to deliver business-critical projects. Candidate Profile Design, build and optimise data pipelines and ETL processes. Lead complex data migration and integration initiatives across multiple platforms. Cleanse, transform and improve data quality within enterprise systems. Work closely with business stakeholders ...

stakeholders, helping to interpret and resolve complex data processing, data handling and technical support problems.Manage the delivery of Nomis data extraction, transformation and loading (ETL) pipelines, including modifying data processing routines, to a high standard.Provide the best possible service by continually reviewing what is required from colleagues, data suppliers and … and activities using appropriate techniques, tools and testing procedures to deliver agreed objectives and solve any problems which you encounter.Schedule and monitor data processing (ETL), dataset release and related update activities.Seek feedback from colleagues, data suppliers and Nomis customers so that the service is being planned and adapted to meet ...