10 of 10 ETL Jobs in Newcastle upon Tyne

data is accessible, reliable and delivered efficiently across the organisation. Key Responsibilities Design, build and maintain scalable and reliable data pipelines. Develop and support ETL/ELT processes for ingesting and transforming data from multiple sources. Enhance and maintain cloud-based data infrastructure within AWS. Monitor, troubleshoot and optimise data ...

migration to Microsoft Fabric. Required Skills Experience with Apache Airflow. Strong Azure SQL skills. Power BI development and data modelling experience. Good understanding of ETL/ELT processes and data warehousing concepts. Strong communication skills and the ability to work with both technical and non-technical stakeholders. Adaptable, hands ...

practices Skills & Experience * 3+ years' commercial experience in Data Engineering * Strong Java or Python development skills * Experience with Kafka, Flink or Spark * Experience building ETL/ELT or streaming data pipelines * Knowledge of AWS (Azure or GCP also considered) * Experience with Docker, Kubernetes and CI/CD tools * Familiarity with ...

improvement and best practice adoption across the team Skills and Experience Previous experience working as a Data Engineer Strong understanding of data engineering principles, ETL processes and data warehousing concepts Experience using workflow orchestration tools such as Airflow to schedule, monitor and manage data pipelines Experience working with at least ...

Kafka, Flink, Spark Solid understanding of stream processing concepts Understanding of software engineering best practices: testing, design patterns, CI/CD, Git. Experience building ETL/ELT or streaming data pipelines. Exposure to microservices and distributed system concepts. Experience working with cloud platforms Understanding of distributed compute, large-scale data ...

Kafka, Flink, Spark Solid understanding of stream processing concepts Understanding of software engineering best practices: testing, design patterns, CI/CD, Git. Experience building ETL/ELT or streaming data pipelines. Exposure to microservices and distributed system concepts. Experience working with cloud platforms Understanding of distributed compute, large-scale data ...

Microsoft's fastest-growing data platforms, this is a fantastic opportunity. You Will Work With Designing, building and maintaining scalable data pipelines. Developing ETL/ELT processes to ingest and transform data from multiple sources. Apache Airflow for workflow orchestration, scheduling and automation. Azure SQL and cloud-based data platforms. … Excellent opportunity for a Data Engineer looking to develop towards a more senior position over time. Key Experience Previous experience in a Data Engineer, ETL Developer or similar role. Strong SQL skills, ideally within Azure SQL or SQL Server environments. Experience building, maintaining and optimising data pipelines. Knowledge of ETL ...

and evolve data architecture, engineering standards, tools, and methodologies. Design scalable, secure, and resilient cloud-based data solutions. Oversee the implementation of data platforms, ETL/ELT pipelines, and analytical solutions. Ensure data services meet both functional and non-functional requirements, including security, performance, and scalability. Drive continuous improvement … Expertise Strong experience with AWS cloud services and modern data platforms. Expertise in designing and implementing scalable data architectures and engineering solutions. Experience with ETL/ELT frameworks, data integration, and pipeline automation. Strong understanding of data modelling, data warehousing, and transformation methodologies. Experience supporting data science and machine learning ...

together multiple business systems Developing and supporting a Microsoft-based enterprise data lake Designing and maintaining MS SQL databases and related data systems Building ETL and data transformation solutions using Databricks and Azure Data Factory Developing cloud-based data solutions across Azure and AWS Ensuring the quality, integrity and reliability … from home The Person: Senior-level Data Engineering experience Expert SQL knowledge Extensive experience with Microsoft SQL Server Strong experience with Databricks Experience building ETL pipelines using Azure Data Factory or similar tools Hands-on experience working across both Azure and AWS Programming knowledge using Python, Java, C# ...

based tooling. Manage AWS infrastructure supporting a mix of React Front End applications, microservices, AWS Lambda functions, and Kafka event integrations. Support integrations involving ETL processes and Robotic Process Automation (RPA) solutions. Implement and manage secure networking patterns, including AWS Transit Gateway and PrivateLink where required. Support the deployment and … governance and FinOps practices, including resource tagging standards. Strong troubleshooting and problem-solving skills. Experience working within Agile delivery teams. Desirable Skills Experience supporting ETL pipelines and data integration solutions. Exposure to Robotic Process Automation (RPA) platforms. Experience delivering services within UK Government or highly regulated environments. Familiarity with accessibility ...