10 of 10 ETL Jobs in Newcastle upon Tyne

preferred) or Python Experience with Kafka, Flink, or Spark (Flink/Kafka ideal) Solid understanding of stream processing (event time, state, backpressure) Experience building ETL/ELT or real-time data pipelines Knowledge of microservices and distributed systems Tech & Cloud Experience with AWS, Azure, or GCP (AWS preferred) Familiarity with ...

such as Snowflake, BigQuery, Redshift, Databricks, Azure Synapse Experience of testing pipelines in things like Airflow, Azure Data Factory, AWS Glue, Kafka Data Concepts ETL/ELT, data modelling, data warehousing, data governance The role is 100% remote, however you must be based in the UK with the right ...

such as Snowflake, BigQuery, Redshift, Databricks, Azure Synapse Experience of testing pipelines in things like Airflow, Azure Data Factory, AWS Glue, Kafka Data Concepts ETL/ELT, data modelling, data warehousing, data governance The role is 100% remote, however you must be based in the UK with the right ...

looking for: Commercial experience in data engineering role Hands-on experience with tools such as Python, SQL, Spark/PySpark Understanding of data pipelines, ETL/ELT processes, and data storage solutions Exposure to data modelling and designing scalable data structures Background or grounding in software engineering principles Strong problem ...

data arriving from the landing zone into the Bronze layer, working in partnership with the Development and Application Management team. Design and optimise ETL/ELT pipeline frameworks using Databricks, Delta Lake and Azure Data Factory. Ensure Silver and Gold layer data products are fit for purpose for analytics, pricing … ensuring compliance with industry standards. Deep expertise in data modelling — conceptual, logical and physical. Data warehousing and data lake architecture for high‐performance analytics. ETL/ELT pipeline development and optimisation to support large‐scale data processing. Data integration across structured and unstructured sources, ensuring high availability. Metadata management and ...

and evolve data architecture, engineering standards, tools, and methodologies. Design scalable, secure, and resilient cloud-based data solutions. Oversee the implementation of data platforms, ETL/ELT pipelines, and analytical solutions. Ensure data services meet both functional and non-functional requirements, including security, performance, and scalability. Drive continuous improvement … Expertise Strong experience with AWS cloud services and modern data platforms. Expertise in designing and implementing scalable data architectures and engineering solutions. Experience with ETL/ELT frameworks, data integration, and pipeline automation. Strong understanding of data modelling, data warehousing, and transformation methodologies. Experience supporting data science and machine learning ...

solutions that enable client onboarding and migration to the clients platform, when new customers join. Key skills and experience needed: SQL T-SQL XML ETL SSMS/Visual Studio Excellent problem solving ability Ability to mentor team members The role has the advantage of a strong modernisation roadmap in place ...

knowledge and experience will you need? Experience bringing together data from lots of different systems, including real-time and batch processing Strong understanding of ETL/ELT tools and how data is extracted, transformed and loaded into platforms Knowledge of data warehousing, data lakes, reporting and analytics tools, and ...

and unstructured data from diverse sources. Ensure the data platform is fully documented, maintaining up-to-date information requirements, data models, data dictionaries, and ETL mappings. Collaborate with cross-functional teams, including system administrators, developers/engineers, external partners, and business stakeholders, to understand requirements and deliver solutions. Optimise solutions … with hands-on experience designing and delivering data pipelines using industry-standard tools and cloud technologies. Knowledge of data engineering concepts, data pipeline development, ETL processes, data lake and data warehousing technologies. Proficiency in working with at least one major cloud data platform Proficiency in Python for data engineering tasks ...

visual reports using Power BI Collaborate with stakeholders to understand their data needs Retrieve and analyse data from SQL Server databases using SQL queries Extract data from key systems outside of existing pipelines when required Support the development of data science capability within the organisation The Requirements Working within … data extraction and analysis Hands-on experience using Power BI Ability to communicate analytical concepts to non technical stakeholders Some knowledge of ETL processes and data warehousing would be a plus ...