1 to 25 of 28 ETL Jobs in Newport

principles are followed throughout. In this role, you will be responsible for: Designing and delivering end‐to‐end data solutions Building and maintaining scalable ETL pipelines and cloud‐based data platforms using Microsoft Azure technologies. Leading workshops, capturing requirements and communicating confidently with both technical and non‐technical stakeholders. Creating ...

translate business requirements into robust technical architectures, ensuring best practices in data governance, security, and performance. Key Responsibilities Design and optimise data pipelines and ETL processes using Azure Data Factory and Databricks. Develop and maintain data models, transformations, and integrations across multiple systems. Collaborate with client teams to deliver high ...

best practises, including data security, data quality and data lineage. Other requirements include: Comfortable working in Microsoft Stack (Fabric, Azure, Power BI) Knowledge of ETL processes, semantic layers and tools like DBT Proficiency in Python for data manipulation and automation Ability to challenge assumptions and educate senior staff on data ...

Terraform, AWS CodePipeline), and integration with databases such as SQL Server, PostgreSQL, Oracle, Redshift, and Synapse Strong hands-on background in building and optimising ETL/ELT pipelines using modern tooling and best practices Proficiency in reporting tools such as Power BI, Tableau, and QlikView Let's connect for more ...

helping make it better. Must have — strong practical experience in most of: Python for data workflows and automation Advanced SQL (optimisation, analytical functions, modelling) ETL/ELT pipeline design, build, and orchestration Docker and containerisation Cloud environments (Azure, AWS, or GCP) Version control (Git) Bonus points for: Airflow, Prefect ...

Doing Designing and building a greenfield data architecture from scratch Creating scalable data pipelines for large, text-heavy and unstructured datasets Building ETL/ELT workflows that produce AI-ready datasets Implementing dataset versioning, reproducibility and data lifecycle management Supporting AI teams with training, validation and test data splits Embedding ...

conscience of the programme - reviewing architecture, data models, pipelines, and design decisions Support development of data pipelines, Fabric workloads, and Power BI integration Validate ETL/ELT processes, migrated datasets, and performance optimisation approaches Ensure data governance, security, privacy, and quality standards are embedded from day one Confidently challenge vendors ...

Python for data engineering tasks hands-on experience with cloud platforms – AWS or GCP is essential, both would be highly beneficial Deep understanding of ETL/ELT processes and data pipeline development Strong problem-solving skills and the ability to work independently in remote settings Excellent communication skills and ...

frameworks (TensorFlow, PyTorch, scikit-learn, etc.) - DevOps practices, CI/CD, IaC, Docker, Kubernetes - Version control (Git) and collaborative development tools - Data engineering and ETL workflows - Monitoring/logging tools (Prometheus, Grafana, ELK, etc.) - Cloud platforms (AWS, Azure, Google Cloud) with focus on Google Cloud - Strong analytical, problem-solving, communication ...

deliver and maintain robust data solutions. Support data modelling and warehousing activities using best practices in schema design and data governance. Contribute to ETL/ELT development, testing, and automation using tools such as Python, SQL, Airflow, or Azure Data Factory. Collaborate closely with analysts, scientists, and architects to ensure … Clearance (or 5+ years UK residency. Desirable Skills & Exposure Familiarity with data lakes, warehouses, or streaming architectures (e.g. Databricks, Spark, Kafka). Experience with ETL tools, orchestration frameworks, or automation pipelines. Understanding of version control and CI/CD (e.g. GitHub, Azure DevOps). Awareness of data governance, lineage, and ...

handover and audit readiness. • Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. • Experience with additional data processing and ETL tools like Apache Kafka, Spark, or Hadoop. • Familiarity with containerization and orchestration tools such as Docker and Kubernetes. • Experience with monitoring and alerting tools such ...

analytic databases Excellent verbal and written communication skills; able to convey technical details to non-technical audiences Previous technical experience within the following; SQL, ETL & PowerBI Ideally worked within SaaS based organisations ...

. Hands-on development experience: Apex, SOQL, Flows, APIs. Experience managing or implementing Salesforce Data Cloud (CDP) or a similar CDP. Strong background in ETL/ELT, SQL, API integrations, and data pipelines. Experience integrating sales & marketing tools High literacy in data: schemas, transformations, deduplication, identity resolution. Comfortable translating ...

part of a team that ensures our data infrastructure is robust, efficient, and continuously evolving. Key responsibilities include: Designing, developing, and maintaining ETL processes Writing and optimising complex queries for data extraction and transformation Supporting BAU data operations and ensuring consistent data delivery Creating and managing reports Developing analytical models ...

data warehousing and data engineering to our clients and internal team. We're tech-agnostic, so we work with a range of cloud, ETL/ELT, data warehouse, BI + AI tools (eg Azure, AWS, GCP, Databricks, Fabric, Snowflake, Redshift...) § Evidence that you're an AI-advocate and experiment with ...

Integration architecture Event-driven architecture patterns (distributed design patterns more generally is an advantage) API design, management, and governance Extensive experience improving and optimising ETL processes, presumably using IPaaS tooling Data architecture Data modelling, cataloguing, and associated governance Data lakes, distributed storage Metadata management Cloud & Platform Architecture Proficient ...

Server, MySQL) to support scalable data architectures. Leverage BI tools like Power BI and Tableau for data visualisation and reporting. Collaborate on ETL and data engineering tasks, ensuring efficient data transformations with SQL, Excel, and DevOps tools. Support teams in utilizing JIRA, Visual Studio, and Office Suite for project management … experience with Databricks, Azure, Data Factory, Synapse, and ADLS. Experience with R & Shiny Proficient with BI/data analytics tools (Power BI, Tableau) and ETL/data engineering. Advanced SQL skills, with experience in SQL Server and MySQL. Familiar with DevOps practices and project management tools like JIRA and Visual ...

collaborate with internal stakeholders and external partners to deliver high-quality data for analytics, reporting, and decision-making. Key Responsibilities Develop and maintain automated ETL pipelines for data cleansing, transformation, and validation. Design and implement hybrid data ingestion strategies (batch, incremental, real-time). Contribute to unified data models and … knowledge transfer sessions. What We're Looking For Proven experience in data engineering, ideally with cloud platforms (Snowflake preferred). Strong understanding of ETL processes, data modelling, and integration from multiple sources. Familiarity with BI tools (PowerBI, Tableau) and data visualisation. Knowledge of data governance and compliance frameworks. Excellent collaboration ...

Modeling SaaS/Cloud architectures Oracle database architecture Architecting and tuning integrations (with products like Oracle Integration Cloud, Boomi, Mulesoft, Celigo, Workato or Snaplogic) ETL tools and techniques Experience in the following areas are desired: Software development life-cycles (SDLC) Release management and/or Agile scrum master experience Developing ...

work closely with client services, strategy and digital colleagues to build and maintain data pipelines and architecture, including data dictionaries, databases, and ETL processes using tools such as Adverity and BigQuery. You'll also help design and QA bespoke dashboards, maintain data integrity, and ensure consistent, clean, and accurate data ...

both technical and executive audiences, whether impromptu on a whiteboard or using presentations and demos Understanding of complete data analytics stack and workflow, from ETL to data platform design to BI and analytics tools Extensive hands-on expertise with SQL and SQL analytics and scripting languages like Python, Bash, Shell … Business Objects, Tableau) Experience and understanding of large-scale infrastructure-as-a-service platforms (e.g. Amazon AWS, Microsoft Azure, GCP, OpenStack, etc.) Experience implementing ETL pipelines using custom, packaged tools and software development experience using C/C++, Java etc. SnowPro Core Certification ...

Data Scientist (GIS) - Remote (Data Scientist, Data Science, Data Analyst, Data Analysis, ETL, Sparse data, Spatial data processing, QGIS, Spatial data storage, PostGIS, Jupyter notebooks, Python, Azure Data Factory, Cosmos DB, PostgreSQL, Statistics, Data Analytics, C# .NET, Data Scientist, Data Science, Data Analyst, Data Analysis) Our client is a prestigious … last 12 months. They are looking for a Data Scientist with a strong GIS focus to be responsible for analysing large datasets to extract actionable insights, build predictive models and develop data-driven solutions to complex problems. You will play a major part in data visualization, statistical analysis and collaboration ...

play a pivotal role in delivering innovative, data-driven solutions for high-profile government clients. You'll be responsible for designing and implementing robust ETL pipelines, leveraging cutting-edge big data technologies, and driving excellence in cloud-based data engineering. This role offers the opportunity to work with leading technologies … collaborate with data architects and scientists, and make a significant impact in a fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure ...

through personally developed code, solution architectures and implementation recommendations Act as a trusted advisor to customer executive leadership for thought leadership and solution approaches Extract business requirements from customers and translate them into a well-architected recommendation Develop and provide forward looking guidance and future state roadmaps Leverage known best … lead role for analytics projects for large enterprises Experience implementing and operating Snowflake centric solutions Understanding of complete data analytics stack and workflow, from ETL to data platform design to BI and analytics tools Familiarity with industry common BI and ETL solutions Hands-on experience in a technical role leveraging ...

great chance to work on impactful data projects across NHS and private healthcare organisations. Role Deliver data warehouse and reporting solutions Develop ETL and data integration processes Turn requirements into production-ready data solutions Maintain existing data warehouse products Produce technical documentation Test and validate outputs Skills & Experience 5+ years … ETL development 5+ years SQL development Experience with large databases NHS/healthcare experience NHS EPR or PAS data experience Strong ETL/data handling skills Knowledge of NHS datasets (CDS, RTT, MHSDS) SSRS, SSIS, BI tools Data warehouse modelling EPR migration experience NO SPONSORSHIP IS AVAILABLE FOR THIS ROLE ...