18 of 18 ETL Jobs in Gloucestershire

Engineer high-performance data ingestion pipelines for batch and streaming data from multiple sources, including sensor, geospatial, communications and operational systems. Design and implement ETL/ELT workflows to transform, enrich and validate data for downstream analytics and machine learning use. Build scalable, distributed data processing solutions using modern ...

outcomes and value of their work, and have working experience in some of the following:End-to-end development experience with data pipelines, ETL processes, workflow orchestration - using core concepts that apply across tech stacks.Working with diverse data sources and types - batch, streaming, real-time, and unstructured.Systems thinking and architectural ...

and calculationsFamiliarity with Power BI best practices, security, and sharing capabilities.Proficient in SQL and experience with querying databases (SQL Server, Oracle, etc.).Knowledge of ETL (Extract, Transform, Load) processes and tools.Analytical thinker/problem solverKeen to learn and understand what is available in the market to support the business with ...

skills and techniques to effectively transform unstructured data and present it back in an informative fashion. Apply knowledge of data cleansing, Exact, Transform, Load (ETL) processes, database design, application, and visualization tools. Engage with clients to gather requirements and present findings in a clear and compelling way. Develop and maintain ...

document, row-based/columnar data stores, data warehousing and data lakes.Expert understanding of data pipeline patterns and approaches such as event-driven architectures, ETL/ELT, stream processing and data visualisation.Experience working with business owners to translate business requirements into technical specifications and solution designs that satisfies the data ...

Strong Python or Java development skills * Experience with AWS cloud services * Knowledge of Apache Spark, Hadoop, NiFi or similar big data technologies * Experience building ETL/ELT pipelines and processing large datasets * Understanding of software engineering best practices, testing and CI/CD * Comfortable working in Agile environments Reasonable Adjustments ...

firm make better use of modern Microsoft-based data and integration technologies.Design, develop and maintain automated data integrations between business applications.Build, support and optimise ETL/ELT processes and automated data pipelines.Develop automation solutions using APIs, scheduled processes and event-driven workflows.Monitor, troubleshoot and optimise data automation processes, ensuring reliable … and experience:4–6 years’ experience in Data Engineering, Integration Engineering, Automation Engineering or a similar role.Strong SQL Server and T-SQL skills.Experience developing ETL/ELT processes and data pipelines.Experience with APIs, integrations and data exchange technologies.Experience using Microsoft Azure services.Experience with Microsoft Fabric or similar cloud data platforms.Good ...

data models to support analytics, reporting and business insight. Integrating data from multiple business systems, including finance, CRM and operational platforms.Building robust ELT/ETL processes that deliver high levels of data quality, consistency and performance.Collaborating with technical and non-technical stakeholders to translate business requirements into scalable solutions.Applying best … Data Factory, Lakehouse, Warehouse, Notebooks and Power BI integration.Strong SQL skills and experience working with both relational and analytical data models.Experience building and maintaining ETL/ELT data pipelines.Knowledge of Azure data services and cloud-based data architectures.Understanding of data governance, security and data quality best practice.Strong problem-solving skills ...

and SFTP integrations between internal applications and third-party platforms. Developing and supporting Microsoft Fabric Lakehouses, Warehouses, Dataflows and Data Pipelines. Designing and implementing ETL and ELT solutions that integrate data from SQL Server, APIs, CSV, Excel, JSON and XML sources. Collaborating with Data Architects, Solution Architects, Business Analysts, Project ...

with both technical teams and customersNice to HaveExperience with any of the following would be an advantage:SaaS or enterprise data environmentsData integration or ETL processesGit or other version control toolsFamiliarity with semantic layer tools such as Cube or LookMWhy Apply You’ll be joining a highly collaborative team where ...

Collaborating with data owners and business stakeholders to translate requirements into effective technical solutions.* Troubleshooting issues across the data lifecycle, from source systems and ETL processes through to front-end reporting.* Monitoring and improving report, dataset, and query performance.* Supporting BI governance, documentation, and best practices to ensure a scalable … data models within Power BI.* Advanced SQL skills, including complex query writing, optimisation, and working with large datasets.* Solid understanding of data warehousing principles, ETL/ELT processes, dimensional modelling, and data transformation.* Experience working with ETL/ELT tools such as Azure Data Factory, SSIS, or similar technologies.* Experience ...

real‐time data solutions using AWS and other public cloud platformsProviding technical leadership across cross‐functional teams and setting best practice standardsDesigning data models, ETL pipelines, warehousing solutions and distributed systemsBuilding and supporting real‐time streaming platforms using Apache Flink and related technologiesEnsuring compliance with industry standards and government regulationsTracking ...

data solutions using AWS and other public cloud platforms Providing technical leadership across cross-functional teams and setting best practice standards Designing data models, ETL pipelines, warehousing solutions and distributed systems Building and supporting real-time streaming platforms using Apache Flink and related technologies Ensuring compliance with industry standards and ...

Palantir Foundry and Gotham:Ingesting, transforming, enriching, and integrating data from diverse sources into well-structured information assets within Palantir Foundry.Designing, building, and optimising ETL processes, data pipelines, and automated workflows for moving and processing data using Palantir Foundry tools.Optimising data systems for performance, scalability, reliability, and monitoring within Palantir … outcomes and value of their work, and have working experience in some of the following:End-to-end development experience with data pipelines, ETL processes, and workflow orchestration, with demonstrable experience in Palantir Foundry and Gotham.Working with diverse data sources and types – batch, streaming, real-time, and unstructured – and integrating ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...

full time on site when required Must hold active Enhanced DV Clearance (West) Circa £700 p/d inside IR35 Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...

automation and supporting Real Time data streaming capabilities. Responsibilities: Design, develop and maintain scalable data pipelines using Python, Go and Azure Data Factory Develop ETL and ELT processes supporting structured, semi-structured and unstructured data Implement and manage hybrid data solutions across on-premises and Azure environments Build and maintain … technologies such as Keycloak Collaborate with technical teams to deliver resilient, secure and scalable data platforms Skills: Strong commercial Python development experience Experience developing ETL/ELT solutions within enterprise environments Azure Data Factory expertise Experience with Kafka and/or NATS event streaming technologies PostgreSQL administration and development experience ...

Work Scheme This Senior Database Architect will have the following responsibilities: Design, maintain, and optimise the systems and database infrastructure Build and manage ETL processes and system integrations Monitor database performance, security, and data integrity Ensure compliance with data governance and GDPR requirements Collaborate with IT teams and third-party … Database Architect vacancy will have the following attributes and exposure: Strong experience with SQL Server, MySQL, or similar relational databases Experience building and maintaining ETL processes and data integrations Knowledge of database performance tuning, security, and backup procedures Understanding of data governance, GDPR, and data management best practices Experience working ...