25 of 25 ETL Jobs in the Thames Valley

Lakehouse, Pipelines, Notebooks, Dataflows, OneLake) Hands-on experience with Databricks in production environments Proficiency in PySpark and SQL Solid understanding of data engineering concepts (ETL/ELT, orchestration, partitioning) Experience working with Delta Lake Familiarity with cloud platforms (Azure preferred) Experience integrating data from relational and non-relational sources Knowledge ...

Engineering & DevOps Silo Elimination & Data Ingestion: Identify isolated data pockets across the business and unify them into the central platform. Design robust ELT/ETL pipelines (using Python, SQL or Spark) to ingest high-volume data from internal systems, APIs and flat files. Modernisation & Migration: Lead the technical migration ...

Responsibilities Build and manage data pipelines using Azure Synapse, Data Factory, Databricks or Microsoft Fabric Design, implement and maintain data lakes data warehouses and ETL/ELT processes Develop scalable data models for reporting in Power BI Work closely with stakeholders to understand business needs and advise on solutions that ...

users on business intelligence tools. Identify opportunities to improve data processes and implement solutions. Integrate various data sources to provide comprehensive insights. ETL Process - Knowledge of extract, Transform, Load (ETL) techniques for cleaning and consolidating data from different sources using SQL and other tools Maintain documentation for all analytics tools …/FI & Power BI should have: Expert user of Power BI. SQL, DAX and Databases - Ability to query databases and structure financial data efficiently ETL Process - Knowledge of extract, Transform, Load (ETL) techniques for cleaning and consolidating data from different sources. Strong analytical and problem-solving skills. Experience ...

responsible for: Building and managing data pipelines using Azure Synapse, Data Factory, Databricks, or Microsoft Fabric Designing and maintaining data lakes, data warehouses, and ETL/ELT processes Developing scalable data models for reporting in Power BI Work closely with stakeholders to understand the needs of their individual business and ...

including: Hands-on experience building and operating cloud-based data platforms in production Strong programming skills (Python, SQL and/or Spark-based frameworks) ETL/ELT pipeline design at scale Experience with modern data orchestration and workflow tools Infrastructure as Code (e.g. Terraform or similar) CI/CD practices ...

shape data architecture, influence technical decisions, and contribute to meaningful, data-driven outcomes. Key Responsibilities Design, develop, and maintain scalable data pipelines to extract, transform, and load (ETL) data into cloud-based data platforms, primarily AWS. Create and manage data models that support efficient storage, retrieval, and analysis of data. … automated builds, deployments, and testing. Skills and Experience Strong experience designing and building data pipelines on cloud platforms, particularly AWS. Excellent proficiency in developing ETL processes and data transformation workflows. Strong SQL skills (postgresql) and advanced Python coding capability (essential). Experience working with AWS services such ...

standards What you’ll need Strong Azure & Databricks engineering experience Advanced Power BI + SQL (SSIS a bonus) Solid data modelling (star schema, medallion, ETL patterns) Confident working with messy/complex data sources Performance tuning & optimisation skills Contract details 6-month Contract with a view of being extended Hybrid ...

and the Azure data platform (Data Factory, Synapse, etc.). Experience with Databricks (or strong willingness to learn). Solid understanding of data architecture, ETL processes, and performance optimisation. Excellent leadership and communication skills. What's Offered Competitive salary up to £75,000. Hybrid working model - 1 day per week ...

technical excellence. Architect and implement robust, cloud-first data solutions. Drive migration projects from Azure to Databricks. Develop high-performance data pipelines and optimise ETL processes. Explore emerging technologies to keep the organisation ahead of the curve. Skills and Experience Proven experience as a Senior or Lead Data Engineer. Hands ...

lead for the migration from Azure to Databricks. Architect and implement robust, cloud-first data solutions. Build and optimise high-performance data pipelines and ETL processes. Skills and Experience Proven experience as a Senior or Lead Data Engineer. Strong hands-on expertise with Databricks and PySpark/Spark SQL. Deep ...

Engineering & DevOps Silo Elimination & Data Ingestion: Identify isolated data pockets across the business and unify them into the central platform. Design robust ELT/ETL pipelines to ingest high-volume data from internal systems, APIs and flat files. Modernisation & Migration: Lead the technical migration of the core reporting and data … managing modern Cloud Data Warehouses (e.g. Snowflake, Databricks or Azure Synapse). You must understand compute/storage separation and cost optimisation. Data Engineering & ETL/ELT: Experience building robust data pipelines using modern tools (e.g. Fivetran, CData, Airbyte or Azure Data Factory). Data Transformation: Experience building production data ...

related discipline. Experience in data quality methods (validation, profiling, cleansing) in medium/large-scale environments. Hands-on experience with relational databases, ETL processes, and CRM systems (e.g., Salesforce, Dynamics). Strong skills in data extraction, transformation, and reporting (Excel, SQL, BI tools). Understanding of GDPR, UK data protection ...

feel at home here. You'll work with: Designing and delivering scalable data solutions on Databricks Building and maintaining robust data pipelines and ETL workflows Working closely with senior data leaders on architecture and strategy Translating architectural designs into high-quality build plans Optimising large-scale data workflows for performance ...

analytics, AI/ML use cases, and operational efficiency. Must have proven experience in large-scale transformation projects, strong knowledge of cloud data platforms, ETL/ELT processes, data governance, and security compliance, along with expertise in program governance, Agile methodologies, and stakeholder management. ...

Governance & Quality Tools: Tools: Collibra, Talend, Snowflake, PowerBI. Knowledge: Metadata management, data lineage, cataloguing. Technical Skills: Proficiency: SQL, data analysis tools. Experience: Data integration, ETL processes. Familiarity: Data visualization tools (Power BI, Tableau). Awareness: Data governance, management practices, tools. Bachelor's degree in Information Management, Data Science, Business ...

analysis Experience in time series database analysis Experience in large Business Transformation Programs involving process reengineering Extensive experience in UCD led approach, UI development, ETL processes, data flows analysis, cloud architecture, and data modernisation/transformation programs Excellent analytical and problem-solving skills, with the ability to think critically and ...

platforms such as SAP (ERP/EAM), Salesforce Design and oversee bi-directional data flows (feature services, map/geoprocessing services, geo-event streams, ETL pipelines) with robust retry, idempotency, and error handling Implement identity federation (SAML/OAuth2/OpenID Connect, SCIM), role-based access control, and service security ...

suite executives and Data Team members for analytical and operational use. Develop and implement data solutions using techniques such as Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, and system integration. Resolve data access issues, including troubleshooting and corrective action. Monitor and tune BI tools to ensure optimal performance. … Power BI. Multi-project & varied commercial exposure of troubleshooting in SQL Multi-project & varied commercial exposure of applying database modelling design principles and deploying ETL/ELT changes within both OLTP and data warehouse/data mart environments. Strong communicator, detail-oriented, problem-solver, and able to work both independently ...

Generative AI and Agentic AI for innovative data solutions Data Virtualization & Streaming Enable data virtualization and manage streaming data pipelines for real-time insights ETL/ELT Development Build and optimize workflows using Matillion, Alteryx, and Qlik Visualization & Reporting Develop dashboards and reports using Power BI Innovation Drive adoption … replication tools (Qlik Replicate, Oracle GoldenGate) Proficiency in data modeling and integration architectures Knowledge of API design, data virtualization, and streaming technologies Familiarity with ETL/ELT tools (Matillion, Alteryx, Qlik) Advanced skills in Power BI and AzureML Understanding of Machine Learning, Generative AI, and Agentic AI concepts Excellent problem ...

will be responsible for: Diagnosing and resolving SQL Server performance issues across queries, indexes and execution plans Tuning stored procedures, user-defined functions and ETL processes to improve scalability and speed Working closely with clients and internal teams to understand requirements and deliver efficient technical solutions Promote performance best practices ...

Salesforce, and other core systems. Design and oversee bi-directional data flows including feature services, map and geoprocessing services, geo-event streams, and ETL pipelines. What You Will Ideally Bring 8+ years of experience in GIS, systems integration, or enterprise architecture roles. Strong hands-on experience with the Esri ArcGIS ...

regulated environment Strong understanding of pension products, processes, and regulatory requirements. Demonstrable experience in data analysis, data migration, and defining data extract requirements. Hands-on experience with transformation and onboarding of third-party systems. Solid understanding of system integration principles and data quality assurance. Excellent analytical, problem-solving, and communication … Desirable Skills Experience with pension administration platforms and data models. Familiarity with data governance frameworks and best practices. Knowledge of data transformation tools or ETL processes. Proficiency in using tools such as SQL, Excel, Visio, or data modelling software. Relevant certifications (e.g., BCS Business Analysis, Agile BA, or similar). ...

service, CRM-style tools some include SalesForce, but often not enterprise grade) Spreadsheets and imperfect real-world data This is a source-to-target, ETL-heavy role requiring curiosity, resilience, and strong problem-solving skills. You will be trusted to work independently, with minimal hand-holding, in a demanding … source systems (often undocumented) Understand and interrogate data models at source and target (D365/Dynamics) Perform source-to-target mapping Extract, cleanse, transform, and load data into Microsoft Dynamics. This will be using various tools, but common being SQL/SSIS/Kingswaysoft. Some Python skill would be useful. ...

and develop StoryMaps Automation & Workflow Optimization Build automated workflows using ModelBuilder, Python scripts, and geoprocessing models Work with tools like FME for spatial data ETL and data transformation processes Your Profile Essential Skills/Knowledge/Experience 10+ years in GIS Web Application Development & Deployment Desirable Skills/Knowledge/… technologies Experience with: ArcGIS Experience Builder (COTS & custom tools) ArcGIS Portal content migration Service publishing Web map and StoryMap creation Strong understanding of spatial ETL workflows using ...