24 of 24 ETL Jobs in the Thames Valley

Lakehouse, Pipelines, Notebooks, Dataflows, OneLake) Hands-on experience with Databricks in production environments Proficiency in PySpark and SQL Solid understanding of data engineering concepts (ETL/ELT, orchestration, partitioning) Experience working with Delta Lake Familiarity with cloud platforms (Azure preferred) Experience integrating data from relational and non-relational sources Knowledge ...

data pipelines using Azure Synapse, Data Factory, Databricks or Microsoft Fabric Architect, implement and oversee high-performing data lakes, data warehouses and ETL/ELT processes Develop scalable, robust data models for enterprise-level reporting within Power BI Serve as a technical authority, advising clients on best-fit data solutions ...

and SSIS in production environments. Strong SQL Server engineering: advanced T-SQL, indexing, performance tuning, execution plans, statistics, partitioning, tempdb optimisation. Proven experience with ETL/ELT development and design patterns (incremental loads, CDC, SCD, error handling, idempotency). Strong data modelling skills (Kimball, dimensional, relational). [Data Engineer ...

users on business intelligence tools. Identify opportunities to improve data processes and implement solutions. Integrate various data sources to provide comprehensive insights. ETL Process - Knowledge of extract, Transform, Load (ETL) techniques for cleaning and consolidating data from different sources using SQL and other tools Maintain documentation for all analytics tools …/FI & Power BI should have: Expert user of Power BI. SQL, DAX and Databases - Ability to query databases and structure financial data efficiently ETL Process - Knowledge of extract, Transform, Load (ETL) techniques for cleaning and consolidating data from different sources. Strong analytical and problem-solving skills. Experience ...

Youll Do Design, build, and maintain scalable data pipelines using Azure services Develop and optimize solutions in Microsoft Fabric (Data Factory, Lakehouse, Warehousing) Implement ETL/ELT processes using tools such as Azure Data Factory Work with large datasets in Azure Synapse Analytics and Azure Data Lake Storage Collaborate with ...

responsible for: Building and managing data pipelines using Azure Synapse, Data Factory, Databricks, or Microsoft Fabric Designing and maintaining data lakes, data warehouses, and ETL/ELT processes Developing scalable data models for reporting in Power BI Work closely with stakeholders to understand the needs of their individual business and ...

skills for creating custom NiFi processors. Programming & Data Technologies: Proficiency in Java and SQL. Experience with C# and Scala is a plus. Experience with ETL tools and big data platforms. Knowledge of data modelling, replication, and query optimization. Hands-on experience with SQL and NoSQL databases is desirable. Familiarity with ...

platforms, and modern data pipeline development. Key Responsibilities Design and architect data solutions using Snowflake Optimise workflows and integrations using Openflow Develop and maintain ETL and ELT pipelines from Salesforce, relational databases, files, and NoSQL sources Implement dimensional modelling to support data warehousing and BI reporting Build and optimise data ...

organisation. You have hands-on expertise with SQL Server technologies including SSIS, SSRS and SSAS, and you are comfortable designing and maintaining data warehouses, ETL processes and reporting structures. You have experience with Snowflake or another cloud data platform, and you understand how to design pipelines, schemas and data flows ...

directly impact executive and operational decision-making across the business, both in the UK and internationally. You'll: Design and build scalable data pipelines (ETL/ELT) pulling from core platforms, cloud storage, databases and APIs Turn raw, messy, disparate data into curated, analysis-ready datasets Work with Python, Spark ...

shape data architecture, influence technical decisions, and contribute to meaningful, data-driven outcomes. Key Responsibilities Design, develop, and maintain scalable data pipelines to extract, transform, and load (ETL) data into cloud-based data platforms, primarily AWS. Create and manage data models that support efficient storage, retrieval, and analysis of data. … automated builds, deployments, and testing. Skills and Experience Strong experience designing and building data pipelines on cloud platforms, particularly AWS. Excellent proficiency in developing ETL processes and data transformation workflows. Strong SQL skills (postgresql) and advanced Python coding capability (essential). Experience working with AWS services such ...

data platforms (S3, Lake Formation, Glue, Athena, EMR/Spark). Design multi account data governance, security, and access models. Develop scalable ETL/ELT pipelines using Python & PySpark . Implement IaC using Terraform and CI/CD using GitHub Actions . Optimize data pipelines for performance, quality, and cost. ...

design, schema improvements, stored procedures, functions, and triggers. Collaborate on data modelling efforts (logical and physical models) for new applications and enhancements. Assist with ETL processes, data migrations, and integration projects across heterogeneous systems. Resolve database related incidents, performance issues and service disruptions Automate routine tasks using PowerShell, Bash, Python ...

analysis Experience in time series database analysis Experience in large Business Transformation Programs involving process reengineering Extensive experience in UCD led approach, UI development, ETL processes, data flows analysis, cloud architecture, and data modernisation/transformation programs Excellent analytical and problem-solving skills, with the ability to think critically and ...

Data Engineer needed in Newbury Paying £271.57 per day ref 5289648 Full time hours on a temporary basis Key Responsibilities Design, develop, and maintain ETL/ELT pipelines using SSIS in production environments. Engineer high-quality data integration solutions following best-practice patterns including incremental loads, CDC, SCD, data quality ...

platforms such as SAP (ERP/EAM), Salesforce Design and oversee bi-directional data flows (feature services, map/geoprocessing services, geo-event streams, ETL pipelines) with robust retry, idempotency, and error handling Implement identity federation (SAML/OAuth2/OpenID Connect, SCIM), role-based access control, and service security ...

Generative AI and Agentic AI for innovative data solutions Data Virtualization & Streaming Enable data virtualization and manage streaming data pipelines for real-time insights ETL/ELT Development Build and optimize workflows using Matillion, Alteryx, and Qlik Visualization & Reporting Develop dashboards and reports using Power BI Innovation Drive adoption … replication tools (Qlik Replicate, Oracle GoldenGate) Proficiency in data modeling and integration architectures Knowledge of API design, data virtualization, and streaming technologies Familiarity with ETL/ELT tools (Matillion, Alteryx, Qlik) Advanced skills in Power BI and AzureML Understanding of Machine Learning, Generative AI, and Agentic AI concepts Excellent problem ...

deploy ODI scenarios and load plans, leveraging Enterprise Manager (EM) for monitoring. Troubleshooting: Resolve issues related to ODI agent connectivity, repository connectivity, or failed ETL jobs. Infrastructure Management: Use WebLogic scripting tools (WLST) to manage server lifecycles and configure Node Manager. Your Profile Essential Skills/Knowledge/Experience Good ...

will be responsible for: Diagnosing and resolving SQL Server performance issues across queries, indexes and execution plans Tuning stored procedures, user-defined functions and ETL processes to improve scalability and speed Working closely with clients and internal teams to understand requirements and deliver efficient technical solutions Promote performance best practices ...

native solutions Essential leveraging AWS, Azure, or GCP Desirable Extensive exprience in developing architectural strategies, blueprints for hybrid and cloud-native solutions ELT/ETL Frameworks & Pipelines Essential Develop robust ELT/ETL pipelines using tools like Apache Airflow, DBT, AWS Glue, Azure Data Factory, or Kafka Connect. Desirable Optimize ...

service, CRM-style tools some include SalesForce, but often not enterprise grade) Spreadsheets and imperfect real-world data This is a source-to-target, ETL-heavy role requiring curiosity, resilience, and strong problem-solving skills. You will be trusted to work independently, with minimal hand-holding, in a demanding … source systems (often undocumented) Understand and interrogate data models at source and target (D365/Dynamics) Perform source-to-target mapping Extract, cleanse, transform, and load data into Microsoft Dynamics. This will be using various tools, but common being SQL/SSIS/Kingswaysoft. Some Python skill would be useful. ...

and develop StoryMaps Automation & Workflow Optimization Build automated workflows using ModelBuilder, Python scripts, and geoprocessing models Work with tools like FME for spatial data ETL and data transformation processes Your Profile Essential Skills/Knowledge/Experience 10+ years in GIS Web Application Development & Deployment Desirable Skills/Knowledge/… technologies Experience with: ArcGIS Experience Builder (COTS & custom tools) ArcGIS Portal content migration Service publishing Web map and StoryMap creation Strong understanding of spatial ETL workflows using ...

and optimize SQL-based solutions to support migration and reporting needs. Develop plans and processes, ensuring minimal disruption to existing services and integrity. Perform ETL operations to migrate data between systems, ensuring accuracy and completeness. Collaborate with other team members to gather requirements and design solutions that meet project and … database structures for improved performance and resource management. Proven experience in large-scale projects, preferably within the pensions or financial services industry. Skilled in ETL processes, data cleansing, and mapping strategies. Experience in implementing software systems. Proficiency with T-SQL, Microsoft SQL server management, XML and Microsoft full suite. ...

Oracle ERP. This role requires experienced ODI professionals who can independently work on complex tasks related to ODI. Your Responsibilities Develop, test, and deploy ETL processes using Oracle Data Integrator (ODI). Collaborate with data architects to design data integration solutions. Analyze and translate data requirements into technical specifications. Monitor … and troubleshoot data integration workflows for issues. Optimize ETL processes to ensure high performance and data integrity. Document ETL processes and maintain accurate records of data transformations. Work with stakeholders to understand data requirements and deliver solutions. Participate in code reviews and provide constructive feedback to peers. Unix Scipt , Strong ...