1 to 25 of 210 ETL Jobs in the City of London

and Databricks. Proficiency in working with the cloud environment and various platforms, including Azure, SQL Server. NoSQL databases is good to have. Hands-on experience with data pipeline development, ETL processes, and big data technologies (e.g., Hadoop, Spark, Kafka). Experience with DataOps practices and tools, including CI/CD for data pipelines. Experience in medallion data architecture and other More ❯

intelligence and reporting tools like Tableau, PowerBI or similar. Experience with version control systems (e.g. Git) Ability to work in an Agile environment Experience with Microsoft SQL. Experience with ETL Tools and Data Migration. Experience with Data Analysis, Data mapping and UML. Experience with programming languages (Python, Ruby, C++, PHP, etc). The ability to work with large datasets across More ❯

Job Title: QA Tester – ETL Testing (Informatica) & Azure Data Engineering Location: Westminster, London Type: Full-time Department: Quality Assurance/Data Engineering Reporting to: Data Engineering Lead Job Summary: We are looking for a skilled and detail-oriented QA Tester with hands-on experience in ETL testing (Informatica or Microsoft Fabric) and a strong understanding of Azure Data Engineering tools … will possess good hands-on knowledge of writing and executing SQL queries to validate data across systems. Experience in Microsoft Fabric is considered a strong bonus. Key Responsibilities: Perform ETL/data pipeline testing using Informatica PowerCenter or IICS . Validate data ingestion , transformation , and loading processes across Azure services. Execute source-to-target data validation , data profiling, and data … analysts. Contribute to daily Agile ceremonies and maintain clear and detailed QA documentation. Required Skills & Experience: 3–7 years of software testing experience, with at least 2+ years in ETL testing using Informatica . Strong hands-on experience in writing and executing complex SQL queries . Experience testing cloud-based data pipelines built on Azure , specifically: Azure SQL Database Azure More ❯

dictionaries and documentation to ensure transparency and standardization across teams. Data Migration & Transformation: - Lead data migration efforts, particularly during system upgrades or transitions to new platforms. - Define and implement ETL (Extract, Transform, Load) processes for transforming data into usable formats for analytics and reporting. Documentation and Reporting: - Document data architecture designs, processes, and standards for reference and compliance purposes. - Create … Google BigQuery). • Experience with big data platforms (e.g., Hadoop, Spark, Kafka). • Familiarity with cloud-based data platforms and services (e.g., AWS, Azure, Google Cloud). • Expertise in ETL tools and processes (e.g., Apache NiFi, Talend, Informatica). • Proficiency in data integration tools and technologies. • Familiarity with data visualization and reporting tools (e.g., Tableau, Power BI) is a plus. More ❯

BI reports from a variety of sources including SQL databases and Excel. Translate business needs into technical reporting requirements, liaising with users to resolve data queries. Manage and maintain ETL processes and troubleshoot data issues, including log analysis and issue resolution. Automate key business processes and transition legacy/manual systems into modernised, scalable solutions. Conduct testing (manual and automated … or Azure Data Factory. Strong skills in Excel and Power Query; experience developing reports in Power BI desirable. Knowledge of programming (e.g., C# .NET, PowerShell, Python or R) and ETL best practices. Familiarity with source control tools and deployment pipelines. Ability to collaborate within a small, agile team, with excellent communication and problem-solving skills. To apply, either respond to More ❯

BI reports from a variety of sources including SQL databases and Excel. Translate business needs into technical reporting requirements, liaising with users to resolve data queries. Manage and maintain ETL processes and troubleshoot data issues, including log analysis and issue resolution. Automate key business processes and transition legacy/manual systems into modernised, scalable solutions. Conduct testing (manual and automated … or Azure Data Factory. Strong skills in Excel and Power Query; experience developing reports in Power BI desirable. Knowledge of programming (e.g., C# .NET, PowerShell, Python or R) and ETL best practices. Familiarity with source control tools and deployment pipelines. Ability to collaborate within a small, agile team, with excellent communication and problem-solving skills. To apply, either respond to More ❯

offered on an Outside IR35 basis. Key Responsibilities: Design, build, and maintain scalable data pipelines using Microsoft Fabric, Azure Synapse, and Azure Data Factory (ADF). Develop and optimise ETL/ELT processes to support business intelligence and analytics solutions. Collaborate with data architects, analysts, and stakeholders to understand business requirements and translate them into technical solutions. Contribute to the … needed. Key Skills & Experience: Proven experience as a Data Engineer working in cloud-native environments. Microsoft Fabric Azure Synapse Analytics Azure Data Factory (ADF) Strong understanding of data modelling, ETL/ELT development, and data warehouse best practices. Experience working across greenfield and brownfield projects. Comfortable working independently in a remote setup. Strong communication and stakeholder engagement skills. Nice to More ❯

with relational SQL databases either on premises or in the cloud. Power platform experience is desirable. Experience delivering multiple solutions using key techniques such as Governance, Architecture, Data Modelling, ETL/ELT, Data Lakes, Data Warehousing, Master Data, and BI. A solid understanding of key processes in the engineering delivery cycle including Agile and DevOps, Git, APIs, Containers, Microservices and More ❯

lakes. Expertise in GCP data services including BigQuery, Composer, Dataform, DataProc, and Pub/Sub. Strong programming experience with Python, PySpark, and SQL. Hands-on experience with data modelling, ETL processes, and data quality frameworks. Proficiency with BI/reporting tools such as Looker or PowerBI. Excellent communication and stakeholder management skills. Google Cloud Professional certifications. Experience in alternative cloud More ❯

Spark, Databricks, or similar data processing tools. Stron g technical proficiency in data modelin g , SQL, NoSQL databases, and data warehousing . Hands-on experience with data pipeline development, ETL processes, and big data technolo g ies (e. g ., Hadoop, Spark, Kafka). Proficiency in cloud platforms such as AWS, Azure, or Goo g le Cloud and cloud-based More ❯

Azure data technologies, including Azure Databricks, SQL Database, Data Factory, and T-SQL. In-depth understanding of London Market insurance data and Actuarial/Finance business processes. Experience with ETL processes, data modelling, and dimensional modelling techniques. Proficient with Azure DevOps, CI/CD, GIT, and deployment strategies. Proven track record in delivering cloud-based enterprise data solutions and supporting More ❯

data and analytics needs. Design and deploy end-to-end data solutions using Microsoft Fabric, encompassing data ingestion, transformation, and visualisation workflows. Construct and refine data models, pipelines, and ETL frameworks within the Fabric ecosystem. Leverage Fabric’s suite of tools to build dynamic reports, dashboards, and analytical applications. Maintain high standards of data integrity, consistency, and system performance across More ❯

Git Actions. · Knowledge of various data modeling techniques, including Star Schema, Dimensional models, and Data Vault. · Hands-on experience with: · Developing data pipelines (Snowflake), writing complex SQL queries. · Building ETL/ELT/data pipelines. · Kubernetes and Linux containers (e.g., Docker). · Related/complementary open-source software platforms and languages (e.g., Scala, Python, Java, Linux). · Experience with both More ❯

000.00 1 week ago London, England, United Kingdom 2 weeks ago City Of London, England, United Kingdom 4 weeks ago London, England, United Kingdom 4 days ago Senior ODI ETL & OAS BI Banking Data Developer Senior Software Engineer - Card Integrations - Visa/Mastercard London, England, United Kingdom 1 day ago London, England, United Kingdom 4 days ago London, England, United More ❯

of actuaries, data scientist and developers. Our role in this mission is to pioneer advancements in the field of pensions and beyond, leveraging state-of-the-art technology to extract valuable and timely insights from data. This enables the consultant to better advise Trustees and Corporate clients on a wide range of actuarial-related areas. The Role As a Machine … model drifts, data-quality alerts, scheduled r-training pipelines. Data Management and Preprocessing. Collect, clean and preprocess large datasets to facilitate analysis and model training. Implement data pipelines and ETL processes to ensure data availability and quality. Software Development. Write clean, efficient and scalable code in Python. Utilize CI/CD practices for version control, testing and code review. Work More ❯

initiatives. What You’ll Do Integrate new data sources (e.g. D365) into the enterprise data warehouse Design scalable data models and perform source-to-target mapping Build and automate ETL pipelines using SQL, SSIS, and Azure Data Factory Support BI delivery, UAT testing, and project work across teams Contribute to our cloud shift using Azure Synapse and Databricks Maintain technical … documentation and support data governance Tech Stack Platforms: SQL Server, Azure Synapse, Databricks ETL: SSIS (2014–2022), Azure Data Factory BI Tools: Power BI Other: Power Apps, Power Automate, Python or R About You Experienced Data Engineer with strong ETL, SQL, and data modelling skills Proficient in the Microsoft data stack Confident working in Agile teams and regulated environments Strong More ❯

With major transformation initiatives underway, this is an opportunity to have impact from day one while helping shape the future of reporting and analytics. Key Responsibilities: Maintain and extend ETL pipelines and support the firm’s data warehouse infrastructure. Work closely with business teams to understand data and reporting needs. Develop and enhance Power BI dashboards and reporting solutions. Assist … Power Query CI/CD tooling What We’re Looking For: A hands-on data engineer or BI engineer with solid SQL skills and experience in building or maintaining ETL processes. Someone who thrives in a fast-paced, high-accountability environment with direct access to stakeholders. Experience working in a financial, regulated, or data-critical environment preferred — though not essential. More ❯

AWS - Data source exploration, data warehousing expansion, horizontal datasets for downstream consumption - Work with customers to build Dashboards with the right KPIs, Metrics for decision making - Data Quality checks, ETL/ELT processes, automation Technical Requirements: - Strong proficiency in SQL and Python programming - Extensive experience with data modeling and data warehouse concepts - Advanced knowledge of AWS data services, including: S3 … Redshift, AWS Glue, AWS Lambda - Experience with Infrastructure as Code using AWS CDK - Proficiency in ETL/ELT processes and best practices - Experience with data visualization tools (Quicksight) Required Skills: - Strong analytical and problem-solving abilities - Excellent understanding of dimensional modeling and star schema design (Facts, dimensions, scd type 2) - Experience with agile development methodologies - Strong communication skills and ability More ❯

following product/solution development lifecycles using frameworks/methodologies such as Agile, SAFe, DevOps and use of associated tooling (e.g., version control, task tracking). Demonstrable experience writing ETL scripts and code to make sure the ETL processes perform optimally. Experience in other programming languages for data manipulation (e.g., Python, Scala). Extensive experience of data engineering and the More ❯

secure, and high-performance data warehouse solutions for BI and analytics. Define and drive the long-term architecture and data strategy in alignment with business goals. Own orchestration of ETL/ELT workflows using Apache Airflow , including scheduling, monitoring, and alerting. Collaborate with cross-functional teams (Product, Engineering, Data Science, Compliance) to define data requirements and build reliable data flows. More ❯

to RfP response. Ability to be a SPOC for all technical discussions across industry groups. Excellent design experience, with entrepreneurship skills to own and lead solutions for clients Excellent ETL skills, Data Modeling Skills Excellent communication skills Ability to define the monitoring, alerting, deployment strategies for various services. Experience providing solution for resiliency, fail over, monitoring etc. Good to have More ❯

take ownership of MI & BI reporting and data analysis, partnering closely with front-office teams. Your work will support business-critical initiatives through the design, maintenance, and enhancement of ETL pipelines, while also contributing to the development of automation solutions to streamline key workflows. You’ll also be responsible for: Migrating and enhancing business reports using Power BI Managing data … solutions Engaging directly with stakeholders to gather reporting requirements and resolve ad-hoc data queries Key skills & experience include: Strong experience in SQL Server/Azure SQL Proficiency in ETL processes and Microsoft SSIS or Azure Data Factory Experience working with Microsoft Excel and Power Query Knowledge of Power BI and DAX for modern BI solutions Programming experience in C# More ❯

With major transformation initiatives underway, this is an opportunity to have impact from day one while helping shape the future of reporting and analytics. Key Responsibilities: Maintain and extend ETL pipelines and support the firm’s data warehouse infrastructure. Work closely with business teams to understand data and reporting needs. Develop and enhance Power BI dashboards and reporting solutions. Assist … Power Query CI/CD tooling What We’re Looking For: A hands-on data engineer or BI engineer with solid SQL skills and experience in building or maintaining ETL processes. Someone who thrives in a fast-paced, high-accountability environment with direct access to stakeholders. Experience working in a financial, regulated, or data-critical environment preferred — though not essential. More ❯

days a week onsite in their state of the art office and will remain a technically hands on role. Key Responsibilities Design, build, and manage scalable data pipelines and ETL/ELT processes in Azure Data Factory , Databricks , and other Azure services. Develop and maintain data models, data lakes, and data warehouses (e.g., Azure Synapse). Use Python for data More ❯

data products using technologies like Snowflake, Power BI, Python, and SQL. Your work will enable self-service analytics and support data governance across the business. Key Responsibilities: Develop robust ETL/ELT pipelines and dimensional models for BI tools Define and implement data quality, ownership, and security standards Empower business teams with intuitive, self-serve data models Own data products More ❯