1 to 25 of 172 ETL Jobs in London

and day to day operations. Knowledge and experience in NEC's data loaders and configuration will be essential. You will also develop and manage ETL workloads to run predictably, efficiently and effectively whilst monitoring, maintaining and supporting all data management services and processes, liaising with IT, service vendors and internal … data exploration. Identification and resolution of problems in databases, data processes, data products and services Analysis and reporting of test activities and results Extensive ETL experience Experience of other housing management systems such as Active H, Open Housing or Northgate would be highly beneficial Spectrum IT Recruitment (South) Limited is more »

various teams to understand data requirements and implement solutions. > Optimizing data workflows and processes to enhance data quality, reliability, and performance. > Developing and managing ETL processes for data ingestion, processing, and transformation. > Implementing data governance practices to ensure data integrity, security, and compliance. > Monitoring and troubleshooting data infrastructure to address more »

responsible for accessing, validating, and querying data from various repositories using available tools. Build and maintain data integration processes using SQL Services and other ETL/ELT processes and scripting tools as well as ongoing requests and projects related to the data warehouse, MI, or fast-moving financial data. Designing … Architecting, building, testing, and maintaining data platform. Develop and support a wide range of data transformations and migrations for the whole business. Construct custom ETL processes: Design and implement data pipelines, data marts and schemas, access versatile data sources and apply data quality measures. Monitoring the complete process and applying … ML is a plus Experience with Azure SQL Database, Cosmos DB, NoSQL, MongoDB Experience with Agile, DevOps methodologies Awareness and knowledge of ELT/ETL, DWH, APIs (RESTful), Spark APIs, FTP protocols, SSL, SFTP, PKI (Public Key Infrastructure) and Integration testing Skills and Abilities Knowledge of Python, SQL, SSIS, and more »

support organizational growth. Essential Requirements: Minimum 5 years of experience in a similar role. Proven track record in designing and building data infrastructure and ETL pipelines. Proficiency in Azure Platform, including Data Lake, Data Factory, Synapse, Logic Apps, and Function Apps. SQL Server, including Store Procedures, T-SQL, or similar more »

Proficiency in designing and implementing data warehouse solutions using Snowflake, including performance tuning and optimization. Strong understanding of data modeling, data integration patterns, and ETL processes. Experience with data governance, data security, and data quality management. Excellent communication and collaboration skills, with the ability to work effectively in a cross more »

Technical and Professional Expertise Development of complex PowerBI reports - knowledge of DAX and Power Query M required Administration of the PowerBI environment Experienced in ETL processes Data manipulation and extraction using PostgreSQL Data manipulation and extraction using Databricks Knowledge of database data warehouse and data lakehouse principles Data transfer through more »

financial services. Strong leadership skills with a track record of successfully managing and developing high-performing teams. In-depth knowledge of data engineering concepts, ETL processes, and data warehouse architectures. Expertise in working with big data technologies and cloud platforms (preferably AWS or Azure). Familiarity with asset management industry more »

Your Responsibilities in this Role will be: Taking ownership of designing and developing scalable data models and warehouses Create and maintain database objects, and ETL processes Optimize data ingestion and transformation processes Collaborate with stakeholders Ensure effective database optimization and security implementation Champion data quality and integrity Requirements: SQL Python more »

team whilst ensuring the overall performance of the solutions utilising the latest technologies, processes and best practice. You will design and build data pipelines, ETL processes and data workflows that enable data to be transferred seamlessly across a variety of platforms Required Skills: - Effective experience leading, motivating and developing a more »

harmonising data, messages, etc. Desired experience: Building integration solutions Experience in designing application databases Experience in designing and building data pipelines using SQL, code, ETL tools Strong estimation and planning skills Mentoring team members and peer-review of their work If you're interested in this opportunity, please click Apply more »

warehouses and data lakes, implementing data integration and transformation solutions, ensuring data quality and integrity, and optimizing data performance. Responsibilities: Develop data pipelines for ETL/ELT (Extract, Transform, Load) processes using Azure technologies. Build and maintain scalable and efficient data warehouses and data lakes on Azure platforms. Implement data more »

storage systems on Google Cloud Platform (GCP). You will be working with technologies such as Apache Airflow, BigQuery, Python, and SQL to transform and load large data sets, ensuring high data quality and accessibility for business intelligence and analytics purposes. Our business is growing quickly and with that so … Key Responsibilities Design, construct, install, test, and maintain data pipelines. Ensure systems meet business requirements and industry practices for data integrity and quality. Manage ETL and ELT pipelines across many data sources (CSV/parquet files, API endpoints, etc) Design and build data models for the business end users. Write more »

with Polaris ProductWriter and WTW Radar. Understanding of best practice design and coding principles. A logical aptitude, with strong problem-solving skills. Familiarity with ETL tools such as SAS, SQL and Excel Proficient in writing both technical and business focused documentation. Embraces opportunities to develop and learn new skills. For more »

accelerated time to market without leaving traces of identity. Required Skills and Qualifications: Demonstrated expertise in architecting systems for real-time transaction processing alongside ETL applications, with a focus on discretion. A comprehensive of data modelling, data warehousing principles, and the innovative Lakehouse architecture. Exceptional proficiency in ETL methodologies, preferably … utilising Azure Databricks or equivalent technologies (Spark, Spark SQL, Python, SQL), including deep insight into ETL/ELT design patterns. Proficient in Databricks, SQL, and Python, with a robust understanding of software development life cycles. Familiarity with columnar and/or time series data design patterns, as well as performance more »

using dbt, ensuring the efficient transformation of raw data into actionable insights. Build and optimize query pipelines in dbt and SQL to extract, transform, and load data from various sources into a structured format suitable for analysis. Create interactive and visually appealing dashboards and reports using Tableau to effectively communicate more »

management of data sources with 3rd party organizations. Working closely with Data Engineers and Data Architects to facilitate various types of integrations, such as ETL processes and API awareness. Researching and sourcing data for new product development, including national datasets and system integrations. Providing insight and adding value to existing more »

delivering complex initiatives across the Defence & Security sector. The Role: As a Data Analytics Consultant, you’ll design and build data solutions such as ETL components, data warehouses or data virtualisation implementation. Working closely with client stakeholders to design the source-to-target mappings for large-scale data migrations whilst … the ability to translate business requirements into functional/technical data designs/solutions Agile and/or DevOps for software development & IT operations ETL tools such as Informatica, SSIS, Talend or Pentaho Data governance and data management tools such as Informatica MDM, Informatica AXON, Informatica EDC, and Collibra MySQL more »

and SQL. Responsibilities: Lead and contribute to data engineering projects, designing and implementing efficient and scalable data pipelines. Demonstrate proficiency in data engineering tools, ETL processes, and database systems, with a strong command of programming languages. Design and optimise data models to ensure efficient storage, retrieval, and processing of data … Requirements: Azure cloud experience is essential (Data Factory, Data Bricks, Azure Synapse) Strong expertise in designing, implementing, and optimising Extract, Transform, Load (ETL) processes for efficient and scalable data movement. In-depth knowledge and hands-on experience with various database technologies, including both relational (e.g., SQL) and NoSQL systems, for more »

Senior Tester (ETL & AWS) – London – up to £70k Senior Tester required by an established Digital Data Consultancy to join a leading Government organisation focusing on test automation for End-To-End testing and Regression Testing. This organisation has a global presence with offices in USA, UK, Germany, Austria and India … project completion. You will be required to go through BPSS clearance for this role. To be considered you must have a deep background in ETL and AWS and will bring the following: Hands-on Testing experience with Test Automation Experience covering Data Pipelines in an AWS environment Experience working hands … professional development and career progression opportunities, a competitive basic of up to £70k + benefits. If you have a deep understanding and experience within ETL testing and AWS Technologies then APPLY NOW for immediate consideration more »

business-transforming decisions through data and analytics findings. THE ROLE AND RESPONSIBILITIES As a Data Analyst, your day to day will involve: Data Mining - extract insights, organize information effectively, and apply statistical analysis to identify actionable trends in market and law firm performance. Predictive Data Models - Develop predictive data models … you will require: Strong dashboarding experience in Power BI, with an understanding of DAX measures and data modelling. A strong understanding of data mining, ETL pipelines and processes. Experience working as a sole contributor is preferred. THE BENEFITS A salary of up to £50,000 in your first year. Flexible more »

sought by leading investment bank based in London - Hybrid - contract *inside IR35 - umbrella* Key Responsibilities: Design and implement scalable data pipelines that extract, transform and load data from various sources into the data Lakehouse. Help teams push the boundaries of analytical insights, creating new product features using data. Develop and … development of our data architecture and data governance capabilities. Develop and maintain data models and data dictionaries. Skills & Qualifications: Significant Experience with data modelling, ETL processes, and data warehousing. Significant exposure and hands on at least 2 of the programming languages - Python, Java, Scala, GoLang. Significant experience with Hadoop, Spark more »

Experience with Real Time data analysis and financial systems (preferred). Knowledge of database design principles, performance optimization, and Datamodelling. Familiarity with data integration, ETL processes, and data warehousing. Excellent problem-solving skills and the ability to work effectively in a fast-paced environment. Strong communication and teamwork skills. A more »

and Snowflake. Support Senior BI developer by overseeing the collection and integration of data from internal and external sources. Implement robust data pipelines and ETL processes to streamline data ingestion and transformation. Competence, Knowledge & Skills: Proven experience in a data management or analytics role within the financial services industry Proven more »

Databricks Spark Delta Lake SQL Python PySpark ADLS Day To Day Responsibilities: Extensive experience in designing, developing, and managing end-to-end data pipelines, ETL (Extract, Transform, Load), and ELT (Extract, Load, Transform) solutions. Maintains a proactive approach to staying updated with emerging technologies and a strong desire to continuously more »

Should have strong implementation experience in all the below technology areas (breadth) and deep technical expertise in some of the below technologies: Data integration – ETL tools like Talend and Informatica. Ingestion mechanism like Flume & Kafka Data modelling – Dimensional & transactional modelling using RDBMS, NO-SQL and Big Data technologies. Experience in more »