Mathematics Preferred : Experience in the financial services industry, preferably with exposure to market risk or counterparty credit risk applications Experience in ETL (extract, transformandLoad) development Some Cloud experience will be a nice plus. Personal Attributes: Strong analytical, verbal and written communication skills Self-starter and entrepreneurial in approach More ❯
to data storage and processing systems. This includes automating data collection, cleaning, and integration processes to support analytics and reporting needs. Develop and optimize ETL processes: Create and enhance ETL (Extract, Transform, Load) processes to extract data from multiple sources, transform it into a usable format, andload it into … Perform regular database tuning, indexing, and query optimization to maintain high performance and reliability. Create and maintain documentation: Develop comprehensive documentation for data pipelines, ETL processes, and data architecture. Ensure that documentation is up-to-date, clear, and accessible to relevant stakeholders, facilitating knowledge sharing and continuity. Monitor and troubleshoot More ❯
services. Knowledge of using PySpark in notebooks for data analysis and manipulation. Strong proficiency with SQL and data modelling. Experience with modern ELT/ETL tools within the Microsoft ecosystem. Solid understanding of data lake and lakehouse architectures. Hands-on experience with Power BI for data integration and visualisation. Familiarity More ❯
services. Knowledge of using PySpark in notebooks for data analysis and manipulation. Strong proficiency with SQL and data modelling. Experience with modern ELT/ETL tools within the Microsoft ecosystem. Solid understanding of data lake and lakehouse architectures. Hands-on experience with Power BI for data integration and visualisation. Familiarity More ❯
south west london, south east england, United Kingdom
Agile
services. Knowledge of using PySpark in notebooks for data analysis and manipulation. Strong proficiency with SQL and data modelling. Experience with modern ELT/ETL tools within the Microsoft ecosystem. Solid understanding of data lake and lakehouse architectures. Hands-on experience with Power BI for data integration and visualisation. Familiarity More ❯
Modelling, Database & Data Platform Design. Proficiency in creating logical & physical data models. Knowledge of relational (SQL) and non-relational (NoSQL) database systems. Understanding of ETL/ELT Processes. Solid understanding of Data Integration & Architecture. Experience with data integration. Data warehousing concepts. Data flow design. Experience working with cloud computing on More ❯
transparency and standardization across teams. Data Migration & Transformation: - Lead data migration efforts, particularly during system upgrades or transitions to new platforms. - Define and implement ETL (Extract, Transform, Load) processes for transforming data into usable formats for analytics and reporting. Documentation and Reporting: - Document data architecture designs, processes, and standards for … big data platforms (e.g., Hadoop, Spark, Kafka). • Familiarity with cloud-based data platforms and services (e.g., AWS, Azure, Google Cloud). • Expertise in ETL tools and processes (e.g., Apache NiFi, Talend, Informatica). • Proficiency in data integration tools and technologies. • Familiarity with data visualization and reporting tools (e.g., Tableau More ❯
transparency and standardization across teams. Data Migration & Transformation: - Lead data migration efforts, particularly during system upgrades or transitions to new platforms. - Define and implement ETL (Extract, Transform, Load) processes for transforming data into usable formats for analytics and reporting. Documentation and Reporting: - Document data architecture designs, processes, and standards for … big data platforms (e.g., Hadoop, Spark, Kafka). • Familiarity with cloud-based data platforms and services (e.g., AWS, Azure, Google Cloud). • Expertise in ETL tools and processes (e.g., Apache NiFi, Talend, Informatica). • Proficiency in data integration tools and technologies. • Familiarity with data visualization and reporting tools (e.g., Tableau More ❯
transparency and standardization across teams. Data Migration & Transformation: - Lead data migration efforts, particularly during system upgrades or transitions to new platforms. - Define and implement ETL (Extract, Transform, Load) processes for transforming data into usable formats for analytics and reporting. Documentation and Reporting: - Document data architecture designs, processes, and standards for … big data platforms (e.g., Hadoop, Spark, Kafka). • Familiarity with cloud-based data platforms and services (e.g., AWS, Azure, Google Cloud). • Expertise in ETL tools and processes (e.g., Apache NiFi, Talend, Informatica). • Proficiency in data integration tools and technologies. • Familiarity with data visualization and reporting tools (e.g., Tableau More ❯
london, south east england, United Kingdom Hybrid / WFH Options
Substance Global
which will enable users across the organization to self-serve analytics. Strong Python (Pandas/SQL Alchemy) & SQL(BigQuery/Snowflake) skills for maintaining ETL/ELT pipelines. Developing tools and processes to ensure the quality and observability of data Monitoring and improving the performance and efficiency of the data More ❯
services including BigQuery, Composer, Dataform, DataProc, and Pub/Sub. Strong programming experience with Python, PySpark, and SQL. Hands-on experience with data modelling, ETL processes, and data quality frameworks. Proficiency with BI/reporting tools such as Looker or PowerBI. Excellent communication and stakeholder management skills. Desirable Experience: Google More ❯
london, south east england, United Kingdom Hybrid / WFH Options
Anson McCade
services including BigQuery, Composer, Dataform, DataProc, and Pub/Sub. Strong programming experience with Python, PySpark, and SQL. Hands-on experience with data modelling, ETL processes, and data quality frameworks. Proficiency with BI/reporting tools such as Looker or PowerBI. Excellent communication and stakeholder management skills. Desirable Experience: Google More ❯
City of London, London, United Kingdom Hybrid / WFH Options
JLA Resourcing Ltd
of DevOps, CI/CD, and modern software development practices. Solid experience with Python (especially data and machine learning libraries). Experience working with ETL platforms and cloud-based data engineering tools (AWS, Azure, or OCI). Excellent communication skills and a solutions-focused mindset. Desirable experience includes: AWS or More ❯
City of London, London, United Kingdom Hybrid / WFH Options
JLA Resourcing Ltd
of DevOps, CI/CD, and modern software development practices. Solid experience with Python (especially data and machine learning libraries). Experience working with ETL platforms and cloud-based data engineering tools (AWS, Azure, or OCI). Excellent communication skills and a solutions-focused mindset. Desirable experience includes: AWS or More ❯
Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure. Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations Use Azure Data Factory and Databricks to assemble large, complex data sets Implementing data validation and cleansing procedures will ensure the … 5+ years of experience, analytical problem-solving, and collaboration with cross-functional teams Azure DevOps Apache Spark, Python Strong SQL proficiency Data modeling understanding ETL processes, Azure Data Factory Azure Databricks knowledge Familiarity with data warehousing Big data technologies Data governance principles are a plus Overview: Infosys is a global More ❯
and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency and reliability. Project & Improvement: Assist in gathering, documenting, and managing data engineering requirements and workflows. Contribute to the development … reviews of designs, prototypes, and other work products to ensure requirements are met. Skills & Experience: Essential: Basic understanding of data engineering concepts, such as ETL processes, data pipelines, and data quality management. Hands-on experience with SQL (e.g., writing queries, basic database management). Familiarity with data tools and platforms More ❯
encryptions, etc.). In-depth knowledge and experience with Azure data storage (SQL Server, Data lake, Synapse, etc.) & access tools, APIs, cloud connectivity, andETL processes. Knowledge and some experience of MS Office/MS Office 365 suite, SharePoint Online, Power Apps, GitHub, MS Teams, etc. In-depth knowledge & experience More ❯
senior stakeholders Comfortable in agile, fast-paced delivery environments ⭐ Desirable: Insurance sector experience Familiarity with cloud platforms (Azure, AWS, GCP) Experience with DataLake/ETL tools (e.g. Databricks, Synapse, Dataiku) Documenting technical data requirements and designing data tests 🎓 Qualifications: BSc or higher in Computer Science, Maths, Economics, or related field More ❯
senior stakeholders Comfortable in agile, fast-paced delivery environments ⭐ Desirable: Insurance sector experience Familiarity with cloud platforms (Azure, AWS, GCP) Experience with DataLake/ETL tools (e.g. Databricks, Synapse, Dataiku) Documenting technical data requirements and designing data tests 🎓 Qualifications: BSc or higher in Computer Science, Maths, Economics, or related field More ❯
senior stakeholders Comfortable in agile, fast-paced delivery environments ⭐ Desirable: Insurance sector experience Familiarity with cloud platforms (Azure, AWS, GCP) Experience with DataLake/ETL tools (e.g. Databricks, Synapse, Dataiku) Documenting technical data requirements and designing data tests 🎓 Qualifications: BSc or higher in Computer Science, Maths, Economics, or related field More ❯
strengthen our growing data practice. As a data engineer/scientist, you will: Data Engineering Focus: Design, implement, and maintain scalable data pipelines andETL processes Develop and maintain data warehouses and data lakes Implement data quality monitoring and validation systems Create and maintain data documentation and cataloguing systems Optimize More ❯
and machine learning workloads. - Write clean, efficient, and maintainable code in Python and C# for data processing, transformation, and integration tasks. - Implement data ingestion, ETL/ELT processes, and data warehousing solutions. - Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions. - Ensure data quality, security More ❯
and machine learning workloads. - Write clean, efficient, and maintainable code in Python and C# for data processing, transformation, and integration tasks. - Implement data ingestion, ETL/ELT processes, and data warehousing solutions. - Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions. - Ensure data quality, security More ❯
london, south east england, United Kingdom Hybrid / WFH Options
Methods
and machine learning workloads. - Write clean, efficient, and maintainable code in Python and C# for data processing, transformation, and integration tasks. - Implement data ingestion, ETL/ELT processes, and data warehousing solutions. - Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions. - Ensure data quality, security More ❯
south west london, south east england, United Kingdom
SoftServe
IF YOU ARE Experienced with Python/PySpark Proficient working with Databricks Lakehouse architecture and principles Having 2+ years of designing data models, building ETL pipelines, and wrangling data to solve business problems Experienced with Azure cloud technologies Modern Data Estate such as Azure Data Factory, Azure DevOps, Azure Synapse More ❯