Mathematics Preferred : Experience in the financial services industry, preferably with exposure to market risk or counterparty credit risk applications Experience in ETL (extract, transformandLoad) development Some Cloud experience will be a nice plus. Personal Attributes: Strong analytical, verbal and written communication skills Self-starter and entrepreneurial in approach More ❯
to data storage and processing systems. This includes automating data collection, cleaning, and integration processes to support analytics and reporting needs. Develop and optimize ETL processes: Create and enhance ETL (Extract, Transform, Load) processes to extract data from multiple sources, transform it into a usable format, andload it into … Perform regular database tuning, indexing, and query optimization to maintain high performance and reliability. Create and maintain documentation: Develop comprehensive documentation for data pipelines, ETL processes, and data architecture. Ensure that documentation is up-to-date, clear, and accessible to relevant stakeholders, facilitating knowledge sharing and continuity. Monitor and troubleshoot More ❯
Modelling, Database & Data Platform Design. Proficiency in creating logical & physical data models. Knowledge of relational (SQL) and non-relational (NoSQL) database systems. Understanding of ETL/ELT Processes. Solid understanding of Data Integration & Architecture. Experience with data integration. Data warehousing concepts. Data flow design. Experience working with cloud computing on More ❯
IT Manager - The Skills You'll Need to Succeed: Mastery of Databricks, Python/PySpark, and SQL/SparkSQL. Experience in Big Data/ETL (Spark and Databricks preferred). Expertise in Azure. Proficiency with version control systems (Git preferred). Knowledge of and/or experience with CI/ More ❯
transparency and standardization across teams. Data Migration & Transformation: - Lead data migration efforts, particularly during system upgrades or transitions to new platforms. - Define and implement ETL (Extract, Transform, Load) processes for transforming data into usable formats for analytics and reporting. Documentation and Reporting: - Document data architecture designs, processes, and standards for … big data platforms (e.g., Hadoop, Spark, Kafka). • Familiarity with cloud-based data platforms and services (e.g., AWS, Azure, Google Cloud). • Expertise in ETL tools and processes (e.g., Apache NiFi, Talend, Informatica). • Proficiency in data integration tools and technologies. • Familiarity with data visualization and reporting tools (e.g., Tableau More ❯
transparency and standardization across teams. Data Migration & Transformation: - Lead data migration efforts, particularly during system upgrades or transitions to new platforms. - Define and implement ETL (Extract, Transform, Load) processes for transforming data into usable formats for analytics and reporting. Documentation and Reporting: - Document data architecture designs, processes, and standards for … big data platforms (e.g., Hadoop, Spark, Kafka). • Familiarity with cloud-based data platforms and services (e.g., AWS, Azure, Google Cloud). • Expertise in ETL tools and processes (e.g., Apache NiFi, Talend, Informatica). • Proficiency in data integration tools and technologies. • Familiarity with data visualization and reporting tools (e.g., Tableau More ❯
london, south east england, United Kingdom Hybrid / WFH Options
Substance Global
which will enable users across the organization to self-serve analytics. Strong Python (Pandas/SQL Alchemy) & SQL(BigQuery/Snowflake) skills for maintaining ETL/ELT pipelines. Developing tools and processes to ensure the quality and observability of data Monitoring and improving the performance and efficiency of the data More ❯
City of London, London, United Kingdom Hybrid / WFH Options
JLA Resourcing Ltd
of DevOps, CI/CD, and modern software development practices. Solid experience with Python (especially data and machine learning libraries). Experience working with ETL platforms and cloud-based data engineering tools (AWS, Azure, or OCI). Excellent communication skills and a solutions-focused mindset. Desirable experience includes: AWS or More ❯
City of London, London, United Kingdom Hybrid / WFH Options
JLA Resourcing Ltd
of DevOps, CI/CD, and modern software development practices. Solid experience with Python (especially data and machine learning libraries). Experience working with ETL platforms and cloud-based data engineering tools (AWS, Azure, or OCI). Excellent communication skills and a solutions-focused mindset. Desirable experience includes: AWS or More ❯
Engineer: Advanced SQL expertise is essential for querying, transforming, and managing data within databases to support business insights. Proven experience in developing and optimising ETL/ELT pipelines, particularly with tools like DBT, ensures efficient data transformation and modelling. A strong understanding of data modelling techniques, including star and snowflake More ❯
Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure. Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations Use Azure Data Factory and Databricks to assemble large, complex data sets Implementing data validation and cleansing procedures will ensure the … 5+ years of experience, analytical problem-solving, and collaboration with cross-functional teams Azure DevOps Apache Spark, Python Strong SQL proficiency Data modeling understanding ETL processes, Azure Data Factory Azure Databricks knowledge Familiarity with data warehousing Big data technologies Data governance principles are a plus Overview: Infosys is a global More ❯
encryptions, etc.). In-depth knowledge and experience with Azure data storage (SQL Server, Data lake, Synapse, etc.) & access tools, APIs, cloud connectivity, andETL processes. Knowledge and some experience of MS Office/MS Office 365 suite, SharePoint Online, Power Apps, GitHub, MS Teams, etc. In-depth knowledge & experience More ❯
senior stakeholders Comfortable in agile, fast-paced delivery environments ⭐ Desirable: Insurance sector experience Familiarity with cloud platforms (Azure, AWS, GCP) Experience with DataLake/ETL tools (e.g. Databricks, Synapse, Dataiku) Documenting technical data requirements and designing data tests 🎓 Qualifications: BSc or higher in Computer Science, Maths, Economics, or related field More ❯
senior stakeholders Comfortable in agile, fast-paced delivery environments ⭐ Desirable: Insurance sector experience Familiarity with cloud platforms (Azure, AWS, GCP) Experience with DataLake/ETL tools (e.g. Databricks, Synapse, Dataiku) Documenting technical data requirements and designing data tests 🎓 Qualifications: BSc or higher in Computer Science, Maths, Economics, or related field More ❯
strengthen our growing data practice. As a data engineer/scientist, you will: Data Engineering Focus: Design, implement, and maintain scalable data pipelines andETL processes Develop and maintain data warehouses and data lakes Implement data quality monitoring and validation systems Create and maintain data documentation and cataloguing systems Optimize More ❯
and machine learning workloads. - Write clean, efficient, and maintainable code in Python and C# for data processing, transformation, and integration tasks. - Implement data ingestion, ETL/ELT processes, and data warehousing solutions. - Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions. - Ensure data quality, security More ❯
and machine learning workloads. - Write clean, efficient, and maintainable code in Python and C# for data processing, transformation, and integration tasks. - Implement data ingestion, ETL/ELT processes, and data warehousing solutions. - Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions. - Ensure data quality, security More ❯
london, south east england, United Kingdom Hybrid / WFH Options
Methods
and machine learning workloads. - Write clean, efficient, and maintainable code in Python and C# for data processing, transformation, and integration tasks. - Implement data ingestion, ETL/ELT processes, and data warehousing solutions. - Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions. - Ensure data quality, security More ❯
similar warehousing technology, real-time systems). Experience with AWS services such as Lambda, SNS, S3, EKS, API Gateway. Knowledge of data warehouse design, ETL/ELT processes, and big data technologies (e.g., Snowflake, Spark). Understanding of data governance and compliance frameworks (e.g., GDPR, HIPAA). Strong communication andMore ❯
london, south east england, United Kingdom Hybrid / WFH Options
Pace
ll be expected to lead by example across TDD practices, paired programming, CI/CD integration, and infrastructure automation. Key responsibilities: Develop and deploy ETL pipelines for data cleansing using Azure-based tooling. Build and maintain outbound/inbound API endpoints for downstream systems (e.g. reporting tools, finance systems). More ❯
plans What does Leidos need from me? Proven experience in front-end development with a focus on building data-driven applications. Experience working with ETL platforms Experience with Python and its numerical, data and machine learning libraries Experience of working in an agile software development environment Experience estimating task effort More ❯
initiatives and contribute to the development of innovative solutions. Responsibilities: Web Crawling and Data Extraction: Develop, deploy, and maintain web crawlers using Python to extract data from websites and social media platforms. Ensure the scalability, reliability, and efficiency of web scraping processes. Data Cleaning and Preprocessing: Perform data cleaning, standardization … to provide insights and support decision-making processes. Work with financial datasets to identify trends, patterns, and anomalies. Data Pipeline Development: Design and maintain ETL (Extract, Transform, Load) pipelines to streamline data workflows. Integrate data from multiple sources and ensure seamless data flow across systems. Collaboration and Communication: Work closely More ❯
initiatives and contribute to the development of innovative solutions. Responsibilities: Web Crawling and Data Extraction: Develop, deploy, and maintain web crawlers using Python to extract data from websites and social media platforms. Ensure the scalability, reliability, and efficiency of web scraping processes. Data Cleaning and Preprocessing: Perform data cleaning, standardization … to provide insights and support decision-making processes. Work with financial datasets to identify trends, patterns, and anomalies. Data Pipeline Development: Design and maintain ETL (Extract, Transform, Load) pipelines to streamline data workflows. Integrate data from multiple sources and ensure seamless data flow across systems. Collaboration and Communication: Work closely More ❯
initiatives and contribute to the development of innovative solutions. Responsibilities: Web Crawling and Data Extraction: Develop, deploy, and maintain web crawlers using Python to extract data from websites and social media platforms. Ensure the scalability, reliability, and efficiency of web scraping processes. Data Cleaning and Preprocessing: Perform data cleaning, standardization … to provide insights and support decision-making processes. Work with financial datasets to identify trends, patterns, and anomalies. Data Pipeline Development: Design and maintain ETL (Extract, Transform, Load) pipelines to streamline data workflows. Integrate data from multiple sources and ensure seamless data flow across systems. Collaboration and Communication: Work closely More ❯
charts and pivot tables), - Knowledge of data visualization tools such as Quick Sight, Tableau, Power BI or other BI packages - Fluency in SQL andETL PREFERRED QUALIFICATIONS - Knowledge of data modeling and data pipeline design - Masters degree in Business, Engineering, Statistics, Computer Science, Data Science, Mathematics or related field - Experience More ❯