applications, components and tools according to the technical plans set by the Development Technical Lead. Knowledge and experience required: In-depth working knowledge of ETL/ELT, data warehousing/business intelligence methodologies including dealing with big data, cloud technology and unstructured data Knowledge of star schema structure & design, detailed … Data Factory, Event Hubs, Data Lake, Synapse, Azure SQL server. Detailed knowledge in developing in Databricks and experience in coding with PySpark. Spark SQL ETL coding standards: ensuring that code is standardised, self-documenting and can be reliably tested Knowledge of best practice data encryption techniques and standards This will more »
Central and North West London NHS Foundation Trust
and social care data sets (MHSDS, CSDS, CDS, RAP etc.) oExcellent knowledge of concepts of data analysis and visualisation oExcellent knowledge of database management, ETL process and transactional SQL oUnderstanding of information technology infrastructure requirements in relation to data flows. oExcellent time and workload management skills. oAble to manage andmore »
Functions and Stored Procedures to optimise database operations - Utilise Reporting Services (SSRS) and Integration Services (SSIS) for data handling and reporting - Design and maintain ETL/ELT pipelines using modern tools to support data integration and transformation - Leverage Azure cloud services to enhance database performance and scalability Skills and experience … required: - Proven experience of the MS SQL Server Stack (SSIS, SSRS, SSAS) - Experience in SQL coding for development purposes - Proficient in building and maintaining ETL pipelines - 2-4 years experience in a similar SQL Development role within either Financial Services/Accounting/Professional Services - CCH Central experience would be more »
data structures and pipelines to organize, collect, cleanse, and standardize data to generate actionable insights and address reporting needs. Using data mining techniques to extract information from data sets and identify correlations and patterns Lead the data modelling, data mapping and data solution testing activity on projects within the role … focused, with ability to meet agreed deadlines and delivery high quality output Technical Expectations Demonstrable experience of working in a data integration-related role, ETL processes and data warehousing principles A strong understanding and experience in key data modelling methodologies, techniques and concepts (dimensional modelling, entity relationship modelling, logical & physical … models) Experience with at least one of the reporting tool - QlikSense/Tableau/Power BI Proficient in SQL, ETL framework, Alteryx or similar technology, Python, GCP (Big Query), QlikSense preferred. Familiarity with Data Science concepts and subjects and an interest in up-skilling in the future Competencies Strong communicator more »
platform, including knowledge about its architecture, services, and security measures. * Data Engineering: A strong background in data engineering, with thorough understanding of concepts like ETL (Extract, Transform, Load), data cleaning, data structures, and data warehousing. * Azure Data Services: Hands-on experience with Azure data services like Azure SQL Database, Azure more »
deadlines. Develop and uphold the best practice standards, design patterns and documentation for data management and data engineering. Design, build, and manage data pipelines, ETL processes, and data orchestration workflows that transfer data smoothly across different systems and platforms. Create system design for integrating and managing data. Ensure that you more »
EC2M, Coleman Street, Greater London, United Kingdom
Devonshire Hayes Recruitment Specialists Ltd
of MS Office, MS Project and Visio. SDLC methodology. Testing in an Agile (SCRUM) environment. A minimum of 10 years of Automation testing experience ETL testing experience. Test leadership and execution of functional and non-functional testing in an Agile (SCRUM) environment. Integrating automated test cases with CI/CD more »
and optimize data platforms leveraging AWS and key technologies like CDAP, Snowflake, and Databricks. You will design and implement robust and scalable data pipelines, ETL, and analytics systems in the cloud. Responsibilities: Develop and enhance data pipelines, ETL processes using CDAP on AWS infrastructure. Build data integration flows to migrate … Hands-on experience with AWS services like S3, EC2, and EMR. Proficiency in SQL and experience with CDAP, Spark, and Kafka. Experience building scalable ETL processes and workflows. Strong programming ability with Python, Java, and unit testing. Infrastructure-as-code expertise with CI/CD pipelines. Ability to communicate complex more »
management of an Azure cloud-based data & analytics platform. Comprehensive experience in the complete data pipeline development process, encompassing data warehousing, data analytics, andETL processes. Profound understanding of best practices in data governance, privacy, and quality. Exceptional skills in communication, leadership, and team management. Capability to handle multiple tasks more »
Base Azure or AWS or GCP Python/PySpark Proficiency in SQL and/or similar data technologies Familiarity with data pipeline tools andETL processes Knowledge of cloud platforms and data architecture Additional Skills: Excellent communication and stakeholder management skills Ability to translate complex data into actionable insights. Strong more »
Hackney, Greater London, Shoreditch, United Kingdom
Talent Smart
We are seeking a highly skilled and motivated Data Engineer. The ideal candidate will have extensive experience in data engineering, particularly with Snowflake, ETL processes, and Power BI. The Data Engineer will be responsible for designing, developing, and maintaining our data infrastructure, ensuring seamless data integration and delivery of high … quality insights. Key Responsibilities: Data Pipeline Development: Design, build, and maintain efficient and reliable ETL processes to move data from various sources into our Snowflake data warehouse. Data Modelling: Develop and maintain data models and schemas to support business needs and ensure data integrity and quality. Data Integration: Integrate data … experience in data engineering or a related role. Proven experience with Snowflake data warehouse, including data loading, transformations, and performance tuning. Strong expertise in ETL tools and processes (e.g., Talend, Informatica, Apache Nifi, etc.). Experience with data visualization tools, particularly Power BI. Excellent problem-solving and analytical skills. Strong more »
Power BI Developer (Powe Apps, Data Warehouse, Modelling, ETL) Hybrid - London (Travel to other sites) £50,000 - £60,000 + 5% performance related bonus + 4% pension contribution + Company benefits Are you a Power BI Developer looking to contribute to a thriving establishment where you will be given the … Data Warehouse and modelling Experience of Dax Experience of premium capacity management Experience of Power Apps Key words: Power BI, DAX, Data Warehouse, Modelling, ETL, SQL Developer, Hybrid jobs, remote jobs Reference: BBBH13882 If you're interested in this role, click 'apply now' to forward an up-to-date copy more »
Databricks best practices. - Maintain data integrity, security, and compliance with regulations like GDPR. - Manage data migration from legacy analytics data warehouses, data lakes, andETL tools to Databricks within set deadlines. - Comfortable operating in all project phases, adjusting requirements, and supporting the transition from build and migration to production. - Serve more »
information technology, or a related field. Proven experience with Insurance Broking Systems data migration (ideally Acturis). Proficiency in SQL and SSIS. Experience with ETL tools. Strong analytical and critical thinking skills, with a focus on practical solutions. Excellent communication and people skills for conveying data concepts to diverse audiences. more »
with the best data solutions. Working with and modelling data warehouses. Skills & Qualifications Strong technical expertise using SQL Server and Azure Data Factory for ETL Solid experience with Databricks, PySpark etc. Understanding of Agile methodologies including use of Git Experience with Python and Spark Benefits £65,000 - £75,000 Bonus more »
engineers. Proficiency in Azure (including services like Azure Data Factory, Azure Databricks, etc.). Strong programming skills in Python . Familiarity with data modeling, ETL processes, and data warehousing. Excellent communication and leadership abilities. Additional Information: This role offers a £100k + performance-based bonus, and comprehensive benefits package. Candidates more »
cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement … technologies! Requirements: Strong development skills in SQL, and ideally Python or Spark Strong experience in data solutions design and development including SQL Data Warehousing, ETLand Data Integration solutions Strong experience designing and developing data pipelines using Azure Data Factory Strong experience with Azure Databricks Some knowledge of the Azure more »
cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement … technologies! Requirements: Strong development skills in SQL, and ideally Python or Spark Strong experience in data solutions design and development including SQL Data Warehousing, ETLand Data Integration solutions Strong experience designing and developing data pipelines using Azure Data Factory Strong experience with Azure Databricks Some knowledge of the Azure more »
SE1, Chaucer, Greater London, United Kingdom Hybrid / WFH Options
Royal College Of Obstetricians And Gynaecologists
through to developing user reports. They will work on the technical aspects of system integration and be involved in the development and maintenance of ETL (extract, transform, load) processes across all systems. The post holder will work closely with colleagues across the organisation to gather requirements and ensure data integrity … ensure that our technical solutions are fully integrated into business processes. Responsibilities: Advanced T-SQL and SSIS development for the creation and maintenance of ETLand reporting solutions. To lead the development and maintenance of custom applications to provide bespoke functionality, for example using .NET Framework, C# or Python. Development … expertise to internal stakeholders for College supported databases. Requirements: Experience of Advanced T-SQL querying and development: Stored Procedures, Views, functions etc. Experience of ETL development using SSIS or similar Knowledge of database and data warehouse design principles Experience of developing and maintaining custom applications to provide bespoke functionality, for more »
South East London, London, United Kingdom Hybrid / WFH Options
The Bridge (IT Recruitment) Limited
Python Developer, on a long term contract, inside IR35 on a remote basis. The key skills required for this Python Developer role are: Python ETL Azure Databricks Pyspark If you do have the required skills for this remote Python Developer contract, please do apply. more »