Databricks Spark Delta Lake SQL Python PySpark ADLS Day To Day Responsibilities: Extensive experience in designing, developing, and managing end-to-end data pipelines, ETL (Extract, Transform, Load), and ELT (Extract, Load, Transform) solutions. Maintains a proactive approach to staying updated with emerging technologies and a strong desire to continuously more »
West London, London, United Kingdom Hybrid / WFH Options
Morgan Hunt UK Limited
/SQL Proven expertise with Microsoft SQL Server Integration Services and BI tools like Power BI, Power Pivot, and SSRS Experience in data warehousing, ETL, data modelling, and data orchestration Excellent stakeholder management and communication skills A degree in Computer Science, IT, or a related STEM subject Morgan Hunt is more »
City Of London, England, United Kingdom Hybrid / WFH Options
Morgan Hunt
/SQL Proven expertise with Microsoft SQL Server Integration Services and BI tools like Power BI, Power Pivot, and SSRS Experience in data warehousing, ETL, data modelling, and data orchestration Excellent stakeholder management and communication skills A degree in Computer Science, IT, or a related STEM subject Morgan Hunt is more »
demonstrate working on large engagements * Experience of AWS tools (e.g. Athena, Redshift, Glue, EMR) * Java, Scala, Python, Spark, SQL * Experience of developing enterprise grade ETL/ELT data pipelines. * Deep understanding of data manipulation/wrangling techniques * Demonstrable knowledge of applying Data Engineering best practices (coding practices to DS, unit more »
open-source data engineering and scientific Python toolset. Our tech stack includes Airbyte for data ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data storage, emphasizing the importance of data integrity andmore »
London, England, United Kingdom Hybrid / WFH Options
Aventum Group
responsible for accessing, validating, and querying data from various repositories using available tools. Build and maintain data integration processes using SQL Services and other ETL/ELT processes and scripting tools as well as ongoing requests and projects related to the data warehouse, MI, or fast-moving financial data. Designing … Architecting, building, testing, and maintaining data platform. Develop and support a wide range of data transformations and migrations for the whole business. Construct custom ETL processes: Design and implement data pipelines, data marts and schemas, access versatile data sources and apply data quality measures. Monitoring the complete process and applying … ML is a plus Experience with Azure SQL Database, Cosmos DB, NoSQL, MongoDB Experience with Agile, DevOps methodologies Awareness and knowledge of ELT/ETL, DWH, APIs (RESTful), Spark APIs, FTP protocols, SSL, SFTP, PKI (Public Key Infrastructure) and Integration testing Skills and Abilities Knowledge of Python, SQL, SSIS, andmore »
high-performance data systems that are foundational to driving business growth and success. Key responsibilities: Implementing scalable data architectures and systems. Developing and maintaining ETL (Extract, Transform, Load) pipelines. Managing data storage, backup, and recovery mechanisms. Writing complex SQL queries to extract data for analysis. Developing and implementing data security more »
requirements into technical requirements & development experience using data discovery tools such as MS Power BI, QlikView, Tableau Ability to model andtransform data, build ETL solutions and present data in a useful business context Experience developing data warehouses & data marts using the Kimball methodology Experience or awareness of Big Data more »
Databricks, Power BI Strong in delivering solutions at scale, on time and within budget. Strong background in data warehousing, data architecture, data modelling, integration, ETL/ELT processes Please apply as directed more »
and Business teams to enhance our customer-centric culture. Ideal Candidate Profile: Proven track record in big data engineering with a solid understanding of ETL pipelines and data system projections. Proficiency in Python, PySpark, SQL, and familiarity with data science tools like R, ML, AI. Strong foundation in database management more »
South East London, London, United Kingdom Hybrid / WFH Options
Stepstone UK
Occasionally, being able to lend hands-on support to the team working on and using the following technologies:Data Warehousing, Data Modelling, Database Design, ETL, AWS Redshift, SQL Server, Power BI, Cloud/DevOps AWS, Docker, Terraform, Bitbucket, Bamboo, Team City, Octopus CI/CD deploy pipeline, Agile, pair programming more »
City of London, London, United Kingdom Hybrid / WFH Options
In Technology Group Limited
you apart. Experience with DevOps practices, CI/CD pipelines, and deployment automation is a definite plus. If you have experience in data modeling, ETL processes, and data analytics/reporting tools like PowerBI, we'd love to hear about it. Show us your excellent interpersonal skills and ability to more »
working with relational databases Experience in data visualization best practices and storytelling with data Understanding of business intelligence concepts and data analytics Knowledge of ETL processes and data integration Experience with data warehousing and data governance Strong problem-solving and analytical skills Excellent communication and collaboration abilities Attention to detail more »
engineers, providing guidance, coaching, and support to foster their professional growth and development. You will lead the delivery, implementation, and optimization of data pipelines, ETL processes, and data warehouse solutions to support business requirements, analytical and data science needs. You will collaborate with cross-functional teams including data science, analytics more »
SSAS). Ability to translate business requirements into technical solutions. Skills in data discovery tools (Power BI, QlikView, Tableau). Experience with data modeling, ETL development, and Kimball methodology. Awareness of Big Data and Data Science technologies. UK applicants only. Contact Faye at 0203 800 0792 or submit your CV. more »
City of London, London, United Kingdom Hybrid / WFH Options
Tech Talent Identified Ltd
Data science, machine learning & AI Data compliance standards and regulations: PII, GDPR, CCPA, etc Experience of handling PII datasets and operationalising DSAR Experience of ETL processes and governance Appropriate use of data cleansing techniques and tools Demonstrable experience creating and managing backlogs to meet strategic objectives Articulate, able to create more »
Greater London, England, United Kingdom Hybrid / WFH Options
Cognitive Group | Part of the Focus Cloud Group
business requirements into technical specifications Hands-on experience with data discovery tools like MS Power BI, QlikView, Tableau Proficiency in modelling and transforming data, ETL solutions, and presenting data contextually Experience in developing data warehouses & data marts following the Kimball methodology Strong communication and problem-solving skills Interested in staying more »
City of London, London, United Kingdom Hybrid / WFH Options
Nigel Frank International
to (url removed) or alternatively, give me a call on (phone number removed). Keywords: Azure, Microsoft SQL Server, SQL Server, Data Platform, Databricks, ETL, DevOps, Data Warehouse, Architecture, Development, SSIS, T-SQL, SQL, ADF, Data Factory, RDBMS, London more »
Greater London, England, United Kingdom Hybrid / WFH Options
Annalect
global business logic into the output’s tables. Ensure a high level of data governance across all data sources Assist in monitoring and improving ETL processes Produce recommendations based on findings Feedback any highlights/concerns to the team. Work closely with wider MI & R and TSOC teams such as more »
and Machine Learning engineers and it is responsible for supporting data scientists in deploying, maintaining and monitoring an increasing number of Python-based microservices, ETL pipelines, SaaS models, databases and vector stores. The MLOps Lead would need to act as an interface between data scientists, the data & analytics team andmore »
a hands-on role in their realisation. Expertly use Azure data services (including Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and others) to extract, transform, andload (ETL) data from various sources. Take initiative in data governance and quality control tasks, ensuring the integrity and security of client data more »
communication skills and ability to work effectively in a remote setting. Nice to Haves: + Experience with SQL Server Integration Services (SSIS) or similar ETL tools. + Understanding of Authentication via SSO + Experience with Infrastructure as Code (Azure ARM/Bicep) What’s on Offer: + A fully remote more »
London, England, United Kingdom Hybrid / WFH Options
Chapman Tate Associates
is an exciting opportunity to contribute to the success of a forward-thinking property management company. Responsibilities: Design, develop, and maintain data pipelines andETL processes using Azure Data Factory. Optimize data storage and retrieval processes to ensure scalability, reliability, and performance. Collaborate with cross-functional teams to understand data more »
career. Candidates must have the following Strong Developer experience on C# Azure, Logic Apps Database experience SQL Server Data Factory/Data Warehousing/ETL Skills required: Experience of developing technology solutions for large, complex business change programmes Experience of working on MS Azure Platform Experience of MS DevOps (VSTS more »
and translate them into analytical solutions. Develop and maintain BI reports, dashboards, and visualisations using tools such as Power BI, Tableau, or similar platforms. Extract, transform, andload (ETL) data from various sources to create centralised datasets for analysis. Perform data analysis to identify trends, patterns, and opportunities for improvement. more »