Databricks best practices. - Maintain data integrity, security, and compliance with regulations like GDPR. - Manage data migration from legacy analytics data warehouses, data lakes, andETL tools to Databricks within set deadlines. - Comfortable operating in all project phases, adjusting requirements, and supporting the transition from build and migration to production. - Serve more »
data pipelines for data ingestion, processing, and transformation in Azure. Utilise Azure Data Factory, Azure Databricks and SAP Business Objects to create and maintain ETL operations. Deliver dashboard reporting and data sets which are interactive and user-friendly via PowerBI Identifying and integrating external data into the business data model more »
Greater Bristol Area, United Kingdom Hybrid / WFH Options
Anson McCade
consulting firm. Proficiency in Azure data services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, etc. Strong understanding of ETL processes, data modeling, and data warehousing principles. Experience with programming languages such as SQL and Python. Familiarity with data visualization tools such as Power BI more »
Manchester Area, United Kingdom Hybrid / WFH Options
Forsyth Barnes
reliable within the Google Cloud Platform. Effective documentation and communication of solutions to both technical and non-technical stakeholders are essential. Candidate Profile: Extensive ETL/ELT background with experience in developing data pipelines, optimizing queries, and enhancing database performance. Proficient in data modeling and data warehousing. Multiple years of more »
Preston, Lancashire, United Kingdom Hybrid / WFH Options
Forsyth Barnes
within the Google Cloud Platform. Effective documentation and communication of solutions to both technical and non-technical stakeholders are essential. Candidate Profile: l Extensive ETL/ELT background with experience in developing data pipelines, optimizing queries, and enhancing database performance. l Proficient in data modeling and data warehousing. l Multiple more »
Newcastle Upon Tyne, Tyne and Wear, North East, United Kingdom
Reed Technology
of the below: - Cloud technology (Azure or AWS) - this organisation are migrating to cloud soon, so any experience here would be great - Data engineering (ETL) - designing and developing processes, both on-premise and maybe even cloud - Exposure to BI Tooling - Power BI would be great, however other tool are considered more »
to work with a team of experts who are passionate about harnessing data to create impactful solutions. Key Responsibilities: • Design, develop, and maintain robust ETL (Extract, Transform, Load) processes to ensure efficient data flow and integration across various systems. • Utilize Python for data manipulation, transformation, and automation tasks. • Collaborate with … a Data Engineer or in a similar role. • Strong proficiency in Python and experience with relevant libraries (e.g., pandas, numpy). • Extensive experience with ETL tools and processes. • Familiarity with data warehousing concepts and technologies (e.g., Redshift, BigQuery, Snowflake). • Proficient in SQL and experience with relational databases (e.g., PostgreSQL more »
to work with a team of experts who are passionate about harnessing data to create impactful solutions. Key Responsibilities: Design, develop, and maintain robust ETL (Extract, Transform, Load) processes to ensure efficient data flow and integration across various systems. Utilize Python for data manipulation, transformation, and automation tasks. Collaborate with … a Data Engineer or in a similar role. Strong proficiency in Python and experience with relevant libraries (e.g., pandas, numpy). Extensive experience with ETL tools and processes. Familiarity with data warehousing concepts and technologies (e.g., Redshift, BigQuery, Snowflake). Proficient in SQL and experience with relational databases (e.g., PostgreSQL more »
Lancashire, North West, United Kingdom Hybrid / WFH Options
JLA Resourcing Ltd
with key stakeholders across the business to understand how data can be used to improve business performance - Develop and create the data sets, repositories, extract/transform/load routines and validation mechanisms - Establish the integration with all databases and software systems - currently in place is Netsuite as the ERP more »
levers, and lead metrics for performance improvement. Develop and create the data sets needed for BI and analytics including, where needed, the data repositories, Extract/Transform/Load routines and validation mechanisms needed to underpin reporting and analysis. Establish the integration with other databases and systems in conjunction with more »
and communicate how our data inputs and outputs affect different groups and identify areas Janes can provide additional value. Requirements Experience architecting and developing ETL pipelines solutions for the ingestion, transformation, and serving of data, as well as solutions for the orchestration of pipeline components (e.g. AWS Step Functions, Apache more »
London, Liverpool, Merseyside, United Kingdom Hybrid / WFH Options
Opus Recruitment Solutions
working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines andETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data more »
systems. Promote best practices and principles of data quality throughout the organisation. Required Skills and Experience: Advanced proficiency in MS SQL Extensive experience with ETL techniques, data warehouse design, and data visualisation Command of Microsoft tools such as Fabric, Data Factory, and Power BI Excellent communication, presentation, and stakeholder management more »
. Knowledge of SQL and experience with relational databases, as well as NoSQL databases Familiarity with cloud services (preferably GCP ) and understanding of its ETL frameworks. Desired : experience with data pipeline and workflow management (Airflow, Composer). Desired : Familiarity with machine learning algorithms and data science principles is a plus. more »
Engineer, develop, and optimize code to ensure business processes support organizational growth. Essential Requirements: Proven track record in designing and building data infrastructure andETL pipelines. Proficiency in Azure Platform, including Data Lake, Data Factory, Synapse, Logic Apps, and Function Apps etc. SQL Server, including Store Procedures, T-SQL, or more »
deadlines. Develop and uphold the best practice standards, design patterns and documentation for data management and data engineering. Design, build, and manage data pipelines, ETL processes, and data orchestration workflows that transfer data smoothly across different systems and platforms. Create system design for integrating and managing data. Ensure that you more »
Exeter, Devon, South West, United Kingdom Hybrid / WFH Options
Bowerford Associates
to 5 years minimum experience working as a Data Engineer, utilising the following technologies, languages, tools and methodologies: - Databricks Python TSQL/T-SQL ETL Test Automation Unit Testing/Mocking Refactoring Agile/Scrum Methodologies Any experience working with the following is an advantage but is NOT essential: - PowerShell more »
guide and motivate junior team members Deep understanding of the Microsoft technology stack, specifically PowerBI, Databricks & Azure Cloud Proficiency in SQL, strong understanding of ETLand ELT processes Strong communication skills, ability to translate complex messages into concise, easy-to-understand messages Strong story telling skills, ability to influence decision more »
South East London, London, United Kingdom Hybrid / WFH Options
Stepstone UK
Occasionally, being able to lend hands-on support to the team working on and using the following technologies:Data Warehousing, Data Modelling, Database Design, ETL, AWS Redshift, SQL Server, Power BI, Cloud/DevOps AWS, Docker, Terraform, Bitbucket, Bamboo, Team City, Octopus CI/CD deploy pipeline, Agile, pair programming more »
delivery. Experience working in an Agile development environment. Passion for engineering excellence through automation, unit testing, and process improvements. Experience with data integration andETL tools (both productized and open source) We're Even More Excited If You Have: Open source contributor. 3+ years of experience with a public cloud more »
in Computer Science, Applied Mathematics, Engineering, or any other technology related field. Approximately 5 years of working experience as a data engineer Proficient in ETL solutions across Microsoft Azure and Google Cloud Platform. Very good practical knowledge SQL, Python and data platform management. Advanced working SQL knowledge and experience working more »
ability to proactively maintain existing and develop new procedures for information provision with One Version of the Truth and the troubleshooting of server andETL issues; including the ability to allow for integration with other technologies such as powershell, web development and other application developments 5.10Expected to provide training in more »
Reporting andETL Developer, Dynamics 365, D365, D365 F&O, D365 Consultant, AX 2012, Dynamics AX, Microsoft power BI, SSRS, ETL, Reporting developer, SQL, Azure synapse, Data Lake, Lake House, Delta Lake, Data verse, DAX, BI reports, Paginated Report Builder, South London, Hybrid, £60-£75K Our end user client requires … a Reporting andETL Developer to join them on a permanent basis to work on their D365 FO implementation. As a Technical Resource, you will play a pivotal role in supporting analytics and reporting efforts within Dynamics 365. It will be a Hybrid role with a requirement to be onsite … Analytics and Reporting: Collaborating with cross-functional teams to identify reporting requirements, design dashboards, and generate insights that drive business decisions. SQL Experience for ETL: Designing and executing Extract, Transform, Load (ETL) processes using SQL to facilitate data integration and reporting. Azure Resource Procurement: Procuring resources in Azure Portal to more »
Manchester, North West, United Kingdom Hybrid / WFH Options
Adria Solutions
Strong network and firewall knowledge Strong Information Security and IT security/Cyber controls Deep experience/understanding of all elements of data engineering (extract/transform/load), visualization, analytics, and machine learning Designing, deploying, maintaining, and developing data systems and controls. Benefits This is a fantastic opportunity for more »
D365 F&SCM, Dynamics365 F&SCM, Finance & Supply Chain Management, Project Operations, Project Ops, Data Migration Consultant, Data Migration, D365 Data Model, Data Architecture, ETL, MS SQL, SQL Server Management Studio, SSMS, PowerBI, Dataverse, D365 FSCM APIs, Azure, DevOps – FTC – Hybrid – London - £60,000-£65,000 Our global end user more »