hosted databases (Postgres, S3 based data lake, AWS glue MySQL, Athena); Integration services (AWS API gateway, lambda functions), nice to have MuleSoft or Axway; ETL services (AWS Glue, Step functions); Infrastructure a management tool such as Terraform and extensive use of SQLs, Python, and Node JS. The data engineering services … data warehouses; Collaborate with data visualisation and analysts’ teams to understand data requirements and translate them into technical specifications. Data Processing: Develop and maintain ETL (Extract, Transform, Load) processes for ingesting data from various sources into the data infrastructure; Optimise data processing and storage for performance and cost-effectiveness. Database more »
Manchester, North West, United Kingdom Hybrid / WFH Options
Adria Solutions
Strong network and firewall knowledge Strong Information Security and IT security/Cyber controls Deep experience/understanding of all elements of data engineering (extract/transform/load), visualization, analytics, and machine learning Designing, deploying, maintaining, and developing data systems and controls. Benefits This is a fantastic opportunity for more »
D365 F&SCM, Dynamics365 F&SCM, Finance & Supply Chain Management, Project Operations, Project Ops, Data Migration Consultant, Data Migration, D365 Data Model, Data Architecture, ETL, MS SQL, SQL Server Management Studio, SSMS, PowerBI, Dataverse, D365 FSCM APIs, Azure, DevOps – FTC – Hybrid – London - £60,000-£65,000 Our global end user more »
Visualisation and Design SQL (SQL Server) SSAS (Tabular) Relational and Dimensional Data Modelling Experience with Tabular Model development with the use of Visual Studio ETL (Data Cleansing/Quality) Experience working in an Agile environment utilising Agile SCRUM Nice to have experience working with: Power Platform (Automate, Apps, Fabric) Azure more »
experience within the industry Lead Engineering engagement with Actuarial SMEs and Underwriters Mentor Analytics Engineering team members to develop and maintain end-to-end ETL processes Maintain a high level of coding and technical standards across the team Demonstrate a high level of technical capability in Python, SQL, and JSON more »
Visualisation and Design SQL (SQL Server) SSAS (Tabular) Relational and Dimensional Data Modelling Experience with Tabular Model development with the use of Visual Studio ETL (Data Cleansing/Quality) Experience working in an Agile environment utilising Agile SCRUM Nice to have experience working with: Power Platform (Automate, Apps, Fabric) Azure more »
Employment Type: Permanent
Salary: £45000 - £55000/annum 25 Days holiday, Pension Scheme
Birmingham, West Midlands, West Midlands (County), United Kingdom
Spectrum IT Recruitment
Visualisation and Design SQL (SQL Server) SSAS (Tabular) Relational and Dimensional Data Modelling Experience with Tabular Model development with the use of Visual Studio ETL (Data Cleansing/Quality) Experience working in an Agile environment utilising Agile SCRUM Nice to have experience working with: Power Platform (Automate, Apps, Fabric) Azure more »
Employment Type: Permanent
Salary: £45000 - £55000/annum 25 Days holiday, Pension Scheme
London, England, United Kingdom Hybrid / WFH Options
McGregor Boyall
seeking Senior Data Engineers to contribute to innovative data projects within a leading financial institution. Key Responsibilities: Data Engineering: Design and implement data models, ETL processes, and data warehousing solutions. Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines. Distributed Processing: Work with Hadoop, Spark, andmore »
Azure data resources: Data Factory, Databricks, Storage Account, SQL Database, SQL Data Warehouse. Senior-level experience in data engineering, including designing data models andETL pipelines, engineering robust solutions, and conducting testing and QA. Expertise in Azure DevOps, with a focus on source repository control, CI/CD, and change more »
with the best data solutions. Working with and modelling data warehouses. Skills & Qualifications Strong technical expertise using SQL Server and Azure Data Factory for ETL Solid experience with Databricks, PySpark etc. Understanding of Agile methodologies including use of Git Experience with Python and Spark Benefits £65,000 - £75,000 Bonus more »
Azure data resources: Data Factory, Databricks, Storage Account, SQL Database, SQL Data Warehouse. Senior-level experience in data engineering, including designing data models andETL pipelines, engineering robust solutions, and conducting testing and QA. Expertise in Azure DevOps, with a focus on source repository control, CI/CD, and change more »
Better Placed Ltd - A Sunday Times Top 10 Employer in 2023!
Proficiency in SQL and other programming languages commonly used in data analysis and BI. Deep understanding of database management systems, data integration techniques, andETL processes. Excellent analytical and problem-solving skills, with the ability to turn complex data into meaningful insights. Strong communication and interpersonal skills, with the ability more »
Experience as a Business Intelligence Developer or similar role SQL Experience/Proficient in SQL coding. Understanding of data warehousing concepts, data modeling, andETL processes. Understanding of finance and accounting principles We celebrate diversity and encourage applicants from all whatever their background and/or disability. We want you more »
technologies (e.g., Kafka). Knowledge of cloud services and architecture (AWS, Azure, or GCP), particularly data storage and computing services. Experience with data integration, ETL processes, and familiarity with data warehousing solutions Proficiency in Python with a focus on data-centric programming. Experience with machine learning algorithms and data modelling more »
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
Primis
Scotland (Hybrid) - All employees must be eligible to work without sponsorship Salary: £70,000 - £85,000 The Role: Lead the Data team to deliver ETL processes, build and maintain data pipelines, enhance scalability, performance, maintainability, configurability and usability Be involved in the entire life-cycle of the Data Strategy, including more »
Sheffield, South Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Experis
concepts, including infrastructure as code, serverless computing, and containerization. Expertise in designing scalable and resilient architectures for data-intensive applications. Familiarity with data modeling, ETL processes, and data integration techniques. Proficiency in programming languages commonly used in cloud environments (e.g., Python, Java). Strong knowledge of security principles and best more »
Greater London, England, United Kingdom Hybrid / WFH Options
itecopeople
deadlines. Develop and uphold the best practice standards, design patterns and documentation for data management and data engineering. Design, build, and manage data pipelines, ETL processes, and data orchestration workflows that transfer data smoothly across different systems and platforms. Create system design for integrating and managing data. Ensure that you more »
quality Business Intelligence products and solutions Good understanding of the Microsoft technology stack, specifically PowerBI, Databricks & Azure Cloud Proficiency in SQL, good understanding of ETLand ELT processes Strong communication skills, ability to translate complex messages into concise, easy-to-understand messages Strong story telling skills, ability to create a more »
Purfleet, England, United Kingdom Hybrid / WFH Options
Carpetright
processes. Develop, optimise, and maintain Power BI Reports, Apps and Dashboards in line with business requirements, supporting continuous improvement. Responsible for the management of ETL processes, including but not limited to, D365 F&O data exports, SQL data transformation and Power BI data model refreshes. Monitor all BI data processes more »
contribute to the technical aspects in the upkeep of the data estate. Focusing on hands-on development, enhancement, and maintenance of data models andETL processes within the data estate You will emphasise the importance of data quality and governance in your project work, contributing to the organisational data model more »
West London, London, United Kingdom Hybrid / WFH Options
Recruitment Revolution
analytic role, with a focus on analysis, reporting and visualisation in Looker Studio + Highly proficient in GCP/GBQ, SQL, data modelling andETL processes + Experience with Supermetrics, GitHub, DBT, Google Big Guery and Shopify + Strong communication and presentation skills to effectively convey insights to both technical more »
and Machine Learning engineers and it is responsible for supporting data scientists in deploying, maintaining and monitoring an increasing number of Python-based microservices, ETL pipelines, SaaS models, databases and vector stores. The MLOps Lead would need to act as an interface between data scientists, the data & analytics team andmore »
and Machine Learning engineers and it is responsible for supporting data scientists in deploying, maintaining and monitoring an increasing number of Python-based microservices, ETL pipelines, SaaS models, databases and vector stores. The MLOps Lead would need to act as an interface between data scientists, the data & analytics team andmore »
with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETLand data modeling Experience with building large-scale systems with extensive knowledge in data warehousing solutions. Developing prototypes and proof-of-concept systems. Strong analytical more »
datasets, draw valid inferences and present them successfully to management using a reporting tool Develop and document data processes including data cleansing and matching ETL design You must have at least 1 to 2 years experience of working with Actimize software. Candidates must have a Bachelor's degree in a … significant experience as a Data Analyst Strong PL/SQL skills Database development (SQL Server, Oracle) Data migration knowledge & experience Development and test of ETLExtract/Transform/Load (ETL) with large data sets. Using Enterprise level tools including MS SSIS, Informatica etc Procedural language such as C# or more »