Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business … Analysts and Data Architects with discovery and best practices. Self-directed and comfortable supporting the data needs of multiple teams, systems and products. What’s required ? Advanced Azure knowledge and experience working and migrating data products from on-prem to Azure. Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark. Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis. Strong analytic skills related to working with unstructured datasets. Build processes supporting data transformation, datastructures, metadata, dependency and more »
JOB TITLE: Data Management Lead SALARY: £61,641 - £68,490 LOCATION: Edinburgh or Leeds HOURS: Full-time WORKING PATTERN: Our work style is hybrid, which involves spending at least two days per week, or 40% of our time, at one of our office sites About this opportunity We're … looking for a change agent to help us modernise to deliver great & innovative solutions to customers, making sure our data is well managed, accurate and trusted, building the foundation for AI and future technology applications. Here's what you'll get involved in - Investigating and analysing data to … recommend and support solutions for our business areas. As well as identifying opportunities to mitigate Data risks Recommending, designing, and documenting Data Management solutions and initiatives, championing policy, best practice, and tooling across Insurance, Pensions & Investments (IP&I) Collaboratively working with colleagues from different areas across IP&I more »
Rotherham, South Yorkshire, Yorkshire, United Kingdom
Corecom Consulting
on the forefront of our journey to Net Zero. Because of this though, they currently use a lot of third parties to store their data and are looking to build out an internal risk function to utilise data more efficiently. You'll get involved in immediately organising the … datastructures, building out a Data Warehouse and data pipelines from the multiple data sources. From there you'll start including other data sources including telephony and others to strengthen Risk decision making. It will be your job to bolster the current Risk function … helping to build better models using Credit Risk Data to allow them to compete across multiple financial sectors. It's a great opportunity to build an overall risk profile, refine the decision engines and eventually manage the processes overall! What you'll need; SQL coding experience for extracting datamore »
Barnsley, England, United Kingdom Hybrid / WFH Options
Legal & General
insurance businesses, we’re a fast-growing division with big, customer-centred ambitions. Job Description Legal and General Mortgage Services are hiring for a Data Engineer to work within the performance reporting function which provides invaluable insight to internal and external stakeholders around lending performance. This role would see … will be working internally with the business to support workflow, change and business processes aimed to increase efficiency as well as upholding and ensuring data quality and maintenance of datastructures, while using tools such as power BI to build dashboards and power automate to maintain and … create data pipelines. What you’ll be doing Building large, complex data systems and pipelines to enable the production of accurate and timely management information in accordance with business and individual stakeholder requirements. Identifying, designing, and implementing internal process improvements, automating manual processes, optimizing data delivery, and more »
Sheffield, South Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
Experis
deployments Infrastructure as Code (IaC) : Extensive experience in creating and managing infrastructure using code. Proficiency in IaC tools like Terraform, Ansible, Chef, or Puppet Data Structuring and Management : Advanced skills in managing data using formats like JSON, YAML, XML, and others. Capable of parsing, creating, and maintaining complex … datastructures for configuration and automation purposes. API Integration and Management : Expertise in querying, integrating, and managing APIs. Capable of constructing and executing API calls for data retrieval, updates, and inter-service communication. Version Control Systems : In-depth knowledge of version control systems like Git, including branching more »
Leeds, England, United Kingdom Hybrid / WFH Options
Middletons Assured Talent
audience. Good problem-solving skills and the ability to develop pragmatic solutions operating within given constraints. Strong knowledge of software engineering principles, design patterns, datastructures, and algorithms. Full understanding of the Software Development Life Cycle. Knowledge of security risks in software development and how to mitigate them … which should be Python and experience of a web-frameworks such as Django, Express, Angular, React, or Vue. Experience of databases and handling analytical data sets. more »
the role: Demonstrable Microsoft Dynamics and Power platform development experience. Excellent experience of full suite of Azure Integration Services products, including Logic Apps, Azure Data Factory etc. Experience of Mambu SaaS cloud banking platform. Evident ability to translate operational requirements into robust process-oriented solutions. Excellent problem-solving skills … accreditations. Knowledge of Workday configuration. Experience of using modelling tools such as EA Sparx, BizzDesign, ErWin to capture business capabilities, processes, technology components and data structures. Experience of developing and maintaining strong 3rd party, vendor, and partner relationships. Knowledge and understanding of the business processes associated with financial services more »