301 to 325 of 326 Data Lake Jobs in the UK

analysis & design phases) of the proposed solution and ensure follow up throughout the rest of the project. What is UMAX? UMAX integrates CRM, billing, invoicing, cash collection, meter data, asset and service management modules in one solution, offering utilities the tools & processes for effective sales, increased customer contribution margins, reduced lead times and streamlined operations. By doing so … existing interfacing with other applications to Azure integrate the solution with relevant Azure technologies (Logic Apps, Azure Service Bus, Application Gateway, Azure Firewall, Azure Functions, Azure Data Lake, ...) enable the integration with portal solutions , supporting customer self service extend UMAX with a reporting infrastructure on Azure technologies leveraging Power BI Our ideal candidate... has good experience More ❯

Select how often (in days) to receive an alert: We are currently looking for a Data Analyst to join our Quality team based in Dunfermline. In this role, you will be leading the way in gathering data from a variety of sources, uncovering trends, and transforming complex information into clear, actionable intelligence. Your insights will help … product performance, drive continuous improvement, and support strategic business moves. ESSENTIAL DUTIES AND RESPONSIBILITIES Responsible for development and maintenance of metrics and reporting with the ability to analyse data and provide relevant information focussing on key messages. Responsible for leading the modernisation of regular reporting from across the business with a primary focus on the Quality team. Responsible … for the creation and implementation of automated processes in data preparation to replace manual processes. Support the business from a data management perspective, ensuring that reports are current alongside the update of any IT infrastructure. Responsible for providing Power BI training and support for business users. Perform monitoring and auditing of data quality and More ❯

Data Analyst (Power BI, Azure) - Near Edinburgh Hybrid Having placed a number of people into their teams ourselves, Lorien's long standing client based near Edinburgh - a leader in their industry with a growing and consistently award-winning product line - have asked us to help them in their searches for a Data Analyst to join their … truly a rewarding opportunity, and everyone in the team feels part of that journey. Here's a snapshot of the duties involved: Developing/maintaining metrics & reporting, analysing data and relaying relevant information collected Modernising the business' reporting processes and implementing automation to reduce manual reliance wherever possible while monitoring, auditing and improving data quality Offering … in the queue, craft relevant solutions and train them on how to use them Collaborate with the wider IT function to ensure reports are in line with necessary data infrastructure in place from Databases to Data Lakes/Factory/and more The kind of skills they're looking for: Strong Power BI skills with the More ❯

Craft: Data, Analytics & Strategy Job Description: Activision Blizzard Media is the gateway for brands to the cross-platform gaming company in the western world, with hundreds of millions of players across over 190 countries. Our legendary portfolio includes iconic mobile game franchises such as Candy Crush, esports opportunities like the Call of Duty and Overwatch Leagues, and top … about more than work. We love games, and are obsessed with creating the best player experience. Responsibilities Partner with senior engineers, architects, and product owners to build scalable data pipelines and services. Work with the product team to understand the business requirements and translate them into development/design tasks. Be a role model in engineering best practices … of experience working with relational databases such as MySQL, Postgres, etc. 2+ years of experience with NoSQL databases like Bigtable, Cassandra, HBase, etc. Experience with schema design and data modeling. Strong understanding of large-scale distributed data processing. Experience with developing extract-transform-load (ETL). Experience with distributed messaging systems like Kafka and RabbitMQ. Experience More ❯

chain Functional knowledge of CRM capabilities for the prospect to order, marketing, and field service Experience integrating ISVs with D365 Experience with connecting D365 with Azure data lake Expertise in understanding complex technology & applying it in a practical way to create business solutions Minimum Experience: Bachelors or advanced degree in an analytic discipline such as engineering, economics … preferred Excellent organizational skills with the ability to balance multiple demands Proven ability to write effective system and process documentation ?"including business and system requirements, process diagrams, and data flow charts Exceptional customer service skills follow up with clients and team members and takes the initiative to anticipate and solve problems Effective time management skills Ability to communicate More ❯

Data Analyst (Power BI, Azure) - Near Edinburgh Hybrid Having placed a number of people into their teams ourselves, Lorien's long standing client based near Edinburgh - a leader in their industry with a growing and consistently award-winning product line - have asked us to help them in their searches for a Data Analyst to join their … truly a rewarding opportunity, and everyone in the team feels part of that journey. Here's a snapshot of the duties involved: Developing/maintaining metrics & reporting, analysing data and relaying relevant information collected Modernising the business' reporting processes and implementing automation to reduce manual reliance wherever possible while monitoring, auditing and improving data quality Offering … in the queue, craft relevant solutions and train them on how to use them Collaborate with the wider IT function to ensure reports are in line with necessary data infrastructure in place from Databases to Data Lakes/Factory/and more The kind of skills they're looking for: Strong Power BI skills with the More ❯

Senior Data Engineer - Hybrid - Up to £80,000 Imcurrentlysupportingawell-establishedorganisationthatisundergoingamajordigitaltransformationandbuildinga modern,enterprise-scaledataplatform .Aspartofthisgrowth,theyrelookingforanexperienced SeniorDataEngineer tojointheteamonafull-time,permanentbasis. TheyhaveanofficeinLeicester,whichthey'rehappyforpeopletoattendasfrequentlyasacoupleoftimesaweekoracoupleoftimesamonth if you live further afield. Thisrolewouldsuitsomeonewhothrivesindesigninganddelivering robust,scalabledatasolutions thatdrivebusinessinsightandinnovation. Whatyoullbeworkingon: Designingandimplementing lakehouse/medallionarchitectures with Azure+Databricks … Developingandoptimising ETLpipelines (AzureDataFactory,Python,SQL) Managing MSSQL/AzureSQLdatabases Deliveringcleanoutputsfor PowerBI reporting Ensuringstronggovernance,security,anddocumentationinan Agile/CI-CDenvironment Whatwerelookingfor: 4+yearsexperienceindataengineering(enterpriseenvironments) StrongSQL,Python,andETLautomationskills Hands-onexperiencewith Azure,Databricks,DataLakes,lakehousearchitectures Familiaritywith PowerBI,DevOps,andAgiledelivery (Bonus)Experienceinfinancialservicesorregulatedindustries Whythiscouldbeagreatmoveforyou: Bepartofa transformationaljourney modernisingdatacapabilitiesacrossthebusiness Gainexposuretocutting-edge cloud-nativeandAI-drivendatasolutions Workina collaborative,forward-thinkingenvironment withstrongstakeholderengagement Buildspecialistexpertisein financialservicesdataplatforms Apply for details More ❯

Our client, a leading insurance broker, are implementing a project known using medallion architecture - 'Medallion architecture is a data design pattern that structures data lakes into multiple layers (Bronze, Silver, and Gold) to progressively improve data quality and usability'. They will be using Snowflake. They have grown and will continue to grow through … significant acquisition so there is disparate data in different places - this will see a standardisation and bringing of data together in to one place. Programme Manager: We are looking for an experienced, energetic Programme Manager who has worked on large data programmes from a technical perspective ((ideally within the London markets/broking space … communicator, able to balance the technical aspects of programme management with a pragmatic and collaborative approach to support business strategic goals * Extensive experience in successfully managing large, complex data tech programmes and delivering tangible business outcomes. * Drive requirements scoping, analysis, and planning including interdependencies, across multiple teams and geographical locations. * Adept at driving consensus amongst senior stakeholders. Ability More ❯

Our client, a leading insurance broker, are implementing a project known using medallion architecture - 'Medallion architecture is a data design pattern that structures data lakes into multiple layers (Bronze, Silver, and Gold) to progressively improve data quality and usability'. They will be using Snowflake. They have grown and will continue to grow through … significant acquisition so there is disparate data in different places - this will see a standardisation and bringing of data together in to one place. Programme Manager: We are looking for an experienced, energetic Programme Manager who has worked on large data programmes from a technical perspective ((ideally within the London markets/broking space … communicator, able to balance the technical aspects of programme management with a pragmatic and collaborative approach to support business strategic goals * Extensive experience in successfully managing large, complex data tech programmes and delivering tangible business outcomes. * Drive requirements scoping, analysis, and planning including interdependencies, across multiple teams and geographical locations. * Adept at driving consensus amongst senior stakeholders. Ability More ❯

Our client, a leading insurance broker, are implementing a project known using medallion architecture - 'Medallion architecture is a data design pattern that structures data lakes into multiple layers (Bronze, Silver, and Gold) to progressively improve data quality and usability'. They will be using Snowflake. They have grown and will continue to grow through … significant acquisition so there is disparate data in different places - this will see a standardisation and bringing of data together in to one place. Programme Manager: We are looking for an experienced, energetic Programme Manager who has worked on large data programmes from a technical perspective ((ideally within the London markets/broking space … communicator, able to balance the technical aspects of programme management with a pragmatic and collaborative approach to support business strategic goals * Extensive experience in successfully managing large, complex data tech programmes and delivering tangible business outcomes. * Drive requirements scoping, analysis, and planning including interdependencies, across multiple teams and geographical locations. * Adept at driving consensus amongst senior stakeholders. Ability More ❯

Part-Time Contract Data Analyst I'm looking for a contract Data Analyst to join my client and assist with one of their main customers for an initial 3-month period, with the possibility of extension. Rate: £225-£250 per day outside IR35 Commitment: 1-2 days per week Contract Length: 3 months Location: Fully Remote … Start Date: ASAP Skills for Success Experience handling large, complex data sets Strong analytical skills to unify, collate, analyze, and interpret data to define actions Ability to read and analyze data for informed decision-making; proficient with analytics software and user behavior tools Experience working with data lakes such as BigQuery or … Snowflake Data visualization experience with tools like PowerBI, Looker Studio, Tableau Proven ability to present comprehensive reports on data analysis findings and recommendations Experience with Python/SQL for managing, transforming, and overlaying models onto data If interested, please send your most recent CV. I look forward to hearing from you if you seem More ❯

integrate CRM and Commerce solutions from leading platforms (Salesforce, Microsoft, Oracle, etc.) based on client needs. Design robust architectures that integrate CRM and commerce solutions with ERP systems, data platforms, analytics tools (Tableau, Power BI), and external systems. Lead large-scale digital transformation projects, ensuring alignment of CRM solutions with ERP, data lakes, cloud infrastructure, and … experience with CRM platforms such as Salesforce, SAP, Microsoft Dynamics, or Oracle working across sales, service and marketing. Proven expertise in delivering complex CRM integrations with external systems (Data Lakes, ERP, analytical platforms, and messaging systems) Experience with commerce platforms (such as Salesforce commerce cloud, Adobe commerce, etc ) and integration platforms (such as Mulesoft, Dell Boomi, etc) Have More ❯

Data Engineer (SC cleared) Start: ASAP Duration: 12 months Location: Mostly Remote - must have access to London or Bristol Pay: negotiable, INSIDE IR35 Responsibilities: - Design, implement robust ETL/ELT data pipelines using Apache Airflow - Build ingestion processes from internal systems and APIs, using Kafka, Spark, AWS - Develop and maintain data lakes and warehouses … AWS S3, Redshift) - Ensuring governance using automated testing tools - Collaborate with DevOps to manage CI/CD pipelines for data deployments and ensure version control of DAGs - Apply best practice in security and compliance Required Tech Skills: - Python and SQL for processing - Apache Airflow, writing Airflow DAGs and configuring airflow jobs - AWS cloud platform and services like S3 … Redshift - Familiarity with big data processing using Apache Spark - Knowledge of modelling, schema design and partitioning strategies - Understanding batch Vs streaming data paradigms - Docker or Kubernetes (containerization More ❯

via Docker/Kubernetes and integrate with orchestration systems (e.g., Airflow, custom schedulers). ? Work with platform engineers to embed Spark jobs into InfoSum's platform APIs and data pipelines. ? Troubleshoot job failures, memory and resource issues, and execution anomalies across various runtime environments. ? Optimize Spark job performance and advise on best practices to reduce cloud compute and … In-depth knowledge of AWS Glue, including job authoring, triggers, and cost-aware configuration. ? Familiarity with distributed data formats (Parquet, Avro), data lakes (Iceberg, Delta Lake), and cloud storage systems (S3, GCS, Azure Blob). ? Hands-on experience with Docker, Kubernetes, and CI/CD pipelines. ? Strong documentation and communication skills, with the ability to … support and coach internal teams. Key Indicators of Success: ? Spark jobs are performant, fault-tolerant, and integrated into InfoSum's platform with minimal overhead. ? Cost of running data processing workloads is optimized across cloud environments. ? Engineering teams are equipped with best practices for writing, deploying, and monitoring Spark workloads. ? Operational issues are rapidly identified and resolved, with root More ❯

via Docker/Kubernetes and integrate with orchestration systems (e.g., Airflow, custom schedulers). ? Work with platform engineers to embed Spark jobs into InfoSum's platform APIs and data pipelines. ? Troubleshoot job failures, memory and resource issues, and execution anomalies across various runtime environments. ? Optimize Spark job performance and advise on best practices to reduce cloud compute and … In-depth knowledge of AWS Glue, including job authoring, triggers, and cost-aware configuration. ? Familiarity with distributed data formats (Parquet, Avro), data lakes (Iceberg, Delta Lake), and cloud storage systems (S3, GCS, Azure Blob). ? Hands-on experience with Docker, Kubernetes, and CI/CD pipelines. ? Strong documentation and communication skills, with the ability to … support and coach internal teams. Key Indicators of Success: ? Spark jobs are performant, fault-tolerant, and integrated into InfoSum's platform with minimal overhead. ? Cost of running data processing workloads is optimized across cloud environments. ? Engineering teams are equipped with best practices for writing, deploying, and monitoring Spark workloads. ? Operational issues are rapidly identified and resolved, with root More ❯

ll join the Platform & AI Enablement team within our GPTO Engineering organization, reporting to the Sr. Director Engineering API. The team is responsible for building and supporting the data and AI platforms that underpin our industry-leading Business Planning Software solutions. This is a highly hands-on role focused on designing, building, and operating scalable systems that integrate … event-driven, batch & streaming data flows, and AI capabilities into the platform. Your Impact Build and maintain core platform capabilities that support high-throughput batch, streaming, and AI-powered workloads. Develop resilient, observable, and scalable systems using Apache Kafka, Flink, Pulsar, and cloud-native tools. Collaborate with AI/ML engineers to operationalize models and enable generative AI … use cases such as prompt-based insights or automation. Deliver reliable integrations with data lakes, event stores, and analytics systems, ensuring data flows efficiently across the business planning ecosystem. Contribute full-stack code where needed, including React-based frontends and backend services in Java and Python. Write clean, maintainable, well-tested code with an emphasis on More ❯

ll join the Platform & AI Enablement team within our GPTO Engineering organization, reporting to the Sr. Director Engineering API. The team is responsible for building and supporting the data and AI platforms that underpin our industry-leading Business Planning Software solutions. This is a highly hands-on role focused on designing, building, and operating scalable systems that integrate … event-driven, batch & streaming data flows, and AI capabilities into the platform. Your Impact Build and maintain core platform capabilities that support high-throughput batch, streaming, and AI-powered workloads. Develop resilient, observable, and scalable systems using Apache Kafka, Flink, Pulsar, and cloud-native tools. Collaborate with AI/ML engineers to operationalize models and enable generative AI … use cases such as prompt-based insights or automation. Deliver reliable integrations with data lakes, event stores, and analytics systems, ensuring data flows efficiently across the business planning ecosystem. Contribute full-stack code where needed, including React-based frontends and backend services in Java and Python. Write clean, maintainable, well-tested code with an emphasis on More ❯

these areas. The Role They are looking for an experienced, commercially-focused, and passionate leader who will grow and manage the new customer analytics team as a senior data scientist. You will be building analytics models using a range of data science approaches, such as machine learning and statistical techniques, along with wider analytical approaches such … as time series and analytics with unstructured data e.g. NLP. They recently used gradient boosting machine learning to predict radio listening behaviour for a client, taking into account advertising spend. The Successful Candidate Is Likely To Have: Ability to talk confidently to clients, discussing and advising on business objectives Proven track record of how results can best be … infrastructures such as Azure or AWS and how to integrate R or Python analytical workflows would be highly desirable Proven track record with accessing client customer databases and data lakes Knowledge of the major secondary data-sets available, and experience of merging these to create additional insights Experience with web scraping tools and techniques More ❯

You'll Bring AI/ML Expertise : Deep knowledge of LLMs, NLP, and recommendation systems. Technical Leadership : Proven experience in scaling AI products, DevOps, and cloud architecture. Backend & Data Proficiency : Skilled in Python, Node.js, PostgreSQL, MongoDB, and API security. AI Deployment : Familiarity with MLOps, data engineering, and ethical AI practices. Strategic Thinking : Ability to align tech … strategy with business objectives and cost efficiency. Security & Compliance : Strong understanding of GDPR, API authentication, and observability. Big Data : Experience with data lakes, warehouses, and tools like Spark, Kafka, and Airflow. ETL Expertise : Ability to evaluate and optimize data ingestion and transformation pipelines. DevOps & CI/CD : Hands-on experience with Jenkins, GitHub Actions More ❯

transformation programme across financial services. We are hiring multiple architects to support the build-out of a new cloud-native technology platform in partnership with a leading market data and index provider. We're looking for: Enterprise Architect You'll bring deep experience defining and executing long-term architecture strategies across cloud platforms (AWS), with proven leadership in … capital markets, index data, or analytics-heavy environments. You'll bridge tech and business to shape scalable, resilient platforms aligned to regulatory and commercial outcomes. Solution Architect You'll design secure, high-performance applications using modern stacks (Angular, Java, Python, APIs, SQL/NoSQL) with a strong focus on AWS-native development. The role supports new product delivery … real-world solutions, particularly around operational risk, governance, and audit readiness. Key Requirements (vary by role): Experience in regulated FS environments (ideally capital markets/investment/index data) Strong AWS cloud architecture and integration background Deep understanding of modern application design: APIs, microservices, data lakes Ability to influence senior stakeholders and drive complex technical decisions More ❯

Skills and Experience AI/ML Expertise: Strong understanding of LLMs, NLP, and AI-driven recommendations. Technical Leadership: Experience in AI product scalability, DevOps, and cloud architecture. Backend & Data Skills: Proficiency in Python, Node.js, PostgreSQL, MongoDB, API security. AI Model Deployment: MLOps, scaling, data engineering, and AI ethics awareness. Strategic Mindset: Ability to align technology with … business objectives and cost efficiency. Security & Compliance Knowledge: GDPR, API authentication, and observability best practices. Big data processing: Understanding data lakes, warehouses, and tools like Spark, Kafka, and Airflow. ETL Pipelines: Ability to evaluate data ingestion, transformation, and cleaning processes. DevOps & CI/CD: Hands-on knowledge of Jenkins, GitHub Actions, Terraform, and CloudFormation. More ❯

Skills/requirements Deploy comprehensive cloud infrastructure for various products, including Astronomer Airflow and AccelData environments. Facilitate cross-functional integration between vendor products and other systems, such as data lakes, storage, and compute services. Establish best practices for cloud security, scalability, and performance. Manage and configure vendor product deployments, ensuring the setup and maintenance of environments. Ensure high … control. Collaborate with cloud providers (e.g., AWS) for pipeline integration and scaling requirements. Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes. Develop infrastructure for optimal extraction, transformation, and loading of data from various sources using AWS and SQL technologies. Work with stakeholders, including … design, product, and executive teams, to address platform-related technical issues. Build analytical tools to leverage the data pipeline, providing actionable insights into key business performance metrics, such as operational efficiency and customer acquisition.? All profiles will be reviewed against the required skills and experience. Due to the high number of applications we will only be able to More ❯

Skills/requirements Deploy comprehensive cloud infrastructure for various products, including Astronomer Airflow and AccelData environments. Facilitate cross-functional integration between vendor products and other systems, such as data lakes, storage, and compute services. Establish best practices for cloud security, scalability, and performance. Manage and configure vendor product deployments, ensuring the setup and maintenance of environments. Ensure high … control. Collaborate with cloud providers (e.g., AWS) for pipeline integration and scaling requirements. Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes. Develop infrastructure for optimal extraction, transformation, and loading of data from various sources using AWS and SQL technologies. Work with stakeholders, including … design, product, and executive teams, to address platform-related technical issues. Build analytical tools to leverage the data pipeline, providing actionable insights into key business performance metrics, such as operational efficiency and customer acquisition.? All profiles will be reviewed against the required skills and experience. Due to the high number of applications we will only be able to More ❯

of our UK, Canada, or US offices, with flexible remote working options. Requirements Responsibilities and Qualifications: Interest or experience in NoSQL and/or MongoDB Atlas. Familiarity with data visualization, migration, and modeling tools. Strategic thinking abilities. Background in applied mathematics and statistics. Extensive database or related computer science experience. Knowledge of Relational DBMS. Experience in database and … cloud architecture, data lakes, and design. Ability to design large relational databases and integrate new systems. Manage data integration, train users, and optimize system performance. Break down complex codes for end-user understanding. Provide timely solutions to data problems with sustainable techniques. Facilitate communication between end-users and data specialists. Research and More ❯

Description As part of the Platform & AI Enablement team under GPTO Engineering, you'll report to the Sr. Director Engineering API. This team is accountable for shaping enterprise data architecture, enabling high-performance AI-driven workloads, and acting as a technical bridge between engineering and architecture. This is a hands-on role for a deeply experienced engineer who … thrives on solving complex problems and scaling robust platforms. Your Impact Influence the design and implementation of platform capabilities for data processing, AI enablement, and developer acceleration across batch, streaming, and real-time systems. Collaborate with the architecture function to represent engineering needs and help translate architectural direction into practical implementation patterns. Guide teams in integrating AI/… strategy discussions. Help teams balance speed and sustainability-delivering under tight deadlines without compromising quality. Your Qualifications 12+ years of software engineering experience, ideally in platform, infrastructure, or data-centric product development. Expertise in Apache Kafka, Apache Flink, and/or Apache Pulsar. Deep understanding of event-driven architectures, data lakes, and streaming pipelines. Strong experience More ❯