176 to 200 of 485 Permanent Data Lake Jobs

Manchester/PERMANENT/SALARY: COMPETITIVE Job Purpose Responsible for developing, maintaining and optimising MPM’s data infrastructure. Provide technical expertise to ensure efficient data handling, ensuring availability, scalability and security of the centralised data asset. Ensure that all ETL pipeline and scheduled jobs … Experience with source control and CI/CD (GitHub, Azure DevOps, DABs) Data architecting, solutions architecting and experience optimising pipelines and Delta Lake Databricks Data Engineer Professional certified #J-18808-Ljbffr ...

pipelines using Dataflow Gen2 and Fabric Notebooks • Develop and maintain Lakehouse solutions using Medallion architecture • Work with SQL, Python, Spark SQL and Delta Lake • Integrate data from APIs, databases, CRM, ERP and third party platforms • Support both batch and real time data processing • Develop … Lakehouse architecture • Strong SQL and Python skills • Experience with Spark and Spark SQL • Proven experience designing scalable ETL and ELT pipelines • Data Lake and Delta Lake experience • Experience integrating data from multiple structured and unstructured sources • Good understanding of CI/CD, DevOps ...

founding in 2013, Quantiphi has tackled some of the world’s most complex business challenges by combining deep industry expertise, disciplined cloud and data engineering practices, and cutting-edge applied AI research. Our work is rooted in delivering accelerated, quantifiable business value, not just technology for technology … cloud innovation.Your next big opportunity starts here!Work Location: London, UKExperience Level: 8+ yearsType: Full timeRole:We are looking for a Senior Data Analyst to support delivery of our Pricing & Exposure data initiatives. This role will focus on hands-on analysis of complex insurance datasets, translating ...

Data Idols, we are working with a large-scale, data-driven organisation investing heavily in its data platform, analytics and AI capabilities. They are now looking for a Data Solutions Architect to provide design and architecture guidance across a broad portfolio … data platforms Experience with Databricks or similar modern data platforms Good understanding of data warehouse, data lake or lakehouse architectures If you are looking for a new challenge and want to help shape data solutions across a large-scale ...

Specialist Reporting to: Principal Data Engineer Role Overview To develop the geospatial data foundation, utilising our data mesh and bringing together geospatial datasets, EO and internal data to create a scalable spatial data solution. The outputs will provide Group wide … sustainable use of land. A key focus will be moving geospatial processing from manual GIS workflows towards automated, maintainable and production-ready data pipelines that can support digital products, analytics and AI/ML applications. Key responsibilities Land Use Intelligence Develop and maintain Origin’s spatial data ...

experience working with SQL Server Strong experience working with Azure Data Factory and Azure DevOps Hands-on experience with data lake platforms, Azure Synapse, Databricks, or equivalent experience/skills Experience with tooling such as CI/CD pipelines and version control The ability … will be responsible for the design, build, and maintenance of Python-based ETL pipelines Accounting and leading the SQL development Data lake development within Azure Synapse, working to the organisation’s architecture standards Meeting with business stakeholders to define requirements and translate them into solution designs Keeping ...

scalable dimensional data models and reporting frameworks. Integrate Power BI with enterprise data platforms including Azure SQL, Data Lake, Synapse, Fabric, and Oracle environments. Establish governance, security, audit, and reporting standards. Define and implement Row-Level Security (RLS), workspace controls, and access management. … Power BI DAX Power Query Semantic Models Dataflows Deployment Pipelines Power BI Administration Experience integrating Power BI with: Azure SQL Azure Data Lake Microsoft Fabric Azure Synapse Enterprise Data Platforms Strong dimensional data modelling experience. Experience designing secure and governed analytics solutions. Knowledge ...

scalable dimensional data models and reporting frameworks. Integrate Power BI with enterprise data platforms including Azure SQL, Data Lake, Synapse, Fabric, and Oracle environments. Establish governance, security, audit, and reporting standards. Define and implement Row-Level Security (RLS), workspace controls, and access management. … Power BI DAX Power Query Semantic Models Dataflows Deployment Pipelines Power BI Administration Experience integrating Power BI with: Azure SQL Azure Data Lake Microsoft Fabric Azure Synapse Enterprise Data Platforms Strong dimensional data modelling experience. Experience designing secure and governed analytics solutions. Knowledge ...

Envitia is a UK-based software and services company that helps organisations unlock the full value of their data to make better, faster decisions. With over 30 years of experience, we specialise in delivering innovative software products, solutions, and consultancy services that transform complex data challenges … into actionable insights. Our mission is to empower customers across defence, government, and national security sectors to harness the power of data — from geospatial intelligence to advanced analytics and AI integration. We are proud to be a trusted partner to UK defence and government organisations, delivering technology that ...

doing Help build, test and maintain data pipelines using tools such as Databricks. Support data warehouse and data lake development with guidance from experienced engineers. Develop ETL/ELT workflows that make reliable, high-quality data accessible. Collaborate with colleagues … Python, SQL or similar data processing languages. Some exposure to Spark or Databricks through work, study, training or projects. Awareness of Delta Lake, notebooks and workflows; production experience is not essential. Familiarity with cloud platforms such as AWS, Azure or GCP is desirable. Basic understanding of relational ...

founding in 2013, Quantiphi has tackled some of the world’s most complex business challenges by combining deep industry expertise, disciplined cloud and data engineering practices, and cutting-edge applied AI research. Our work is rooted in delivering accelerated, quantifiable business value, not just technology for technology … Your next big opportunity starts here! Work Location: London, UK Experience Level: 8+ years Type: Full time We are looking for a Senior Data Analyst to support delivery of our Pricing & Exposure data initiatives. This role will focus on hands-on analysis of complex insurance datasets ...

Role: Data Team Lead- AD Location: London Salary: Competitive salary and package dependent on experience Career Level: Associate Managing Director (CL5) Please Note: Any offer of employment is subject to satisfactory BPSS and SC security clearance, which requires 5 years continuous UK address history at the point … drive adoption of modern data platforms using Microsoft Fabric, Azure Databricks, Azure Synapse, Azure Data Factory, Azure Data Lake and Power BI. Provide strategic direction across data architecture, engineering, analytics, governance and AI. Own delivery across large, complex programmes, ensuring scope ...

Data Engineer (Azure | Databricks | PySpark | SQL) Contract | Remote | UK Public Sector Project We are seeking a Data Engineer to support delivery of key data components within our evolving data ecosystem. This role will work closely with architects, analysts, engineers, and wider delivery … platforms. Who We’re Looking For A highly capable Data Engineer with hands-on experience building ETL pipelines, implementing Data Lake architectures, and working across Azure platform services. You will need strong problem-solving ability, a solid engineering mindset, and the ability to work collaboratively ...

possible in their world of motion. Purpose:The Finance Transformation Specialist advances the global Finance organization's transformation strategy by connecting finance processes, data, systems, and technology. This role partners with Finance, IT, and business stakeholders to identify improvement opportunities, define business and data requirements … finance technologies.Identify and implement opportunities to leverage AI, advanced analytics, and emerging technologies to improve business processes, decision making, and financial insights. Data & Technology Enablement Partner with Finance, IT, and data teams to define finance data requirements, business data models, and reporting ...

Canopius, our delivery teams are responsible for ensuring that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. … aligned with organisational standards and governance requirements. Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines to ensure trusted, accurate outputs. ...

Role As a Core Data Engineer, you will play a pivotal role in designing, building, and optimising data pipelines, architectures, and workflows for our diverse client base. You’ll work within dynamic, multi-disciplinary project teams to implement scalable data solutions while adhering … best practices and emerging trends in data engineering. This is an exciting and valuable opportunity for an enthusiastic, earlier-stage data engineer to advance their career across a variety of commercial sectors. At Optima, you’ll work within cross-functional teams, collaborating with experts in different ...

Head of Data & Analytics Department: Technology Employment Type: Full Time Location: London Reporting To: Chief Information Officer Compensation: £100,000 - £110,000/year Description Job Title: Head of Data & Analytics Salary: £100,000- £110,000 + Bonus + EV Allowance Location: Hybrid (2-3 days … week in London office) We're looking for a Head of Data and Analytics to own our data strategy and turn the information flowing through Pod into decisions that grow the business. You'll build and lead a small central data team, and work ...

Technical Team Lead will guide a team of engineers in building scalable backend services, modern user interfaces, financial calculation workflows, back testing capabilities, data integrations, automated testing frameworks, and AI-assisted QA/evaluation routines. The role requires strong technical judgment, practical leadership, and the ability to translate … practices, testing expectations, and delivery patterns for the engineering team. Guide developers through complex design decisions involving Java services, frontend architecture, AWS workflows, data integration, AI-assisted development, and calculation accuracy. Partner with product owners, quantitative analysts, QA teams, infrastructure teams, data teams, and business stakeholders ...

Coventry City Council is seeking an experienced BI & Insight Analyst/Data Analyst to support a data transformation project … within Digital & HR Services. The role involves migrating data from the existing data warehouse to a new Data Lake, with HR data a significant focus, and close collaboration with HR teams and stakeholders across the Council. You will develop and maintain ...

# Senior Data EngineerIndia ContractAre you a Senior Data Engineer with 8+ years of experience in building scalable data platforms and pipelines? Apply now for a remote long-term contract opportunity with a leading client in London.## Requirements* 8+ years of experience in Data … Kafka or Kinesis* (Desirable) Experience with Airflow or other workflow orchestration tools* (Desirable) Experience with Docker and Kubernetes* (Desirable) Exposure to Data Lake and Lakehouse architecture* (Desirable) Experience in Agile/Scrum development environments* (Desirable) Experience with Apache Kafka, Apache Airflow, Terraform, Databricks, Delta Lake, Snowflake ...

Data Engineer (Python SQL AWS) London/WFH to 85kDo you have experience of building data pipelines within finance/Fintech environments? You could be progressing your career in a hands-on Data Engineer role at a scaling Investment Research tech company with great … benefits and perks. As a Data Engineer you will be at the intersection of data engineering, database management and platform delivery. You will help build and evolve a modern, scalable AWS cloud based data platform. Your focus will be on designing and maintaining data ...

market intelligence. With an insight into over 50 overseas markets, we deliver the world's most complete, accurate and up-to-date automotive data and insights, creating significant competitive advantage to our customers. Find out more about what we do here: JATO Our vision Our vision … future and stakeholders in our desires. Our strategic intent is to help customers create significant competitive advantage by constantly leading in connected data, information and knowledge provision, ultimately improving our customers’ work processes, informed decision-making and business results. Role Overview We're seeking an Azure Data ...

this role matters You’ll play a central role in ensuring data flows reliably and efficiently at scale. You will directly enable faster insights, smarter decision‐making, and a resilient data ecosystem that supports everything from operational reporting to ground breaking modelling. How you'll contribute … ingestion and transformation pipelines using technologies such as Spark, Scala, Python, AWS, DBT, and Snowflake Owning and improving the organisation's Data Lake environment and data platform. Ensuring it remains robust, scalable, and future‐ready Owning ETL processing, table refreshes, defect resolution, and other ...

Elevate your career by steering multi-faceted tech programs, integrating innovative solutions for a dynamic impact across global operations. The Chief Data & Analytics Office (CDAO) at JPMorgan Chase is responsible for accelerating the firm’s data and analytics journey. This includes ensuring the quality, integrity … data platforms such as Databricks and Snowflake Good understanding of AWS data analytics services including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns with demonstrated experience architecting end-to-end data solutions Experience navigating complex ...

Role: Microsoft Fabric Data Engineer Location: London (Hybrid) Employment: Fulltime Role overview: The role is responsible for the design, development, and maintenance of scalable data solutions using Microsoft Fabric. The role focuses on building end-to-end data pipelines, working with business users … participate in sprint ceremonies Technical Skillset: Microsoft Fabric (Dataflows, Lakehouse, Warehouse) Azure Data Services (Synapse, Data Factory, Data Lake) SQL (advanced) and Python/Spark for data transformation Strong understanding of data modelling (e.g. star schema) Experience building scalable ...