26 to 50 of 301 Data Lake Jobs

Our client within the Education sector are looking for a Senior Data Engineer to join them on a contract basis. Inside IR35 … month contract Hybrid 1 – 2 days per week onsite Technical Skills: In depth knowledge of relevant Azure services such as Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL Database, Azure Stream Analytics, etc. Strong Python or Scala with Spark … and analytics. Apache Spark: Deep understanding of Apache Spark for large-scale data processing. Azure Blob Storage and Azure Data Lake Storage: Expertise in setting up and optimizing Azure Data Lake Storage for storing and managing large volumes of data. Cloud Experience more »

This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. Client Details Global … when needed, accurate and understood. Key Technical Skills required: Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI Extensive experience of working with Azure Data Factory & Databricks Extensive SQL knowledge (Microsoft SQL Server … . Metadata management/Data quality Profile Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI Extensive experience of working with Azure Data Factory & Databricks Extensive SQL knowledge (Microsoft SQL Server more »

Data Architect (SC Cleared/Banking), London (Hybrid) 6 Month Contract £550-625/day (Outside IR35) Data Architect needed with active SC Security Clearance , Banking domain experience , data transformation and COTS products experience on Data modernization and Transformation Programs. 6 Month … work with a leading digital transformation business on large-scale IT modernisation programmes for Government clients. Key skills, experience + tasks will include: Data Architect with strong experience with COTS data flows, product architecture, and integration with data sources. Strong Banking/Financial Services … domain experience. Working Data Modernization and Transformation Programs including Data Cleansing and Migration. Good understanding of security measures and regulations in the Banking and Financial industry. Experience with COTS products and solutions for Data Integration and management. Evaluate and recommend COTS products and solutions more »

Data Architect (SC Cleared/Banking), London (Hybrid) 6 Month Contract £(Apply online only)/day (Outside IR35) Data Architect needed with active SC Security Clearance , Banking domain experience , data transformation and COTS products experience on Data modernization and Transformation Programs. … work with a leading digital transformation business on large-scale IT modernisation programmes for Government clients. Key skills, experience + tasks will include: Data Architect with strong experience with COTS data flows, product architecture, and integration with data sources. Strong Banking/Financial Services … domain experience. Working Data Modernization and Transformation Programs including Data Cleansing and Migration. Good understanding of security measures and regulations in the Banking and Financial industry. Experience with COTS products and solutions for Data Integration and management. Evaluate and recommend COTS products and solutions more »

Job Description Summary The Senior Data Architect is accountable for enabling the technical vision and strategy for the organisations use of data. You will be accountable for defining and maintaining the technical data architecture roadmap offering advise and guidance to business stakeholders. You will ensure that … data architect solutions align with business requirements and data policies and regulations. You will be accountable for the choice of the toolsets required to design, build, manage and maintain the data storage facility within an agreed budget. You will lead a team of people … to deliver a simplified data solution ensuring that data is secure, available, and accurate to business stakeholders. Job Description You will review the ‘as is’ solution, work closely across TalkTalk and wider teams to identify an approach that allows us to move data across more »

Role: Senior Data Analyst Location: Remote Salary: £45,000 - £47,000k per annum + benefits About Company: Join us in our partnership with a leading for-profit organization in the education sector, committed to delivering exceptional services to students globally. Job Purpose: As a Senior Data … actionable insights. Key Responsibilities: Conduct complex statistical analysis on diverse data sets, focusing on data warehousing and data lake solutions. Translate findings into actionable insights, utilizing tools such as Power BI, Tableau, and others, to visualize and communicate data effectively. Lead … record of effectively engaging with stakeholders, including senior executives and technical specialists. Ideally, hands-on experience with SQL Server, Microsoft Azure Data Lake, Oracle databases, and data warehouses. Highly desirable expertise in Alteryx and familiarity with R and/or Python programming languages. Knowledge/ more »

Data Engineer Remote working, West Sussex, Manchester Up to £54,000 per annum + Bonus An exciting opportunity has arisen to join a leading company in the Insurance and technology sector, renown for its outstanding working culture, in a Data Engineering role. The role will require … who has strong Pyspark and SQL experience alongside an Azure background. Key responsibilities: Develop low to high complexity, secure, governed, high quality, efficient data pipelinesfrom a variety of on and off premise, internal and external data sources Ensure that data is cleansed, mapped, transformed … pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. Build solutions that pipe transform data into data lake storage areas, physical databasemodels and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. Build more »

Datalake Data Solution Architect - Dublin - 85,000 - 95,000 euros FRG Data are working with a well esteemed Financial Services Group in Ireland who are on a digital first transformation journey. They are looking for experienced Datalake Data Solution Architects highly experienced in a … Engineering teams. Responsibilites: Provide ownership and accountability for delivering effective solution designs to meet business needs within the Bank`s Enterprise Data Lake (EDL) platforms, taking the lead on the delivery from an data design perspective Contribute to the data architecture roadmap and … strategy, working with the enterprise architecture team providing inputs in the definition of the future data architecture state Provide key contributions to overall solution planning, providing input into the estimation process as well as highlighting technical risks, issues and assumptions Partake in design reviews from fellow data more »

Title: Data Architect Reporting to: Head of Data Location: Hybrid - London office 2/3 days a week Job description The role of a Data Architect is a visionary who translates business requirements into technology requirements and defines data standards and principles. … The data architect is responsible for visualizing and designing the organisation's enterprise data management framework for how IT infrastructure supports our data strategy. This role aims to show the company's infrastructure how data is acquired, transported, stored, queried, and secured. … Apache Iceberg, Apache Spark, Apache Hudi, Apache Kafka, Power BI, BigQuery, DeltaLake, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App Service, Azure ML is a plus. Languages : Python, SQL, T-SQL, SSIS, and high-level programming knowledge on Spark is a plus. more »

Due to continued growth within our professional services, we are looking for a Solution Architect to join our data practice - working with some of the best data professionals in the country. You will play an integral part in taking our data services to market … providing technical and strategic thought across the whole lifecycle of data projects from presales through to sign-off and support. A day in the life of an Aiimi Solution Architect: Taking on technical ownership of data projects and transitioning them from presales to delivery Translating customers … and/or GCP would be of added benefit) Experience of using technologies such as Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, Azure Analysis Services, Databricks and Power BI (or equivalent technologies within AWS or GCP stack) Experience of implementing centralised data more »

JOB TITLE: Lead Data Architect (Cloud) SALARY: The salary banding for this role is £121,023 - £142,380 LOCATION: Manchester, Leeds, Halifax, Bristol or Edinburgh HOURS: 35 hours, full time WORKING PATTERN: Our work style is hybrid, which involves spending at least two days per week, or … architecture experience; Leading or being part of transformation in Data (e.g., move to advanced analytics/machine learning, data lake, big data, data democratisation) Data modelling and how that can help accelerate reuse of data and … delivery of data consumption use cases Modern data technologies understanding e.g. Machine Learning and Generative AI Experience with data management capabilities like metadata, lineage, data quality, data privacy and data lifecycle management Familiarity with data regulations more »

Purpose of Position Pantheon require a passionate hands-on Data Support Engineer to support the delivery of change to existing systems as well as conduct analysis for root cause & software issues. Pantheon is at the start of a multi-year programme to establish itself as a data … technologies (ETL, SQL Database, Reporting) Knowledge of Dimension Modelling Strong SQL skills, experience in writing complex SQL queries Knowledge of Azure Data Lake, Data Factory, Databricks and Functions Essential Experience Experience in supporting traditional Data Warehouses Exposure in building Azure based data ingestion and transformation pipelines, data lake, data warehouse/data marts etc. Experience working with Agile development methodologies such as Kanban/Scrum A natural problem-solving attitude. Conversant with current industry and technology trends. Experience with dealing directly with stakeholders more »

Role: Data Engineer - Tech Lead Job Type: Permanent Location: London, UK Do you strive for engineering excellence and are ready to lead a modern tech transformation ? Do you have experience as a Azure, Pyspark, Cloud? We have the perfect role for you- Data Engineer - Tech Lead … analysis on large datasets. Architect Data Storage Solutions: Architect data storage solutions using Azure SQL Database, Azure Data Lake Storage, and other Azure services, ensuring scalability, reliability, and performance. Collaborate with Cross-functional Teams: Collaborate with cross-functional teams including data … effectiveness, leveraging Azure monitoring and logging services. Your Profile Expertise in Azure cloud services, Databricks, Synapse, Azure SQL Database, and Azure Data Lake Storage. Expertise in Data Engineering, Solution designing and Cloud Computing. Programming skills in Python, with developing data processing applications using more »

Data Delivery Lead Location: Hybrid - London Package: Negotiable + Benefits Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them to provide great customer service and grow through the provision of … superior data services. The Data Delivery Lead is responsible for ensuring the successful and timely delivery of data projects and initiatives. You will lead a team of Brown & Brown and third-party data specialists, manage resources, and act as a bridge between … patterns and best practice, including data pipelines delivering projects in the Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL, Azure Cosmos DB, Azure Power Platform, Power BI The rewards: negotiable basic salary and all the normal benefits you’d expect more »

Role Overview Microsoft Data Security Cloud Solution Architects are trusted advisors for customers attempting to secure their entire data estates against internal and external data risk. Microsoft Purview's integrated Data Security services support customers holistically secure data: · Protect Sensitive … Data using data classification, sensitivity labelling and encryption policies. · Manage Insider Risks using machine learning detection controls and indicators, adaptive protection to dynamically enforce controls and advanced privacy controls · Prevent Data Loss using built in exfiltration policies for Microsoft 365 apps, services and endpoints. … working with Microsoft 365 services and/or Azure data services such as Sharepoint, Teams, Office 365, SQL, Azure Data Lake Services. Additional or Preferred Qualifications · Bachelor's Degree in Information Management, or related field and 5+ years' experience in Data/Information more »

Azure Data Engineer | Manchester (Hybrid) | £50,000 - £60,000 Peaple Talent have partnered with a leading end to end solution provider in the testing, inspection, certification and compliance sector, covering an extensive range of engineering services. Due to aggressive growth plans in the Data department we … and reporting solutions using the latest Microsoft technologies: SQL Server Integration Services Azure Synapse Analytics, Azure Analysis Services, Azure Data Lake, Azure SQL Database, Azure Data Factory and Power BI. Their operations are of a scale that will provide you with material data … and analytic solutions. Experience needed: Proficient using SQL & Python Strong experience using Microsoft Azure Knowledge of further skills including, Synapse, Data Lake, Data Bricks, Data Factory. Data visualisation expertise with Power Bi What's in it for you? 💰Salary more »

Data Architect We are on the lookout for a visionary Data Architect to translate business requirements into technology requirements and defines data standards and principles for a leading and dynamic insurance company. You’ll be responsible for visualising and designing the organisation's enterprise … data management framework for how IT infrastructure supports our data strategy. The goal of this role is to show the company's infrastructure how data is acquired, transported, stored, queried, and secured. The data architecture built will be the foundation of any … Apache Iceberg, Apache Spark, Apache Hudi, Apache Kafka, Power BI, BigQuery, DeltaLake, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App Service, Azure ML is a plus. Languages : Python, SQL, T-SQL, SSIS and high-level programming knowledge on Spark is a plus. more »

We are currently looking for an Azure Data Platforms Engineer on a contract basis (OSIR35) for a global retail organisation. The project will to deliver a foundational data platform to enhance data-driven decision-making and performance analytics.They will play an important role in … and data integration processes using Azure services such as Azure Data Factory, Azure Synapse Analytics and Azure Data Lake Storage. Responsibilities: Collaborate with solution/data architect to design and implement scalable, secure data infrastructure using Azure services. Develop … and support. Skills/Experience required: Proficiency in Azure services, particularly Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage. Strong understanding of data integration processes and tools. Knowledge of data security measures, including Azure Active Directory integration and more »

Azure Data Engineer Perm Cheltenham/Hybrid working (2/3 days per week onsite) Up to £65,000pa Candidates must be eligible for SC Clearance We're in search of an exceptional Azure Data Engineer to join our Engineering Team. As a member of our … for this role, you will need to be a sole British national, eligible to work on secure client sites. We're seeking a Data Engineer with a … focus on Azure, showcasing proficiency in: · Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. · Utilizing Azure data and analytics services, including but not limited to Azure Data Factory more »

brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Lead Data Engineer role sits within the Data Services department, you will work actively to unlock the value of data by building and enabling product teams and data practitioners to use the … and needs assessment. You Have These: Team management experience Exposure to, and ideally experience with, modern data architectures (e.g. data lake, lake house, data mesh) and accompanying technologies (e.g. Azure Synapse, Snowflake, Amazon Redshift) Awareness of data governance and all more »

Senior Data Engineer - 6 month FTC London (Hybrid Role) £85,000 per annum Senior Data Engineer Opportunity An exciting opportunity has arisen for a Senior Data Engineer to join a dynamic team dedicated to shaping effortless, digital-first customer experiences. This role is pivotal … in driving value for customers through modelling, sourcing, and data transformation. The Senior Data Engineer will collaborate closely with core technology and architecture teams, delivering strategic data solutions while promoting Agile and DevOps methodologies in data engineering delivery. Responsibilities: Automate data … mentoring abilities and good critical thinking with problem-solving skills. Nice to Have: Experience with relevant technologies such as Synapse, Azure Data Lake, Azure Data Factory, and Databricks. Why Join: This is an opportunity to join a collaborative environment that encourages innovation and values each more »

a successful, dynamic, and creative global business then we want to hear from you. The Opportunity: We have an exciting opportunity for a Data Warehouse Architect to join a rapidly growing data team in Clarion. The role will report into the Senior Architect, with responsibility to … overcome complex challenges, and grow your design through developing skills with the new initiatives we are looking to explore. Key Responsibilities: Analyse existing data design and suggest improvements that promote performance, stability, and interoperability Work with product management and business subject matter experts to translate business requirements into … Analytics platform including Azure Synaps Azure Logic Apps, Azure Functions, Azure Storage Azure SQL Data Warehouse, Azure Data Lake, Azure Databricks Azure Cosmos DB, Azure Data Factory, Azure Search, Azure Stream Analytics Delta Lake and Data Lakes Apache more »

Lead Azure Data Engineer | Power BI, Synapse, Data Factory/Data Lake | Tech for Good/Charity Rate: £500 per day circa Duration: 6-12 months IR35: Outside Location: Remote with occasional travel to London (Once a month max) Essential skills required: Azure … solid experience required Ability to build a data platform on Azure (Synapse, Azure Data Factory, PowerBI) Be happy to act as a lead and mentor to the other permanent Azure Data Engineers This is the chance to work for a unique organisation! Our client … so if you are interested apply ASAP. Lead Azure Data Engineer | Power BI, Synapse, Data Factory/Data Lake | Tech for Good/Charity more »

Hi Professionals, Greetings From Ampstek!! Hope you are high in your spirits. Please stay safe. Our client is looking for Data Architect to join a high-growth organization. If you are interested share you resume sudhakaran.m@ampstek.com Role: Data Architect Location: London, UK (Hybrid) Duration: Contract … data with existing data architecture (called as UDP but essentially on Azure that consists of Stream Analytics, Data Lake, Ingestion and orchestration layers) Analysing existing solution (Legacy MES) to extract the data from its complex data model Skills needed … solution – SSRS) Should be well versed with Azure/Amazon cloud data architecture (Data Ingestion, Stream Analytics, Data Lake and Orchestration) Should have knowledge on Unified Namespace or equivalent standards Should be well versed with potential solutions options that can be used to more »

Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business Analysts and Data Architects with discovery and best practices. Self-directed and comfortable supporting the data needs of multiple teams, systems and products. What’s required ? Advanced Azure knowledge and experience working and migrating data products from … Azure Synapse Analytics, Azure Analysis Services Data Ingestion and Storage including Azure Data Factory, Azure Databricks, Azure Data Lake, Kafka and Spark Streaming, Azure EventHub/IoT Hub, and Azure Stream Analytics Experience with Object-oriented/object function scripting languages: Python preferred more »