26 to 50 of 189 Data Lake Jobs in England

Data Architect We are on the lookout for a visionary Data Architect to translate business requirements into technology requirements and defines data standards and principles for a leading and dynamic insurance company. You’ll be responsible for visualising and designing the organisation's enterprise … data management framework for how IT infrastructure supports our data strategy. The goal of this role is to show the company's infrastructure how data is acquired, transported, stored, queried, and secured. The data architecture built will be the foundation of any … Apache Iceberg, Apache Spark, Apache Hudi, Apache Kafka, Power BI, BigQuery, DeltaLake, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App Service, Azure ML is a plus. Languages : Python, SQL, T-SQL, SSIS and high-level programming knowledge on Spark is a plus. more »

A fantastic opportunity has a risen with our Financial Services client, for a Head of Data Engineering to join the team. The Head of Data Engineering will be responsible leading a team of data engineers to architect, build, and maintain a new data … requirements. The Head of Data Engineering will be involved from the very beginning of the project and will have experience of Azure Datalake and Databricks. Key responsibilities for the Head of Data Engineering Define and drive the data engineering strategy and technical roadmap in … successful digital transformation initiatives involving data engineering and analytics. Significant hands-on Microsoft Azure stack experience is a must: Data Lake, Data Factory, Synapse, Databricks, Power BI Strong in delivering solutions at scale, on time and within budget. Strong background in data more »

We are currently looking for an Azure Data Platforms Engineer on a contract basis (OSIR35) for a global retail organisation. The project will to deliver a foundational data platform to enhance data-driven decision-making and performance analytics.They will play an important role in … and data integration processes using Azure services such as Azure Data Factory, Azure Synapse Analytics and Azure Data Lake Storage. Responsibilities: Collaborate with solution/data architect to design and implement scalable, secure data infrastructure using Azure services. Develop … and support. Skills/Experience required: Proficiency in Azure services, particularly Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage. Strong understanding of data integration processes and tools. Knowledge of data security measures, including Azure Active Directory integration and more »

Azure Data Engineer Perm Cheltenham/Hybrid working (2/3 days per week onsite) Up to £65,000pa Candidates must be eligible for SC Clearance We're in search of an exceptional Azure Data Engineer to join our Engineering Team. As a member of our … for this role, you will need to be a sole British national, eligible to work on secure client sites. We're seeking a Data Engineer with a … focus on Azure, showcasing proficiency in: · Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. · Utilizing Azure data and analytics services, including but not limited to Azure Data Factory more »

Role: Data Engineer (Azure) Location: Bristol (hybrid on-site/remote) Salary: Up to £55,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETL Company: Join a dynamic IT transformation consultancy at the forefront of innovation, delivering cutting-edge solutions … for this role, you will need to be a sole British national, eligible to work on secure client sites. We're seeking a Data Engineer with a … focus on Azure, showcasing proficiency in: Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including but not limited to Azure Data Factory more »

brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Lead Data Engineer role sits within the Data Services department, you will work actively to unlock the value of data by building and enabling product teams and data practitioners to use the … and needs assessment. You Have These: Team management experience Exposure to, and ideally experience with, modern data architectures (e.g. data lake, lake house, data mesh) and accompanying technologies (e.g. Azure Synapse, Snowflake, Amazon Redshift) Awareness of data governance and all more »

Senior Data Engineer - 6 month FTC London (Hybrid Role) £85,000 per annum Senior Data Engineer Opportunity An exciting opportunity has arisen for a Senior Data Engineer to join a dynamic team dedicated to shaping effortless, digital-first customer experiences. This role is pivotal … in driving value for customers through modelling, sourcing, and data transformation. The Senior Data Engineer will collaborate closely with core technology and architecture teams, delivering strategic data solutions while promoting Agile and DevOps methodologies in data engineering delivery. Responsibilities: Automate data … mentoring abilities and good critical thinking with problem-solving skills. Nice to Have: Experience with relevant technologies such as Synapse, Azure Data Lake, Azure Data Factory, and Databricks. Why Join: This is an opportunity to join a collaborative environment that encourages innovation and values each more »

As the Data Architect, you'll lead data architecture initiatives, establishing standards and practices essential for effective data management. Your focus will be on designing and implementing robust data and information systems, ensuring they meet stringent criteria for modelling, flow, lineage, quality … and security. Working closely with stakeholders and data governance teams, you'll drive adherence to established standards, facilitating data-driven decision-making processes across the organisation. This role encompasses: Developing and maintaining a comprehensive Data Architecture Framework and maturity roadmap. Enforcing best data … Azure stacks, including data pipelines, security and networking Expertise with data warehousing, data lakes and data lake houses Experience with master data management software and technologies Experience with ETL technologies including SQL Server, SSIS, Azure Data Factory more »

Hi Professionals, Greetings From Ampstek!! Hope you are high in your spirits. Please stay safe. Our client is looking for Data Architect to join a high-growth organization. If you are interested share you resume sudhakaran.m@ampstek.com Role: Data Architect Location: London, UK (Hybrid) Duration: Contract … data with existing data architecture (called as UDP but essentially on Azure that consists of Stream Analytics, Data Lake, Ingestion and orchestration layers) Analysing existing solution (Legacy MES) to extract the data from its complex data model Skills needed … solution – SSRS) Should be well versed with Azure/Amazon cloud data architecture (Data Ingestion, Stream Analytics, Data Lake and Orchestration) Should have knowledge on Unified Namespace or equivalent standards Should be well versed with potential solutions options that can be used to more »

Job Title: AWS Data Architect Location: United Kingdom (U.K.) - Hybrid The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy dedicated to delivering exceptional value to our clients in the public sector. Our company culture promotes collaboration, autonomy, and rapid learning, empowering our … work environment focused on deliverable outcomes, along with a range of benefits to support our employees’ well-being and professional development. Key Responsibilities: Data Architecture Design: Collaborate with stakeholders to understand data requirements and design scalable and secure data architectures on AWS. Develop data models, data flow diagrams, and architectural documentation to support financial applications. Cloud Data Management: Design, implement, and manage cloud-based data solutions on AWS, including data lakes, data warehouses, and analytics platforms. Ensure the scalability, performance, and cost more »

Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business Analysts and Data Architects with discovery and best practices. Self-directed and comfortable supporting the data needs of multiple teams, systems and products. What’s required ? Advanced Azure knowledge and experience working and migrating data products from … Azure Synapse Analytics, Azure Analysis Services Data Ingestion and Storage including Azure Data Factory, Azure Databricks, Azure Data Lake, Kafka and Spark Streaming, Azure EventHub/IoT Hub, and Azure Stream Analytics Experience with Object-oriented/object function scripting languages: Python preferred more »

Senior Solutions Architect | Up to £120,000 + Bonus & Excellent Benefits | Northamptonshire | Hybrid Hydras are supporting an award-winning tech company specialising in Data and AI. The Senior Solution Architect will be joining their professional services team focusing specifically on their data practice. The role will … require 2-3 days per week in modern offices with some flexibility The Senior Solutions Architect will have significant experience in taking data services to market, working in a strategic capacity whilst also working with their sales function providing technical presales support through to product implementation and post … of data platform using Microsoft Azure stack Experience of using technologies such as Azure Data Factory, Azure Data Lake, Azure Databricks etc. along with Power BI. If you are a Senior Solutions Architect with strong experience in the data services space more »

A Data Platform Product Manager required by this leading research and analytics vendor to join an existing Data engineering/product function as they look to continually improve their product and application suite. You will be required to build strong relationships across the client and use … a strong commercial mindset and data expertise to define and execute the roadmap and backlog for the data engineering and products. Experience should include: Significant experience 3 years+ as a data business partner/manager/product owner/data analyst or … technical business analyst in a data platform domain Be an experienced subject matter expert within the data platform domain, with strong technical knowledge and demonstrable passion, including understanding on (some of): Data lakes, data marts, data warehousing (Azure Data more »

unparalleled educational experience. By attracting and retaining the finest educators worldwide, our client ensures an environment where excellence thrives. Job Purpose As the Data Platform Engineer overseeing the Data Warehouse and analytics infrastructure, you will shape the backbone of our client's business analysis and reporting … capabilities, both now and into the future. They are seeking a visionary with a proven track record of architecting enterprise-level data ecosystems, someone who thrives on pushing the boundaries of what's possible in data manipulation. Your expertise will ensure data is not … Remarkable experience with Development and maintenance of data pipeline and ETL processes using Azure data Factory, Azure Data Lake and Azure Databricks. Exceptional experience developing codes, testing for quality assurance, administering Azure Databricks platform and exposure to Unity Catalog. Exposure of Performance Tuning more »

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture … Spearhead the design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors … Skills and Experience: Proficiency in Microsoft Azure Data Services, including Azure SQL Database, Azure Data Factory, Azure Data Lake Storage, and Azure HDInsight. Advanced skills in SQL programming, with the ability to design, optimize, and maintain complex queries and databases. Strong experience in more »

Are you an experienced best in class data engineer with 5-10 years' experience? Do you have experience or capability for a senior data engineering role ? If so, we want to hear from you ! We are currently recruiting for 2 experienced data engineers who … can support the data manager implementing and maintaining an effective business intelligence technical services . Support cloud platform and reporting, assisting in design and developing a data acquisition strategy, reporting to customers, and maintaining datasets. Key Responsibilities are: Monitor and maintain ETL processes , ensure accurate reporting … can best be gathered. Skills and knowledge needed: Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, extensive Power BI experience Extensive experience of working with Azure Data Factory & Databricks Extensive SQL knowledge (Microsoft more »

Are you looking for an exciting opportunity in Solution Architecture ? Are you passionate about everything cloud and data ? Join us as an AWS Cloud Data Platform Solution Architect Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do … knowledge/experience: Experience of AWS Data platform experience including AWS-EMR Cluster Platform, Glue, EC2, S3, VPC, IAM, RDS, Redshift, Sagemaker, Lake formation and Glue catalogue. Data Storage Fundamentals. Cloud specific patterns and technologies. AWS Service Selection, Container design. Designing DevSecOps pipelines. Experience in … Pyspark. Good to have: Experience in Databricks platform. Insurance domain knowledge (Pensions & Annuity.) Understand the data platform solutions like data lake, data warehouse, data marts. AWS solution architect certifications. Rewards & Benefits: TCS is consistently voted a Top Employer in the UK more »

Advanced Specialisation. Adatis is now part of Telefonica Tech as of March 2022, powering the next phase of our growth. We’re a Data Analytics Consultancy that works with our clients to deliver information solutions, to help make better informed business decisions. Our integral approach within our team … people really love; and, importantly, a career model that lets you take control of your development and progression. OUR VISION To be the data analytics company most admired for its people, culture and innovation. THE ROLE The primary focus for you will be the design and delivery of … DAX Data Modelling/Data Warehouse Theory Nice to Have Azure Modern Data Platform Services (Data Lake, Data Factory, Databricks, Synapse) Azure DevOps/CI/CD/YAML/ARM/Terraform MSBI Traditional Stack (SQL, SSAS, SSIS more »

in X++ and T-SQL, experience in developing within the Power Platform, and familiarity with Azure integration technologies (Functions, Logic Apps, Data Lake, Synapse, ADO). Key Responsibilities System Integration: Collaborating with stakeholders to understand business requirements and designing integration solutions to connect Dynamics 365 Finance and … Operations with other systems such as ProjOps, Dataverse, Data Lake, Synapse, Enterprise Data Warehouse (EDW), or third-party applications. Development: Writing code and developing custom solutions using relevant programming languages and technologies (such as X++, C#, SQL, XML, JSON) to create seamless data … including solutions. T-SQL development skills Cloud Integration specialisms familiar with the range of Azure integration technologies Functions Logic App Azure Data Lake Azure Synapse Azure DevOps Experience in developing solutions within Power platform (Power Apps, Power automate), Dataverse Experience of integration work with payroll/HR more »

non-technical deliverables. As an integral team member, you will play a key role in advancing Study Group's transition to a more data-driven culture, all while supporting data governance initiatives. ABOUT THE ROLE Undertake simple and complex statistical analysis of a variety of different … establishing and maintaining automated data processes. This will involve working with the Data Architecture Team around the data lake by identifying and revising reporting requirements. Will need to develop and maintain MI/data reports and dashboards. Reports often must be … initiative to manage competing priorities and requirements, whilst ensuring the delivery of key objectives. Ideally, experience using SQL servers, Microsoft Azure Data Lake, or Oracle databases and data warehouses. Highly desirable if there is experience with Alteryx. Highly desirable if there is experience with R more »

Data Engineer - 5 Month Remote Contract Interviewing now for a Data Engineer for a remote project (Outside IR35.) We are seeking an experienced Data Engineer responsible to develop and deliver … data solutions, optimising data to ensure data availability and accuracy. You will extract data from the Datalake using Big Query. You will Build data pipelines from gathered requirements to support delivery of data solutions. You will also track …/UK Start: ASAP Skills -Previous experience in database services, design, implementation and experience at enterprise level data platforms, data lake concepts and data handling. - Proficient with SQL, joins, PKs, FKs, referential integrity. -Previous data warehouse skills including ETL. -Proficient working more »

Senior Data Engineer About us HENI is a technology company pioneering art markets and information. We work with world-leading artists and estates across various sectors, including printmaking, book publishing, NFTs, digital content, and art research – all underpinned by cutting-edge research in analytics, AI, and machine learning. … Our team comprises of talented web developers, data engineers, data scientists, and infrastructure specialists who thrive on solving complex problems. We enjoy developing machine learning tools and embracing the latest in infrastructure and coding methodologies. We maintain high standards of technical quality via thorough testing and … ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data storage, emphasizing the importance of data integrity and version control in our workflows. Day-to-day more »

Senior Data Architect Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to Be Yourself At Work. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that … agile and entrepreneurial culture. Your Capco Day/Key Responsibilities You will accompany and lead complex agile consulting projects supporting our clients with data architecture design and delivery. You will work with technology leaders across Financial Services to provide best practice guidance for data management and … procedures, architectures and technologies in one or more of the following topics: Contextual Datamodelling, Entity Relationship Modelling, Logical & Physical Datamodelling and Data Lake design. Experience designing and implementing cloud data migration and storage patterns on one or more of AWS, GCP and Microsoft Azure Experience more »

partner with Deutsche Bank to support contingent recruitment processes. Job description - the role On behalf of Deutsche Bank, we are looking for a Data Governance Analyst for an initial 6 month contract based in the Banks London Office on a hybrid working model of 3 days per week … Together we're sharing new perspectives and transforming what it means to be a bank.' Purpose of the role: Transaction Monitoring & Screening Global Data Steward Office is responsible for Data Governance, Data Quality Management (DQM) & Data Programme delivery covering key functions within … Transaction Monitoring and Screening. Working as part of the DQM team the Senior Data Analyst will be responsible for supporting the Data Quality Management Framework and for contributing towards the central Data Analytics capability. Data Quality Management Framework covers Data more »

Data Analyst Location: Hybrid - London Package: Negotiable + Benefits The Data Analyst for Data Operations will be responsible for gathering, collating and analysing data issues and translating them into data and reporting needs, using technical expertise to ensure data accuracy and high-quality, whilst ensuring delivery deadlines meet business requirements. Working closely with the data operations team, business stakeholders and the wider data team in resolving operational and data issues. The day to day: You will be an experienced analyst who … communication and collaboration skills Experience with data warehousing Experience in the Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL Server, Azure Power Platform, Power BI. The rewards: negotiable basic salary and all the normal benefits you’d expect (Holiday, company more »