76 to 94 of 94 Data Lake Jobs in the UK excluding London

Job summary It is said that in today's modern world data is a richer resource than oil. As Healthcare becomes more complex, there is an ever growing need to understand and interpret large data sets to provide insight and support decision makers, ensuring we serve … as performance and demand reporting to all business areas. At the heart of this strategy is the development of an Azure Data Lake and structured Data Warehouse. The Data Engineers will support the Head of Data Engineering and the Senior Data … Engineering and wider BI team in the design, development expansion and maintenance of the ICB 'data warehouse', Azure Data Lake and Business Intelligence (BI) systems, acting as a deputy where required. To assist in developing the data assets and capabilities of the more »

We are searching for an experienced Data Engineer for an outstanding technology focused business based in Devon. The role is offered on a hybrid working basis, so to be considered for the vacancy you need to either live within a commutable distance of Exeter/East Devon or … Methodologies Any experience working with the following is an advantage but is NOT essential: - PowerShell Azure AWS PowerBI/Power BI Data Lake We are looking to speak with candidates who are good team players and communicators, people that are happy to present their ideas in meeting … Engineer, Databricks, Python, TSQL, T-SQL, Test Automation, Unit Testing, Mocking, Refactoring, Agile, Scrum, PowerShell, Azure, AWS, PowerBI, Power BI, Data Lake Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this more »

About the Role: I am looking for a talented Data Engineer to join our clients dynamic team on a 6-month contract basis. This is an exciting opportunity for a mid-level professional with 3-5 years of experience to make a significant impact on our data …/hybrid working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data … data quality and validation checks to ensure data integrity. Contribute to the development and maintenance of our data lake and data warehouse solutions on AWS. Participate in code reviews and provide constructive feedback to peers. Required Skills and Experience more »

tasks. Knowledge of CI/CD approaches for Data Platforms using Bitbucket and Bitbucket Pipelines. Knowledge of AWS data lake approaches using Athena & Apache Iceberg tables. Exposure to visualisation development using Power BI. Knowledge of MS SQL Server, SSIS, Visual Studio, and SSDT projects. … their team. In this role, you will have the opportunity to work with cutting-edge technologies such as Bitbucket and AWS Data Lake while collaborating with a team of innovative individuals. As a Data Engineer, your main responsibility will be developing and maintaining data pipelines on Bitbucket using Bitbucket Pipelines. You will also use your knowledge of AWS data lake approaches to optimize performance by implementing Apache Iceberg tables. This is an exciting chance to gain experience in visualisation development using Power BI and working with MS SQL Server more »

Data Analyst X 2 - Manchester Our Manchester client is looking for two Data Analysts to join our friendly and diverse team. Your role will involve turning data into insightful analysis and models to drive business growth. You will help develop customer analysis, provide insights … identify opportunities for strategic improvements. Key Responsibilities: Analyse and interpret large datasets to identify trends, patterns and insights Develop statistical models and perform data mining techniques to support business decisions Work closely with various teams across the organization to understand their data needs and provide appropriate … research on business challenges Generate reports from both structured and unstructured data in our Data Warehouse and Data Lake Assist in regulatory and compliance tasks by creating detailed reports Develop, prototype, and maintain reports in Power BI utilizing SQL and DAX Engage in more »

About the AWS Data Engineerj ob Stride Recruitment are looking for skilled and motivated AWS Data Engineers to join a consulting firm offering end-to-end data solutions, delivering best-in-class experiences for their external clients. To be successful in this AWS Data Engineer role, you will need to have a strong background in AWS, with experience in data warehousing, data lakes, and data integration. You should also have a good understanding of data modelling, ETL processes, and data governance. Technical … Skills: Proficiency in AWS Glue, AWS Redshift, and Python Experience with ETL processes, data integration, and data warehousing. Strong SQL skills Experience with Big Data technologies such as Hadoop, Spark, and Kafka Familiarity with cloud platforms (AWS, Azure, Google Cloud) Working knowledge of data more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal … years in a Lead/Principal Engineer role. l 3+ years of experience with GCP. l Extensive experience with SQL and Data Lake/Warehouse solutions. l Proficiency in languages such as SQL, Python, Java, or Scala. l In-depth knowledge of query optimization techniques and experience more »

Description Who we are At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in fair and equitable way. … and business analysts you will be accountable for the results and delivery of the team, with a focus on innovation. Working in the Data and BI domain, you will gain valuable experience and progress your career, using newer technologies and defining best practices to deliver a self-service … technical debt, or other means) Occasionally, being able to lend hands-on support to the team working on and using the following technologies:Data Warehousing, Data Modelling, Database Design, ETL, AWS Redshift, SQL Server, Power BI, Cloud/DevOps AWS, Docker, Terraform, Bitbucket, Bamboo, Team City more »

occasional office travel Circa £70,000k The client is looking for a Power Bi Developer to design and develop Business Intelligence solutions using data from Microsoft Dynamics 365. You'll be liaising with the central BI and Data teams to ensure a consistent approach whilst analysing … Power BI Desktop, Power BI Service, Datasets, Dataflows, DAX, M, Power Query) Dynamics 365 CRM - Sales, operations, marketing - development experience Azure Data Lake Modis International Ltd acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers in the UK. more »

Principal Data Engineer Northwest Up to £76,000 VIQU are seeking Principal Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a dedicated team … across numerous specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will … roles - Demonstrated leadership experience. - Over 3 years of hands-on experience with Google Cloud Platform (GCP) - Deep expertise in SQL and Data Lake/Warehouse solutions - Advanced skills in programming languages such as SQL, Python, Java, or Scala - Extensive knowledge of query optimisation techniques and a proven more »

Role: Data Engineer Salary: £40,000 - £50,000 Location: Dorset (1 day a week onsite) Overview The Data Engineer will work closely with IT, Finance and Operations to deliver the business reporting requirements within a timely and consistent manner. They are required to develop and provide … trusted data on performance, financial positions to aid decision making across the business. They also to provide tactical information to end users to support process. Benefits Up to 10% matched pension scheme with Standard Life Death in Service: 4 x salary Annual Car Parking permit Purchase monthly during … Children under the age of 24 can be covered free of charge. Skills Hold qualifications in related disciplines such as Statistics, Mathematics and Data Sciences Experienced in working Microsoft Cloud Data and Automation technologies Experienced working with Tableau and or Power BI Experienced in data more »

This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. Client Details Global … when needed, accurate and understood. Key Technical Skills required: Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI Extensive experience of working with Azure Data Factory & Databricks Extensive SQL knowledge (Microsoft SQL Server … . Metadata management/Data quality Profile Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI Extensive experience of working with Azure Data Factory & Databricks Extensive SQL knowledge (Microsoft SQL Server more »

term objectives. As a BI Specialist, you will be responsible for: Transitioning to Azure cloud technologies, such as Azure Fabric and Data Lake, to optimise data storage and processing. Overseeing the release of SQL Code, stored procedures, and table changes. Deploy source code into production … environment. Addressing sustainability concerns with the current Data Lake setup, potentially involving external consultancy for guidance. Reviewing and enhancing the architecture of data solutions, with a focus on replacing reporting tools like Snap with more efficient alternatives. Collaborate with DevOps Engineers to ensure seamless integration … deploy, particularly focusing on .NET changes and code deployment. Eliminating internal delays in software releases, streamlining processes, and enhancing overall efficiency within the data and architecture function. To be successful in this role, you should have the following skills and experience: Data Release Octopus Deploy Stored more »

a business who have made great strides in investing in their IT function and who have stated that being led and driven by data is one of their core business aims. You will be integral to this and will be responsible for establishing and building the Data & Analytics function from scratch - you'll design, own and implement the Data Science/Data Analytics strategy as well as selecting and implementing the tools that will enable them to improve the performance of the business. The Role: The role sits within the core … work with. The Tech stack is new and investment within the business is there to enable you to establish and build a successful Data/Analytics functions. Key responsibilities include: - Lead the development and execution of the roadmap for Data and Analytics - Work closely with key more »

with major global brands are entering a period of growth within their new office location in Llandysul… They are currently seeking an experienced Data Architect to play a crucial role in designing and managing their data infrastructure. You’ll leverage your technical expertise and join a … of learning, who are not afraid of making mistakes and thinking outside of the box. You’ll develop innovative solutions and transform complex data into meaningful insight, using your experience in data modelling, database design, and data governance. You will spend time collaborating with …/GCP/Azure/Cosmos) Knowledge of data governance and modern concepts e.g., data mesh and data lake houses Knowledge of data science and ML platforms e.g., Databricks, Vertex, Fabric Applicants must be within commutable distance of Llandysul for more »

this organisation now, all have said glowing reviews about it, they're the leader in legal representation comparison and have rather interesting, unique data to work with. They are using modern Azure tools and have some very exciting initiatives! They are looking for an a mid -weight Data … warehouses and data lakes. Familiarity with Azure Cloud Services. Sound understanding of T-SQL programming. Exposure to Azure Data Lake technologies, including ADF, HDFS, and Synapse. Solid knowledge of Data Governance, Data Catalog, and Master Data Management. (You more »

implemented by a Sales focused Cloud Architect with an ability to secure UK eDV security clearance. With Machine Learning techniques, Encryption and Big Data tools, this firm have solved a critical privacy issue that will benefit National Security and Intelligence clients across the world and is equally impactful … for other sectors, allowing private access to Neural Networks and Data sets for knowledge growth. If you are interested in delivering impactful product presentations and able to highlight mission-critical benefits of a software product, you will be highly valued in this role. Youll need to lead during … consultative selling of B2B software Demonstrable experience working with Privacy technologies such as homomorphic encryption, SMPC, Federated Learning, TEE. Any prior experience with Data management or tooling hugely beneficia (Data Lakes, Snowflake or Databricks). Experience working closely with engineering teams (particularly those working on Machine more »

and platforms. Role purpose/summary Collaborate with stakeholders to understand business requirements and translate them into effective solution designs for our party data model data platform. Architect and implement cloud-based solutions that leverage popular data platforms to enable efficient storage, processing, and … analysis of large-scale data. Design scalable and resilient architectures that ensure high availability, fault tolerance, and disaster recovery for our data platform. Assess and select appropriate data platforms and technologies based on functional and non-functional requirements, considering factors such as performance, scalability, security, and … platforms such as Amazon Web Services (AWS) (e.g., S3, RDS, Redshift, Athena), Microsoft Azure (e.g., Blob Storage, SQL Database, Data Lake Analytics), or Google Cloud Platform (e.g., Cloud Storage, BigQuery). Deep understanding of cloud computing concepts, including infrastructure as code, serverless computing, and containerization. more »

will include… You will be able to produce a variety of reports focusing on a range of areas, including; Security, Performance, compliance audits, data collected from various IT Systems and tools. Strong ability to maintain and develop technical documentation, including system configurations, network diagrams, operating procedures to support … clients IT Environments. You will be analysing large data-sets to identify trends, patterns and anomalies, and have the ability to extract worthwhile insight to be included in the reports. Be an SME around identifying opportunities where automation report created can be used, using scripting languages and reporting … tools to enhance efficiency and scalability. What you've got… Experienced background in Report Writing, Data Analysis, or technical documentation within the IT/Tech industry. Experience on Microsoft office applications! Particularly Excel + Word, for documenting and report writing purposes. Being confident on Azure is a must more »