101 to 125 of 233 Data Lake Jobs in the UK

least 4 years of design and development.experience with various relevant Microsoft platforms, tools, technologies, patterns, and techniques related to Azure tools, integration, and data is required.Experience with industry/domains like pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred.Experience with healthcare industry regulations, data … etc., and connectivity & security configurations (certificates, encryptions, etc.).In-depth knowledge and experience with Azure data storage (SQL Server, Data lake, Synapse, etc.) & access tools, APIs, cloud connectivity, and ETL processes.Knowledge and some experience of MS Office/MS Office 365 suite, SharePoint Online, Power … Azure DevOps and CI/CD pipeline.Experience working with APIs, Postman/SOAPUI tools, MS D365, ServiceNow, Azure Analytics tools, Azure Data lake, Azure Synapse, Azure BYOD & Data verse, Informatica, BI tools, etc. is a big plus.General business skills:Clear communication to translate and explain more »

infrastructure investments. Be part of a dynamic team driving growth and maximizing value in the alternative asset management industry. Key Responsibilities: Support the Data Team Lead in system updates. Develop, modify, and maintain software components. Resolve data/software issues and suggest technical solutions. Collaborate with … experience in Azure data systems. Proficiency in Data Warehouse technologies and SQL. Familiarity with Azure services like Data Lake and Data Factory. Essential Experience: Supporting traditional Data Warehouses. Building Azure data pipelines and data lakes. more »

located in Stamford, CT, USA as a hybrid role.Position Description/Requirements The Azure Cloud AI Engineer is a member of the Enterprise Data Services (EDS) team within Global IT Services. In this capacity, the candidate will work with a team of empathetic, autonomy-supported, well-connected, competent … and passionate data analysts, data engineers, data architects, and data scientists (i.e., a data team) responsible for empowering the organization with modern data science and AI tools, technologies, and workflows. The ideal candidate will be highly empathetic, collaborative … and securing Azure solutions. - Strong experience in automating CI/CD pipelines in Azure. - Strong experience with integrating Azure storage (e.g., Data Lake, Cosmos DB, Microsoft SQL Server, etc.) in broader solutions. - Experience in deployment and functionality of container services (e.g., Azure Kubernetes Service). - Good understanding more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Python Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Senior Data Engineer 💰 £80,000-£100,000 🖥️ AWS, Python, Docker 🌍 London, 3 days a week in office We are exclusively partnered with a high growth, early stage startup operating in the beauty and wellness industry (in the UK and now US!) and supporting them on their search for … a Senior Data Engineer. The role... As the company's 1st Data Engineer, you’ll be the central player in building the integrated data architecture from the ground up. You'll gather data from diverse sources, build and maintain data … What you'll be doing... You will gather data from various departments and tools, integrating it into a central data lake or warehouse. You will design and construct data pipelines to automate data flow, involving ETL processes as needed. You will more »

Write high-quality, maintainable code using languages such as Python , SQL . Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2 Utilize PowerBI, Tableau, or similar tools to design and create interactive and visually appealing dashboards and reports. Work closely with … PoCs to validate new technologies, frameworks, or solutions. Drive the development of MVPs, ensuring timely delivery and alignment with business goals. Azure and Data Engineering: Leverage your Azure expertise to design and implement cloud-based solutions. Collaborate with data engineers to build robust data pipelines and ensure data quality. SQL and Data Interface: Develop and optimize SQL queries for data retrieval and manipulation. Work on data interfaces to connect various systems within the bank. Qualifications: Bachelor’s degree in Computer Science, Information Technology, or more »

Senior Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £100,000 Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great … opportunity to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real impact on a scaling business. You will be working very closely … be up to?: Data Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse. Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as more »

We are searching for an experienced Data Engineer for an outstanding technology focused business based in Devon. The role is offered on a hybrid working basis, so to be considered for the vacancy you need to either live within a commutable distance of Exeter/East Devon or … Methodologies Any experience working with the following is an advantage but is NOT essential: - PowerShell Azure AWS PowerBI/Power BI Data Lake We are looking to speak with candidates who are good team players and communicators, people that are happy to present their ideas in meeting … Engineer, Databricks, Python, TSQL, T-SQL, Test Automation, Unit Testing, Mocking, Refactoring, Agile, Scrum, PowerShell, Azure, AWS, PowerBI, Power BI, Data Lake Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this more »

as a Power BI Developer Analyse large datasets and draw on your expertise with Power BI to provide expert reporting and intelligence into data driven decision making for key Customer Focused areas across the business. Work with data engineers across IT & Data teams to … provide guidance and consultancy on producing an efficient and accurate reporting infrastructure. To mentor and provide training to the Data Team, to develop their skills with Power BI and surrounding processes. Experience & Skills Required Expertise with Data Visualisation and Report Presentation using Power BI. Able to … design, data transformation and engineering for reporting purposes. Proficiency with the Azure Suite, Data Factory, SQL DB, Data Lake Storage Must have experience in working with consultancies and end-clients If this is something of interest to you, please send your CV across more »

and platforms. Role purpose/summary Collaborate with stakeholders to understand business requirements and translate them into effective solution designs for our party data model data platform. Architect and implement cloud-based solutions that leverage popular data platforms to enable efficient storage, processing, and … analysis of large-scale data. Design scalable and resilient architectures that ensure high availability, fault tolerance, and disaster recovery for our data platform. Assess and select appropriate data platforms and technologies based on functional and non-functional requirements, considering factors such as performance, scalability, security, and … platforms such as Amazon Web Services (AWS) (e.g., S3, RDS, Redshift, Athena), Microsoft Azure (e.g., Blob Storage, SQL Database, Data Lake Analytics), or Google Cloud Platform (e.g., Cloud Storage, BigQuery). Deep understanding of cloud computing concepts, including infrastructure as code, serverless computing, and containerization. more »

About the AWS Data Engineerj ob Stride Recruitment are looking for skilled and motivated AWS Data Engineers to join a consulting firm offering end-to-end data solutions, delivering best-in-class experiences for their external clients. To be successful in this AWS Data Engineer role, you will need to have a strong background in AWS, with experience in data warehousing, data lakes, and data integration. You should also have a good understanding of data modelling, ETL processes, and data governance. Technical … Skills: Proficiency in AWS Glue, AWS Redshift, and Python Experience with ETL processes, data integration, and data warehousing. Strong SQL skills Experience with Big Data technologies such as Hadoop, Spark, and Kafka Familiarity with cloud platforms (AWS, Azure, Google Cloud) Working knowledge of data more »

Lead Azure Data Engineer - Manchester - £60,000-£75,000 My client has an immediate and exciting opportunity available for an experienced Azure data engineer to join and help lead their small team of developers. You'll have the opportunity to expand your skills by delivering valuable … data insights to drive change across various business areas. Key Responsibilities: Develop and implement data and reporting solutions using the latest Microsoft technologies: SQL Server Integration Services, Azure Synapse Analytics, Azure Analysis Services, Azure Data Lake, Azure SQL Database, Azure Data Factory, and Power BI. Collaborate with team members or directly with business users to understand requirements and more »

Data Engineer London - Hybrid working £55,000 - £60,000 A global leading HR staffing organisation based in London is currently looking to recruit a Data Engineer who will play a crucial role in designing, developing, and maintaining the data infrastructure that powers innovative solutions … within the client. We require an engineer who has a passion for data and has a good background in Azure, synapse, Databricks, SQL, Python and DataOps. This is a fantastic opportunity for a Data Engineer to gain exposure to different business areas from Visualisation, Machine Learning … Alongside this my client is going to be going through a cloud migration to Azure. Responsibilities : Collaborate with cross-functional teams to understand data requirements and design efficient data pipelines. Develop and maintain scalable data models and databases. Design and implement data more »

Data Engineering Lead Salary - Circa £65,000 Are you someone with a proven track record in data engineering, ready to lead and innovate? We have an exciting opportunity for an experienced Data Engineering Manager to manage a data development team who are … responsible for delivering IT data solutions across Aviva. As demand for data continues to grow across the organisation, we are in need of an experienced team lead from a technology … background to manage development projects through the full project life cycle with specific focus on ETL/data store (data lake/warehouse) in an Amazon Web Services environment. A bit about the job: This is a great opportunity for the right technology-aware individual more »

term objectives. As a BI Specialist, you will be responsible for: Transitioning to Azure cloud technologies, such as Azure Fabric and Data Lake, to optimise data storage and processing. Overseeing the release of SQL Code, stored procedures, and table changes. Deploy source code into production … environment. Addressing sustainability concerns with the current Data Lake setup, potentially involving external consultancy for guidance. Reviewing and enhancing the architecture of data solutions, with a focus on replacing reporting tools like Snap with more efficient alternatives. Collaborate with DevOps Engineers to ensure seamless integration … deploy, particularly focusing on .NET changes and code deployment. Eliminating internal delays in software releases, streamlining processes, and enhancing overall efficiency within the data and architecture function. To be successful in this role, you should have the following skills and experience: Data Release Octopus Deploy Stored more »

and growth of our bespoke development capabilities. Leading design phases on Business IT programmes, validating requirements and ensuring that all aspects of UX, data and solution design are within scope, complete, and deliverable. Having responsibility for the architecture of data and solutions delivered to the business … premise application to the cloud Azure Cloud development, Blazor, NServiceBus, CQRS and Domain-driven design, Scrum/Agile, API Design and management skills Data Engineering projects using Data Lakes, Data factories, ETL techniques, Synapse and PowerBI … MS Logic and Power Apps Azure DevOps Experience with the following would be beneficial: AI + Machine Learning Analytics: Analysis Services, Data Lake Analytics, Data Catalog DevOps: Application Insights Key Competencies Will use a coaching and influencing style to achieve outcomes rather than taking a more »

they are always looking to adapt to technological changes to stay at the forefront of the industry About the Role: As a Principal Data Engineer, you’ll play a pivotal role to help drive the adoption of Microsoft Power platform and streamline reporting and analytics processes across the … organisation, we are looking for a Data Engineer with extensive multi-cloud data engineering experience and in-depth understanding of end-to-end development and deployment processes. Whilst this is a data engineer role, the focus is on data analytics and migrating … from Tableau to Power BI. Experience/skills required: Proficient in data analysis, data modelling and designing ETL processes. Familiar with Data Mesh architecture and Data Products Highly skilled in T-SQL with experience in performance tuning and dealing with large data more »

term objectives. As an Automation Specialist, you will be responsible for: Transitioning to Azure cloud technologies, such as Azure Fabric and Data Lake, to optimise data storage and processing. Overseeing the release of SQL Code, stored procedures, and table changes. Deploy source code into production … environment. Addressing sustainability concerns with the current Data Lake setup, potentially involving external consultancy for guidance. Reviewing and enhancing the architecture of data solutions, with a focus on replacing reporting tools like Snap with more efficient alternatives. Collaborate with DevOps Engineers to ensure seamless integration … deploy, particularly focusing on .NET changes and code deployment. Eliminating internal delays in software releases, streamlining processes, and enhancing overall efficiency within the data and architecture function. To be successful in this role, you should have the following skills and experience: Experience automating SQL Deployment into multiple environments more »

Advanced Specialisation. Adatis is now part of Telefonica Tech as of March 2022, powering the next phase of our growth. We’re a Data Analytics Consultancy that works with our clients to deliver information solutions, to help make better informed business decisions. Our integral approach within our team … a career model that lets you take control of your development and progression. So, if you want to do some great things in data analytics (and have some fun at the same time), welcome to Adatis. OUR VISION To be the data analytics company most admired … role will vary depending on the project but will primarily focus on the delivery of enterprise-level applications in the Business Intelligence and Data Analytics arena. This is a client-facing position, so the ideal candidate must be comfortable speaking with clients and some occasional travel. Our offices more »

including integration with third party systems. Architecture Development: Define the overall solution architecture for D365 CE/Power Platform projects, including system integrations, data models, security, and scalability considerations. Technical Leadership: Provide technical leadership and guidance to development teams throughout the project lifecycle, ensuring adherence to best practices … Conduct detailed requirement analysis, identify gaps, and propose appropriate d365 CE/Power Platform components and customizations to meet client needs. Integration and Data Management: Design and implement integrations between D365/Power Platform/LOB systems, leveraging connectors, APIs, and data manipulation techniques to ensure … D365/Power platform/integration. Deep understanding of relevant Azure services such as Azure logic apps, API service, Web Jobs , Data Lake, Data Factory, Synapse, and Azure Functions. Lead experience working with MS SQL Server, SSRS, SSIS, KingswaySoft and/or other prominent data more »

About the roleA Payments FinTech are currently seeking a Data Engineering Lead (Python, Hadoop & SQL) to lead and mentor a talented team of data engineers and scientists as they look to simplify the bank through developing innovative data driven solutions, allowing them to be … business-critical platforms.Desirable skills & experienceWorking to an Agile methodology and familiarity with Azure DevOpsDeep automation knowledge with PythonSkilled in Pyspark and SynapseExperience with data modelling and visualisation in … Power BI (or alternative)A strong understanding of architecting data platforms, BI, MI, or analytics solutionsStrong experience using Azure Data Lake, Azure Data FactoryDeliver the automation data pipelines and building of a scalable data architecture. more »

this organisation now, all have said glowing reviews about it, they're the leader in legal representation comparison and have rather interesting, unique data to work with. They are using modern Azure tools and have some very exciting initiatives! They are looking for an additional Snr Data Engineer to join a well established team, this could possibly suit a mid weight Data Engineer who has mentored others. Salary is circa 75K with a 5% bonus There is no sponsorship for this role, sorry. Responsibilities: Guiding a team of developers in the creation, optimization … warehouses and data lakes. Familiarity with Azure Cloud Services. Sound understanding of T-SQL programming. Exposure to Azure Data Lake technologies, including ADF, HDFS, and Synapse. Solid knowledge of Data Governance, Data Catalog, and Master Data Management. Understanding more »

Scalexperts are partnered with a VC backed education group who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function. They are looking for a Senior Data Engineer to join them to work on building a … brand new data platform which is still in early stage development. They are looking to combine all the data into one common data platform heavily on Azure so that reporting & insight/analytics becomes much clearer and more consistent. This role will require someone … years experience in Data Engineering Azure experience ideally worked with tools such as Synapse, Azure Data Factory, Data Lake etc Experience with SQL is a must, some Python is a bonus Confident in providing technical leadership Able to gather requirements for a variety more »

Senior Data Engineer (No Sponsorship Available) I am seeking an experienced Data Engineer who has experience managing green field projects and implementing modern data platforms that connect business systems and data sources to drive insights through data analytics. The ideal … candidate will have experience using Azure Platforms for consolidating data sources and making them accessible to the wider business to support growth and business strategy. Must have strong communication skills and be comfortable liaising with key stakeholders and other business units to understand business needs and gather requirements. … designing and building data infrastructure and ETL pipelines Experience with Azure Platform including Data Factory, Synapse, and Data Lake DB development experience with SQL Software development experience in relevant languages like Python or C# Experienced with T-SQL and RESTful APIs Experience with more »