76 to 100 of 244 Data Lake Jobs

Senior Data Engineer- Fast growing SaaS Scale up 🚀 West Midlands- hybrid working Up to £86K base with bonus and benefits The client SaaS Software business platform which is revolutionising financial management for their customers. Responsibility: Working to ensure a high-quality data platform. Design, develop, test … deploy data pipelines and integrations using IPaaS technology Collaborate on engineering platform ingestion, orchestration, data warehouse/data lake and API strategies for the data management ecosystem Willingness and an enthusiastic attitude to work within existing processes/methodologies. Collaborate with … enterprise-scale volumes of data, ideally with proficiency in Snowflake. Experience Data Stores - Technical excellence in SQL, NoSQL, Blob,Delta Lake, and other enterprise scale data stores. Data Orchestration - Enterprise scale usage of technology such as Azure Data Factory more »

Introduction Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware that our work impacts millions of patients … in the development of disaster recovery and business continuity plans. Preferred Qualifications: 3-5 years working in Azure cloud environments, Azure Data Lake, Azure Data Factory Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field. Experience working in healthcare … or pharmaceutical industry. Proficiency in Azure Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Knowledge of Azure DevOps, CI/CD pipelines, GitHub, Kubernetes (AKS). Additional certifications in relevant areas such as Azure Security, Azure Networking, or Azure AI/ML. Experience more »

the UK, USA and Australia, their dynamic technology team – the driving force behind their success – is looking for a talented and creative Senior Data Engineer to develop and implement new Greenfield software solutions for seamless data accessibility. The Role: Designing and implementing data solutions … constructing new infrastructure to centralize data, and delivering actionable insights across the business. Responsibilities include collaborating with key stakeholders, gathering requirements, designing solutions, and leading the development lifecycle. Key Duties: Cultivate relationships with key stakeholders to design and implement data solutions aligned with business requirements. Lead … similar role. Proven track record in designing and building data infrastructure and ETL pipelines. Proficiency in Azure Platform, including Data Lake, Data Factory, Synapse, Logic Apps, and Function Apps. SQL Server, including Store Procedures, T-SQL, or similar enterprise database toolset. Familiarity with more »

Contract Relevant context A fast growing Energy & Commodities trading company is embarking on a transition from a CTRM-centric technology architecture to a data-centric model, termed as the Digital Data Hub (DDH), to enhance scalability and stability. The first phase involves the integration of a … Allegro to Topaz derivatives integration project. Engage in the development of various test automation frameworks targeting web applications, thin client, microservices, real-time data processors, data analytics/visualizations reports. Ensure the automation test frameworks and tests are aligned with the existing programme test automation strategy … experience, backend test experience. Exposure/experience in cosmos dB and azure event hub. in data quality assurance around Data Lake, Data bricks and ETL. Exposure working with Power BI. Knowledge and experience of implementing test best practice. This is an Outside IR35 more »

Data Engineer/Architect (GCP) Google Cloud Platform | Fully Remote | £55,000 The Role: My client are a leading digital consultancy, specializing in delivering innovative solutions to businesses worldwide. With a focus on leveraging cutting-edge technologies and strategic insights, they empower our clients to thrive in the … digital age. Position Overview: We are seeking a talented Data Engineer/Architect with expertise in Google Cloud Platform (GCP) to join our team. This position is fully remote, with the option to work from offices based in Cardiff, United Kingdom. As a Data Engineer/… Architect, you will play a pivotal role in designing, implementing, and optimizing data solutions that drive business value for our clients. You will collaborate closely with cross-functional teams to understand business requirements, architect scalable data solutions, and ensure the successful delivery of projects. Key Responsibilities more »

Job Description: Lead Data Engineer Location: Central London (Hybrid: 2 days per week onsite.) £600-£700 Outside Company Description: My Client is a leading financial organisation committed to leveraging cutting-edge technology and data-driven insights to empower stakeholders and drive innovation within the industry. As … they continue to expand their data capabilities, they are seeking a skilled Lead Data Engineer to spearhead the development and implementation of their data platform whilst also advising and consulting on legacy data migrations from on-prem to the cloud to increase … carbon neutrality. Role Overview: As a Lead Data Engineer, you will play a pivotal role in designing, building, and maintaining their data infrastructure while collaborating closely with senior stakeholders across the organisation. Your expertise in Azure, Databricks, Spark, Python, and data modelling will be more »

Senior Data Engineer - Azure/Databricks - £75-80,000 Scalexperts are partnered with an education business who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function. They are looking for a Senior Data Engineer to join them to work on building a brand new data platform which is still in early stage development. They are looking to combine all the data into one common data warehouse so that reporting & insight/analytics becomes much clearer … depth knowledge of and experience with Databricks Azure experience ideally worked with tools such as Synapse, Azure Data Factory, Data Lake etc Experience with SQL is a must, some Python is a bonus Experience of working with a number of different data sources more »

this organisation now, all have said glowing reviews about it, they're the leader in legal representation comparison and have rather interesting, unique data to work with. They are using modern Azure tools and have some very exciting initiatives! They are looking for an additional Snr Data Engineer to join a well established team, this could possibly suit a mid weight Data Engineer who has mentored others. Salary is circa 70K with a 5% bonus There is no sponsorship for this role, sorry. Responsibilities: Guiding a team of developers in the creation, optimization … warehouses and data lakes. Familiarity with Azure Cloud Services. Sound understanding of T-SQL programming. Exposure to Azure Data Lake technologies, including ADF, HDFS, and Synapse. Solid knowledge of Data Governance, Data Catalog, and Master Data Management. Understanding more »

Senior Data Engineer Fully Remote or Hybrid Working Up to £70,000 per annum + Bonus An excellent opportunity has arisen for an experienced and engaging Senior Data Engineer, to join a well-known organisation within the legal sector. The successful applicant will join a well … established team as a point of expertise for all data related projects. They will design, build and deploy high quality solutions across company platforms and ensure they meet the required standard. Main duties include: Mentoring a team of developers to effectively create, optimise and maintain automated systems and … role Excellent understanding of Databricks and Pyspark Strong knowledge of Azure Cloud Services Excellent understanding of SQL Good exposure to Azure Data Lake technologies such as ADF, HDFS and Synapse Good knowledge of Data Governance, Data Catalog, Master Data Management Excellent more »

What you’ll do We are looking for a Data Platform Engineer, someone who can deliver operational excellence and stability in our data platforms that underpin the services we deliver for our customers. You’ll be part of the team helping to build strong, collaborative relationships … help define the future of hospitality both in the UK and abroad. Responsibilities will involve:- Implement and maintain secure, scalable, and highly available data platforms within our datacentre and public cloud environments. Build and continually improve tooling, monitoring, and security controls. Own the data platform aspects … d like you to have experience in design, implementation and day-to-day running of enterprise level data platforms, data lake concepts and data handling. We’d also like you to have experience of solid monitoring and tuning skills in highly available transactional more »

Data Analyst/Engineer - £50,000 - £60,000/Carmarthenshire (South Wales) + Hybrid 2 days on-site Are you looking to join an exciting business as they continue their scale-up plans in 2024? This is a fantastic opportunity with a business proud to be expanding in … Wales. This is a great opportunity for a Data Engineer or Data Analyst/BI dev who wants to develop their skills in Data Engineering. If you have a background in creating dashboards in Power BI feel free to apply or reach out for … ll be doing: You’ll be the brain behind developing and putting into action strategies to gather, process, and dissect large sets of data, all aimed at giving clients actionable insights. You’ll focus on crafting and maintaining data pathways to ensure data accuracy more »

Lead Data Engineer - £70k plus benefits - hybrid 2 days in Manchester An exciting opportunity has arisen to join this leading household name, based in Manchester city centre (hybrid). The role will be critical in delivering and ensuring data quality, consistency, and reliability working closely with … other data engineers in the team as well as the analytics team, architecture team and stakeholders. You will be responsible for the development, operation and maintenance of data pipelines to extract, load and transform data sources from both internal and external/third-party … candidate will have led a team or projects and used to working in an Azure environment with a focus on Azure Data Lake, Databricks, Azure Data Factory and Power BI architectures. Working with Python, SQL, Spark and Databricks, you will build, rebuild and maintain data more »

change the status quo, we’ll help you make your moment. Join Team Purple. Join IFS. Job Description As a Principal/Senior Data Engineer, you will spearhead our data initiatives, transforming raw data into strategic assets that propel our business forward. This role … who excel in a dynamic environment, offering the freedom to innovate and the responsibility to deliver. Core Responsibilities: Identify and harness high-value data opportunities within our product suite, converting raw data into impactful features and reusable assets. Act as the authoritative voice on data technology , steering our organization towards cutting-edge platforms and methodologies. Architect and execute comprehensive data projects, ensuring robust scalability and performance from conception to deployment . Collaborate with a team of ML Engineers, Data Scientists, and other key stakeholders to design, implement, and maintain more »

development, implementation, and support of a cutting-edge real-time data platform, which includes data streaming, a data lake, and a blazing fast analytics database. We are looking for someone who is passionate, motivated, driven, and up for the challenge. Strong knowledge of … database design and development with previous experience in developing ETL processes, and multidimensional data models. High understanding of both relational and multidimensional modelling principles. Deep knowledge of Object-Oriented Programming languages and must have a strong experience in Java. Strong experience on data quality standards and … contribution on defining and monitoring data quality metrics and KPIs Key Skills Needed: Flink Beam Kafka Connect Java more »

technology, such as Microsoft’s Blazor Framework, you will be responsible for building various applications using Web APIs and messaging systems. From a data perspective, you will work with SQL Server using T-SQL, and there are currently plans to move to the cloud in the near future … with the following would be beneficial: Devops Automated Testing MS Logic and Power Apps AI + Machine Learning Analytics: Analysis Services, Data Lake Analytics, Data Catalog DevOps: Application Insights TypeScript, NodeJS Blazor KendoUI The Team The IT team is responsible for providing clients and staff more »

fight financial crime, and reduce scams in online payments! The team is very early-stage, and you’d be joining as the Founding Data Engineer, working closely with the Founders who have a previous success story in FinTech. You’ll be taking very high ownership: Designing, building and … maintaining scalable and reliable data storage, processing pipelines, and analytics infrastructure. Apply your expertise in data analysis and model development: conduct experiments and build production-grade, transparent data products that drive impact for the business and our customers. About you; Proficiency with language/… tools for data processing and analytics, such as SQL, Python/Scala, Spark, Airflow, etc Strong understanding of data architectures, data modelling, and designing scalable and fault-tolerant data pipelines and data lakes/warehouses. You’ve worked with cloud more »

Cloud Architect/Data Architect Google Cloud/GCP, Machine Learning/Generative AI Remote-based or Hybrid should you prefer (London) £90k-£120k basic salary + bonus Benefits: 25 days holiday + bank holidays Private Healthcare Discounted Gym Membership (Nuffield + Hussle) Life Insurance, Income Protection, Employee … Assistance Program Pension Scheme (max 10%) We are working with an AI/Data Consultancy with core clients within the Retail, Financial Services, Gaming, SaaS sectors. The successful Cloud Architect will work with an array of technologies with clients from several industries & sectors meaning you will find your … devising innovative solutions to address their needs, defining project parameters, and supervising the execution of these projects. Role of the Cloud Architect/Data Architect: Utilising advanced data processing and cloud technologies effectively to stimulate innovation. Engaging with clients to create top-notch solutions tailored to more »

Cloud Architect/Data Architect Google Cloud/GCP, Machine Learning/Generative AI London Based - New Offices, Refurbed in the Heart of a buzzing area £90k-£120k basic salary + bonus Benefits: 25 days holiday + bank holidays Private Healthcare Discounted Gym Membership (Nuffield + Hussle) Life … Insurance, Income Protection, Employee Assistance Program Pension Scheme (max 10%) We are working with an AI/Data Consultancy with core clients within the Retail, Financial Services, Gaming, SaaS sectors. The successful Cloud Architect will work with an array of technologies with clients from several industries & sectors meaning … devising innovative solutions to address their needs, defining project parameters, and supervising the execution of these projects. Role of the Cloud Architect/Data Architect: Utilising advanced data processing and cloud technologies effectively to stimulate innovation. Engaging with clients to create top-notch solutions tailored to more »

SENIOR DATA ENGINEER (EU Remote Opportunity) Xcede are delighted to be working with a very exciting Web3/Blockchain organisation with a remote working culture. Their company makes life easier for organisations in the Web3 space by providing managed services across a range of operational tasks and responsibilities … in one space. As a Senior Data Engineer in the company, you will have several clear tasks that are essential to the smooth running of processes that make this Product so unique. Responsibilities Design and implement both batch & stream Data Pipelines around the data stores & data lake. Lead by example, always aiming to work towards software engineering best practice and disaster prevention (rather than recovery). Maintain and optimise the infrastructure across the company. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years more »

Senior Data Engineer – Higher Education – 6 Months (Rolling) - London - £522.50 One of the UK’s leading higher education clients now requires a Senior Data Engineer on an initial six-month contract to improve their learning engagement platform. The Data Engineer will be predominantly responsible … for setting up and configuring a new Azure Data Lake. The ideal Data Engineer will have the following skills/experience: Proven Experience working on Azure Data Factory Previously worked with Python and SQL Previously worked with Power BI Interpersonal and Stakeholder Management Skills … position and would require you onsite 1 – 2 day(s) per week onsite at their office in London. If you’re an experienced Data Engineer looking for an exciting new opportunity with a leading Higher Education client, please apply more »

Senior Azure Data Engineer (Consultancy) £70,000-£80,000 salary Hybrid (London) Immediate start One of my long-standing consultancy clients, one of the UK's leading Microsoft Solutions Partners for over 20 years and experts in digital transformation with Azure, have just reached out with an urgent … hire for a Senior Azure Data Engineer to join the team. **This is a permanent position ( no contractors will be considered ), and you must have full right to work in the UK to apply** They have a new project starting in mid-February, so are looking ideally for … interviews next week, and they are looking to have this position filled by next Friday . Essentials: Experience in a consultancy . Azure Data Engineer certification . Experience working with Dynamics 365 Experience with Azure Synapse , Data Factory , Data Lakes 4+ years as a more »

Azure is our main offering, but experience with AWS/GCP is a strong plus! Containerization: Docker and/or Kubernetes Bonus: Big Data processing (BI systems, Data lakes) Excited to learn more? 🤔 Feel free to reach out, and I'll happily share all the details. more »

A global leader in the design, marketing and distribution of premium lifestyle products is seeking a customer data platform product manager, to join their global customer insights team. You will be responsible for leading the development of their customer data platform. The ideal candidate will understand … customer facing businesses, have ROI-driven digital marketing acumen, be data fluent, and play a pivotal role to bridge the gap between business and technical teams. Responsibilities: Bridge the gap between the business and IT; ensure all requirements are documented, understood, and delivered. Own customer data … and EMEA, managing best practice communication and guidelines. Serve as the first point of contact for platform-related questions and support resolution of data issues. Understand consumer privacy regulations like GDPR and work with DPO, legal, engineering, and marketing teams to ensure compliance. Work to define data more »

will include… You will be able to produce a variety of reports focusing on a range of areas, including; Security, Performance, compliance audits, data collected from various IT Systems and tools. Strong ability to maintain and develop technical documentation, including system configurations, network diagrams, operating procedures to support … clients IT Environments. You will be analysing large data-sets to identify trends, patterns and anomalies, and have the ability to extract worthwhile insight to be included in the reports. Be an SME around identifying opportunities where automation report created can be used, using scripting languages and reporting … tools to enhance efficiency and scalability. What you’ve got… Experienced background in Report Writing, Data Analysis, or technical documentation within the IT/Tech industry. Experience on Microsoft office applications! Particularly Excel + Word, for documenting and report writing purposes. Being confident on Azure is a must more »

Data Delivery Lead Location: Hybrid - London Package: Negotiable + Benefits Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them to provide great customer service and grow through the provision of … superior data services. The Data Delivery Lead is responsible for ensuring the successful and timely delivery of data projects and initiatives. You will lead a team of Brown & Brown and third-party data specialists, manage resources, and act as a bridge between … patterns and best practice, including data pipelines delivering projects in the Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL, Azure Cosmos DB, Azure Power Platform, Power BI The rewards: negotiable basic salary and all the normal benefits you’d expect more »