251 to 275 of 328 Data Lake Jobs in the UK

will be initially 6 months but likely to extend paying £525 per day In order to be considered for this role you will need to have - Experience with data … management and data architectures (SQL/NoSQL), database systems, modern data warehouse platforms (Snowflake, Databricks, BigQuery), ETL/ELT pipeline development, and data lake/warehouse implementations for integrating structured and unstructured laboratory and sequencing data sources. Master Full-Stack technologies, such as Python, JavaScript/TypeScript, Cloud(preferably AWS), SQL More ❯

will be initially 6 months but likely to extend paying £525 per day In order to be considered for this role you will need to have - • Experience with data … management and data architectures (SQL/NoSQL), database systems, modern data warehouse platforms (Snowflake, Databricks, BigQuery), ETL/ELT pipeline development, and data lake/warehouse implementations for integrating structured and unstructured laboratory and sequencing data sources. • Master Full-Stack technologies, such as Python, JavaScript/TypeScript, Cloud (preferably AWS), SQL More ❯

This forward-looking company are applying data science to deliver positive results for people with a view to the low carbon future. With an abundance of data collected, and technology in place, they are seeking a lead engineer with the analytical capabilities of a data scientist and the technical grounding of a data engineer. Initially you will take the lead on delivering answers to vital data-driven questions posed by stakeholders, using your own capability along with mastering and refining their data platform. As time progresses, you will take responsibility for hiring and career development for a team you will lead. Autonomy and responsibility will be key … as you drive the technical development of their services. You will have: Data science experience, including use of Python, databases, data cleaning, statistical methods and potentially machine learning techniques, along with the likes of PowerBI, Tableau and data visualisation tools in general. Experience creating and managing data pipelines, working with and developing More ❯

At Gorilla , we're building the data infrastructure that powers energy companies on their journey to net-zero. As a Lead/Staff Data Platform Engineer, you'll play a key role in defining and scaling our data platform to meet the increasing complexity and volume of data-driven use cases in … designing the architecture, improving the developer experience, and guiding our platform strategy with a strong focus on performance, security, and scalability. Your Role SaaS experience in high-load, data-intensive environments. Lead the technical vision and strategy of our internal data platform, influencing architectural decisions and establishing best practices across the engineering organization. Design, implement, and … infrastructure, monitoring key systems, and leading incident response and root cause analysis for platform-related issues. Evaluate and introduce new technologies and practices (e.g., container orchestration, data lake solutions, workflow orchestration tools) based on evolving business needs. What You'll Need Proven experience designing, building, and scaling data platforms or backend infrastructure in production environments. More ❯

JOB TITLE: Data Engineering Manager SALARY: £70,929 - £78,810 LOCATION: Edinburgh HOURS: Full time WORKING PATTERN: Hybrid, 40% (or two days) in our Edinburgh office. About this opportunity As a Data Engineer within the 'General Insurance' (GI) platform, you'll be responsible for leading and motivating a multi-disciplinary team of Data Engineers … programme. About us We're on an exciting journey and there couldn't be a better time to join us. The investments we're making in our people, data, and technology are leading to innovative projects, fresh possibilities, and countless new ways for our people to work, learn, and thrive. What you'll need Validated expertise in delivering … Coding/scripting experience developed in a commercial/industry setting (Python, Java, Scala or Go and SQL) Strong experience working with Kafka technologies Working experience with operational data stores, data warehouse, big-data technologies, and data lakes Experience working with relational and non-relational databases to build data solutions More ❯

daily to our panel of over 24 million registered members to understand opinion and behaviors around the world. We have a strong reputation as a source of accurate data and we're trusted by the world's biggest brands to get it right, making us the most quoted market research source in the world. With operations in the … India and Asia Pacific, YouGov has one of the world's largest research networks. About Brandindex BrandIndex is YouGov's flagship brand intelligence platform that transforms consumer survey data into insights for businesses: it monitors thousands of brands globally to deliver a comprehensive view of brand health. Through continuous data collection and analysis, BrandIndex enables customers … and MySQL Exposure to Docker, Kubernetes, AWS, Helm, Terraform, Vault, Grafana, ELK Stack, New Relic Relevant experience in the maintenance of data APIs and data lake architectures, including experience with Apache Iceberg, Trino/Presto, Clickhouse, Snowflake, BigQuery. Master's degree in Computer Science or Engineering-related field Get to know us better YouGov is More ❯

Hypercube Consulting is a rapidly growing data and AI consultancy dedicated to transforming the energy sector through cutting-edge technology. Specialising in advanced AI systems, including Agentic AI workflows and large language models (LLMs), we help clients unlock profound value from their data assets. Join our expert team in shaping the future of AI-driven energy … here: We are looking for a Senior AI Engineer with experience in Agentic AI and LLM technologies to design and develop impactful AI solutions. You'll work alongside data engineers, data scientists, and cloud specialists, directly contributing to client success. In this role, you will: Engage with client challenges, developing practical and innovative Agentic AI and … AI expertise. Key responsibilities Technical contribution Develop and deploy reliable AI and LLM solutions, collaborating with senior team members. Contribute to the implementation and maintenance of AI pipelines (data ingestion, model training, deployment, and monitoring). Work within multidisciplinary teams to deliver client-focused solutions. Effectively communicate AI concepts and methodologies to peers and clients. Continuous learning & development More ❯

Data Engineer, Commodities £135,000 Basic + Extensive Benefits, London My Commodities Trading Client are looking for a Data Engineer to join the trade surveillance team, develop ingestion pipelines and frameworks to support strategic decision making. The team has recently built a new data lake house and ingestion infrastructure. It is entering a phase of hardening and re-engineering to enhance the speed, ease, and quality of ingestion across the portfolio. Key Requirements: Strong … proficiency in Python and PySpark Successful track history in a Data Engineering role including Database Management (ideally SQL), Data Orchestration (ideally Apache Airflow or Dagster), Containerisation (ideally Kubernetes and Docker) .Data Pipelines (big data technologies and architectures) Experience in Financial Services (ideally Commodity) Trading. Bachelor's degree in Information Systems, Computer Science, Engineering, or More ❯

Data Engineer, Commodities £135,000 Basic + Extensive Benefits, London My Commodities Trading Client are looking for a Data Engineer to join the trade surveillance team, develop ingestion pipelines and frameworks to support strategic decision making. The team has recently built a new data lake house and ingestion infrastructure. It is entering a phase of hardening and re-engineering to enhance the speed, ease, and quality of ingestion across the portfolio. Key Requirements: Strong … proficiency in Python and PySpark Successful track history in a Data Engineering role including Database Management (ideally SQL), Data Orchestration (ideally Apache Airflow or Dagster), Containerisation (ideally Kubernetes and Docker) .Data Pipelines (big data technologies and architectures) Experience in Financial Services (ideally Commodity) Trading. Bachelor's degree in Information Systems, Computer Science, Engineering, or More ❯

and modern web frameworks (React/Angular/TypeScript) Experience with data engineering, ETL/ELT pipelines, Azure services (Data Factory, Synapse, Data Lake), CI/CD, and DevOps practices Ability to communicate complex concepts clearly to both technical and business stakeholders Collaborative mindset with a track record of building trust and driving More ❯

Data Analyst - PowerBI Developer and MS Fabric Specialist Data Analyst - PowerBI Developer and MS Fabric Specialist Europe United Kingdom Full time Permanent Share Data Analyst - PowerBI Developer and MS Fabric Specialist Aberdeen We are currently recruiting for a talented PowerBI Developer and MS Fabric Specialist to support the delivery of digital data … Solid understanding of Power BI, DAX, Power Query and data modelling best practices Solid understanding of Power BI security models Demonstratable experience with Azure Data Lake, Synapse and MS Fabric Minimum 4 years hands on experience delivering Power BI solutions working across all ecosystems, dataflows, dashboards, performance tuning Proven experience supporting digital system or software … implementation, we drive efficiency and improvement and reduce risk, and help established, and emerging businesses achieve their goals. The Core29 BI Team develop reporting solutions to cultivate a data-oriented culture within an organisation and empower business decision-making at all levels based on quantifiable fact. More ❯

Involvement in school improvement initiatives. Familiarity with school/trust Financial Management Systems (FMS). Knowledge of school/trust budget planning. Ability to manage a data lake, including data ingestion, storage, governance, and integration with analytics tools. Advanced proficiency in Microsoft Office suite. Strong customer relationship management skills. Skilled in technical writing. Competence in More ❯

Social network you want to login/join with: Our Data Services Team offers a variety of data products with a strong focus on engineering, including data science and data analytics, to help our business users, mainly trading teams, make data-driven decisions and improve their business operations. At Macquarie … ll be part of a friendly and supportive team where everyone-no matter what role-contributes ideas and drives our success. What role will you play? As a Data Platform Engineer, you will join our dynamic Engineering team developing cutting-edge data product solutions. You will build and maintain applications ranging from cloud infrastructure automation, APIs … and Engineering background Proficient in writing infrastructure as code for public cloud Experience with Python coding/testing or any Cloud-based technology (AWS preferred) Good understanding of Data Observability Good understanding of Hosting Platform Linux/Unix (EKS and Container experience is a plus) Good understanding of Databases, Data Lakes, and Query Engines, SQL/ More ❯

Contract Data Project Manager - Housing Sector Advantage Location: Hybrid (details on request) Contract Length: 3 months Start Date: ASAP Day Rate: Competitive (Outside IR35) We're recruiting on behalf of a client for an experienced Data Project Manager to join on a 3-month contract , starting as soon as possible. This is a hands-on role … where you'll work closely with both technical and non-technical teams to drive the successful delivery of a data-focused programme of work. What you'll bring: Strong background in data projects, with the ability to confidently discuss technical concepts with a wide range of stakeholders Proficiency in Microsoft Project, with a proven ability to … plans with clear milestones and outcomes Experience managing dependencies and identifying resource requirements across complex workstreams Confident producing concise progress reports for stakeholders at all levels Understanding of Data Architecture, including concepts like Data Lakes, Data Warehouses, and data extraction/transformation/migration workflows Excellent communication skills - able to bridge the More ❯

Contract Data Project Manager - Housing Sector Advantage Location: Hybrid (details on request) Contract Length: 3 months Start Date: ASAP Day Rate: Competitive (Outside IR35) We're recruiting on behalf of a client for an experienced Data Project Manager to join on a 3-month contract , starting as soon as possible. This is a hands-on role … where you'll work closely with both technical and non-technical teams to drive the successful delivery of a data-focused programme of work. What you'll bring: Strong background in data projects, with the ability to confidently discuss technical concepts with a wide range of stakeholders Proficiency in Microsoft Project, with a proven ability to … plans with clear milestones and outcomes Experience managing dependencies and identifying resource requirements across complex workstreams Confident producing concise progress reports for stakeholders at all levels Understanding of Data Architecture, including concepts like Data Lakes, Data Warehouses, and data extraction/transformation/migration workflows Excellent communication skills - able to bridge the More ❯

Contract Data Project Manager - Housing Sector Advantage Location: Hybrid (details on request) Contract Length: 3 months Start Date: ASAP Day Rate: Competitive (Outside IR35) We're recruiting on behalf of a client for an experienced Data Project Manager to join on a 3-month contract , starting as soon as possible. This is a hands-on role … where you'll work closely with both technical and non-technical teams to drive the successful delivery of a data-focused programme of work. What you'll bring: Strong background in data projects, with the ability to confidently discuss technical concepts with a wide range of stakeholders Proficiency in Microsoft Project, with a proven ability to … plans with clear milestones and outcomes Experience managing dependencies and identifying resource requirements across complex workstreams Confident producing concise progress reports for stakeholders at all levels Understanding of Data Architecture, including concepts like Data Lakes, Data Warehouses, and data extraction/transformation/migration workflows Excellent communication skills - able to bridge the More ❯

SNG's ambitious Corporate Plan identifies the important role that data, digital and technology plays in our future success. SNG's CIO function will enable us to leverage the investments we have already made and embrace new technology frontiers to create a modern, digitally connected business; one that delivers maximum impact and value for our customers and people. … Collaborating with Data and Analytics colleagues to maximise SNG's investment in the Microsoft product stack, in particular Azure Data Factory and Data Lake Maintaining Integration code repositories within Azure DevOps Troubleshooting integration issues, using the required tooling, and debugging processes to diagnose and resolve. What you'll need You should have previous … and maintaining Integration services. You'll also need: Experience with Workday integration tooling (Studio, EIB, API) Proven experience working with large, complex datasets, covering structured, unstructured, semi structured data Clear communication skills with the ability to build strong relationships with stakeholders at all levels Desirable Experience with Cloud-based integration services (Data Factory, Functions, Logic Apps More ❯

Data Engineers ?? Cambridge/Hybrid 2x per week onsite | ?? £60,000£75,000 | ?? SC or DV Clearance Required Were working with a specialist technology consultancy delivering cutting-edge solutions into the UKs most secure government environments. Due to continued growth, theyre looking for a talented Data Engineer to join their secure data team and … help solve complex, high-impact challenges. The role Youll design and develop secure data pipelines and platforms, working on projects that process sensitive, mission-critical information. This is an opportunity to apply your technical skills in an environment where your work has a direct impact on national security. What youll be doing: Build and optimise scalable data … workflows and processes What were looking for: 5+ years of experience in data engineering or related roles Proficiency in Python, Java, Golang, Spark, Azure, Synapse Analytics, SQL, Datalake Technology, PySpark, Python, Azure Functions, Azure Data Factory Nice to have: Scala. Familiarity with Kepler geospatial visualisation tool, or other similar tools, and experience working with geospatial data More ❯

multi-account Organization. This should include: • Networking and DNS components, Compute, Storage and Backup platforms, Logging, Messaging, and Alerting services, Organisational account management platforms, Serverless platforms, Data Lake/Lake House platforms, services & architecture, IAM roles and policies, Security and audit tools and practices • Experience with implementing complex Terraform IaC and multi-branch CI/CD More ❯

This is an exciting opportunity for a Senior Data Engineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector … transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior Data Engineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior Data Engineer will be responsible for, but not limited to: Design and maintain More ❯

This is an exciting opportunity for a Senior Data Engineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector … transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior Data Engineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior Data Engineer will be responsible for, but not limited to: Design and maintain More ❯

Reviews and health checks Mentor junior consultants Build strong customer relationships Support managed services as required Essential Requirements 3+ years consulting/managed services experience Solid Data Lake experience with AWS data solutions (Redshift, Glue, Athena, Lake Formation) Advanced AWS skills (EC2, S3, VPC, IAM, Lambda) Infrastructure as Code experience (CloudFormation/Terraform) AWS More ❯

Reviews and health checks Mentor junior consultants Build strong customer relationships Support managed services as required Essential Requirements 3+ years consulting/managed services experience Solid Data Lake experience with AWS data solutions (Redshift, Glue, Athena, Lake Formation) Advanced AWS skills (EC2, S3, VPC, IAM, Lambda) Infrastructure as Code experience (CloudFormation/Terraform) AWS More ❯

As the Data Platform Lead , your mission is to orchestrate data infrastructure that is resilient, scalable, and agile. You'll lead the design, implementation, and optimisation of data platforms-including databases, data lakes, and cloud-based solutions. Your responsibilities will span data technologies, security, and performance tuning. Working collaboratively with … cross-functional teams, you'll drive innovation and streamline data workflows. Your impact will be felt across the wider business environment, enabling efficient data utilisation and informed decision-making. This role plays a pivotal part in shaping the data ecosystem, fostering collaboration, and unlocking the full potential of data-driven initiatives. What … your function is adequately resourced through capacity plans aligned to business demand, leveraging as appropriate external vendors to offer capacity and capability Drive cross functional alignment both within Data and Digital and the wider IS&D functions Lead the design, development, and implementation of an enterprise-wide data platform strategy Develop and own the operating model More ❯

and innovation. You will also foster close working relationships with Microsoft on current and emerging new product features. Main responsibilities: Design customer-centric solutions considering all systems and data impacts, with a strong focus on standardisation and to minimise customisations Conduct Fit/Gap Analysis and identify technical solutions for gaps ensuring design consistency cross domain across Finance … will bring: Proven experience designing and implementing technical architectures for Dynamics 365 F&O solutions. Familiarity with enterprise architecture frameworks is a plus Experience in working with Common Data Services (Dual Write) for integration with Dynamics 365 for sales and Field services Solid experience with integrating Dynamics 365 F&O with other systems using tools such as Data … scale enterprise implementations Strong client leadership and engagement skills up to C-level Knowledge of emerging Microsoft technologies; Azure Cloud Platform, Power Bi, PowerApps, Flow, Azure Data Lake, DevOps, RSAT Intellectual curiosity, especially around emerging enterprise technologies Requirements Microsoft Dynamics 365 F&O certifications (e.g., Dynamics 365 Finance and Operations Core, Dynamics 365 Finance, Dynamics 365 Supply More ❯