101 to 125 of 142 Data Lake Jobs in the UK excluding London

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

Data Architect Up to £80k West Midlands - Hybrid - twice per week in the office Benefits: Bonus Scheme Hybrid Working Life Assurance Cycle to Work Scheme 25 days holiday, increasing with length of service Employee Assistance Program I am working with a client in the West Midlands … looking for an Enterprise level Data Architect with Databricks experience to join the team. Databricks is an absolute necessity for this role. The architecture has been outsourced up to this point, and is being brought back in house, so you should be experienced enough to take over responsibility ...

Role: Data Analyst Retail Banking Location: Milton Keynes, UK Work Mode: 12 Months FTC Employment JOB DESCRIPTION: Required Qualifications Expertise: Strong history of data analytics experience, heavily focused within UK Retail Banking . Strong understanding of ETL processes. Experience in creating source-to-target mapping documents. … proficiency in Python or R for data manipulation. Cloud Infrastructure: Practical, hands-on experience working in an AWS data lake environment (eg, S3, Athena, Redshift, Glue). Soft Skills: Strong analytical and problem-solving skills with the ability to interpret complex datasets and business rules. ...

Data Architect needed in Lincoln Paying £30.29 per hr ref 376142 Full time hours on a temporary basis Key Responsibilities Data Architecture & Strategy Develop, implement, and maintain the organisation's data architecture strategy. Design scalable data models, data warehouses, data ...

Data Architect Scroll down to find an indepth overview of this job, and what is expected of candidates Make an application by clicking on the Apply button. Up to £80k West Midlands - Hybrid - twice per week in the office Benefits: Bonus Scheme Hybrid Working Life Assurance Cycle … length of service Employee Assistance Program I am working with a client in the West Midlands who are looking for an Enterprise level Data Architect with Databricks experience to join the team. Databricks is an absolute necessity for this role. The architecture has been outsourced up to this ...

Essential Employment in Lincoln is seeking a Data Architect to design and manage the organisation's data architecture. The role focuses on building scalable data models, data warehouses, data lakes, and integration solutions to align with business goals. Responsibilities include … leading data projects, establishing governance and security standards, and guiding data engineers and BI teams. The position is a full-time, temporary role based in Lincoln. #J-18808-Ljbffr ...

seeking 3 experienced SC Cleared Data Engineers with strong expertise in AWS Glue to work for our client in the defence sector. You will support the design, development, and optimisation of cloud-based data integration and analytics solutions. You will play a key role in building … Glue, developing Glue Jobs using PySpark and Python, AWS Glue Data Catalog, Crawlers, Workflows and triggers, Amazon S3 data lake implementation and management, AWS IAM roles, policies and security best practice. You will also need experience with several of the following: Amazon Redshift, AWS Lambda ...

Capital One UK is seeking a Senior Manager Architect in Data to shape the architecture of a cloud-based data ecosystem. You will lead cross-functional teams, influence senior stakeholders, and define standards for distributed data processing, data lakes, and data products. You will collaborate with engineers, data scientists, and governance teams to drive real-time data capabilities, ML/AI readiness, and scalable data platforms across the organization. #J-18808-Ljbffr ...

Anaplan’s forecasting solutions. The team is responsible for the production execution of forecasting and predictive models, the MLOps infrastructure supporting our data scientists, and the data processing services that deliver insights to enterprise customers. This role reports to the Director of Engineering for Predictive Intelligence … models, neural networks, and optimization solvers in production. Familiarity with data orchestration tools (e.g., Prefect, Airflow, dbt) and modern data lake architectures. Experience working closely with data scientists to operationalize research code. Multi‐cloud experience across AWS, GCP, and Azure. Background in forecasting ...

sparkle for millions of Very customers. About the Role You’ll be a hands-on senior engineer at the heart of our data transformation. You won’t just deliver pipelines. You’ll shape how we build them, how we scale them and how we make them better. … work with modern cloud technologies, help evolve our data platform and influence engineering standards across the team. You’ll also support and mentor others, helping create a strong, collaborative engineering culture. The impact is real. Better data means better customer experiences, faster decisions and stronger performance ...

Teams, Co-Pilot, Power Platform (Power Apps, Power Automate, Power BI and Power Virtual Agent) and other MS365 services. Integrate and manage data sources like Dataverse, SharePoint and SQL. Act as the Technical Authority for any new enterprise-wide applications development (e.g. Dynamics 365), configuration and implementation. … SharePoint, Teams and OneDrive. Hierarchical structured data and SQL programming. Azure Integration services, especially Azure API Management. (desirable) Azure Data Lake, Azure Synapse. (desirable) Dynamics 365 (desirable). #J-18808-Ljbffr ...

Scrumconnect Limited in Newcastle upon Tyne is seeking a proactive Azure Data Engineer to design, develop, and support scalable data solutions on Microsoft Azure. You will collaborate with engineering, data, and delivery teams to build reliable cloud data … platforms and pipelines, while applying best practices for automation and source control. The role emphasizes hands-on work with ADF, Synapse, Data Lake, and IaC with Terraform, alongside GitLab for CI/CD, and requires strong data engineering #J-18808-Ljbffr ...

working with BAs and procurement teams, requirements analysis and process improvement. Proficient in Project Management, Agile, Risk management. Awareness of ISO27001 and Data Protection Act. Application Landscape Management Maintain a complete and up-to-date inventory of all applications in use across the business (SaaS, hosted, and internally … driven architectures) Cloud-to-cloud and hybrid integration scenarios Ensure applications are designed to integrate with: Data warehouse/data lake platforms & Reporting and analytics environments Promote best practices in: Data consistency and interoperability API-led integration Reusable integration patterns SharePoint Online Solutions ...

ready to shape the future of data? Matillion is the company behind Maia, the AI Data Automation platform. In the AI economy, demand for data is exploding. Manual data engineering can’t keep up. Maia fixes that by combining 15 years … data expertise with agentic AI to eliminate the manual work that slows data teams down. Organisations like Cisco, DocuSign, and Slack are already using it to deliver real business impact, faster. We started in Manchester and now we’re global - with teams across ...

Teams, Co-Pilot, Power Platform (Power Apps, Power Automate, Power BI and Power Virtual Agent) and other MS365 services. Integrate and manage data sources like Dataverse, SharePoint and SQL. Act as the Technical Authority for any new enterprise-wide applications development (e.g. Dynamics 365), configuration and implementation. … SharePoint, Teams and OneDrive. Hierarchical structured data and SQL programming. Azure Integration services, especially Azure API Management. (desirable) Azure Data Lake, Azure Synapse. (desirable) Dynamics 365 (desirable). ...

capabilities, and fit within existing systems and information architecture. Build scalable feature engineering and data pipelines on Databricks using data lake sources, leveraging Spark/Delta and Databricks workflows/jobs. Required qualifications, capabilities, and skills Formal training or certification in software engineering concepts with … tools such as Git/BitBucket, Jira, ServiceNow, and pre-commit hooks. Strong programming skills in Python and Java, including experience with distributed data processing. Leverage enterprise-authorized AI coding assistant tools to improve code quality and delivery speed (e.g., code generation/refactoring, unit tests, documentation), while ...

connect security telemetry, assets, identities, vulnerabilities, threats, controls, and incidents into a trusted intelligence layer. The role is highly hands-on and combines data science, graph engineering, cybersecurity analytics, semantic modeling, and technical leadership to enable attack-path analysis, threat investigation, exposure prioritization, GraphRAG, and AI-assisted security … graph ingestion and transformation pipelines for SIEM, EDR/XDR, IAM/PAM, CMDB, vulnerability scanners, cloud security platforms, threat intelligence feeds, security data lakes, and case-management systems. Develop entity extraction, identity resolution, deduplication, schema mapping, relationship inference, confidence scoring, temporal modeling, and graph enrichment capabilities. Model ...

engineer who enjoys building production-grade applications, Back End services, APIs, developer tooling, and automation solutions that support enterprise-scale cyber security and data platforms. This is a software engineering-focused position with significant hands‐on development responsibilities. It is not a traditional infrastructure, DevOps, or platform engineering … supporting production environments. Desirable Skills Experience with Kong API Gateway. Exposure to Cyber Security engineering environments. Knowledge of Databricks, Spark, or Data Lake technologies. Experience supporting Data Engineering platforms. Understanding of API security concepts including OAuth2, JWT, and mTLS. Knowledge of Site Reliability Engineering ...

building APIs/microservices with Azure tools (Functions, APIM, Web Apps). Knowledge of Azure data services (SQL, Storage, Data Lake, Cosmos DB). Track record of leading development and mentoring others. Strong communication skills, able to engage both technical and non-technical stakeholders. Experience ...

building APIs/microservices with Azure tools (Functions, APIM, Web Apps). Knowledge of Azure data services (SQL, Storage, Data Lake, Cosmos DB). Track record of leading development and mentoring others. Strong communication skills, able to engage both technical and non-technical stakeholders. Experience ...

Join our team and youll be responsible for providing technical leadership for our Data Platform team, defining technical direction and driving architectural decisions across data, platform and infrastructure domains. Working in the Data Platform department you will build scalable, reliable and well-governed data … reimagine the labour market to make it work for everybody. Your responsibilities Define and evolve the technical vision, roadmap and architecture of the Data Platform, driving decisions across data, platform and infrastructure domains Establish engineering standards, best practices and reusable patterns while partnering with Enterprise Architecture ...

Working within the Impact and Improvement Team, you will be responsible for championing data- driven decision making. You will analyse and report on risk and performance across large and complex datasets, translating this into actionable insights to inform strategic decision making. 37 hours per week/permanent/… build real connections – guide us in all our actions. Working within the Impact and Improvement Team, you will be responsible for championing data- driven decision making. You will analyse and report on risk and performance across large and complex datasets, translating this into actionable insights to inform strategic ...

Active Directory, Azure DNS, Traffic Manager, Azure Web Apps, Azure API Apps, Azure ARM, Azure Service Fabric, Azure Container Service, Azure Data Lake Storage, Azure Functions, Azure Logic Apps. Building and maintaining tools, solutions and microservices associated with deployment and operations platform, ensuring that all meet ...

Scott Logic is a UK data engineering partner delivering bespoke software and data platforms. You will design and implement data pipelines, build data lakes/warehouses, and transform datasets for analytics, ML, and reporting. You’ll work hands-on with modern tools ...

sales expertise to deliver end-to-end solutions—from data acquisition and SCADA integration to enterprise-level analytics and data lake architectures. Responsibilities: Position Schneider Electric GeoSCADA as the core supervisory control solution for water, wastewater, and utility networks as well as other suitable applications. … understand operational challenges and translate them into software-driven solutions. Deliver compelling presentations and workshops showcasing the value of integrated automation and data-driven insights. Design software architectures to integrate with AVEVA software, and enable seamless data flow from device layer through to enterprise systems. Ensure ...