151 to 175 of 498 Data Lake Jobs

Lead Data Engineer Department: Technology Employment Type: Permanent Location: Any UK Office Hub (Bristol/London/Manchester/Swansea) Compensation: £80,000 - £96,000/year Description As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping … public sector organisations become truly data-lead by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. Combining cloud engineering knowledge ...

Create scalable data solutions on AWS leveraging S3, Glue, Lambda, and related services. Integrate & Automate: Implement ETL processes and data lake/lakehouse architectures that ensure accuracy and reliability. Collaborate & Advise: Partner with technical and business stakeholders to translate requirements into effective data … preferred). Experience with AWS cloud services including S3, Glue, Lambda, IAM. Familiarity with ETL design, data modelling, and data lake/lakehouse concepts. Understanding of data governance and compliance frameworks. Experience in the healthcare sector or knowledge of NHS data ...

constantly evolving needs of our clients across a wide range of markets on a global scale. If you’re an experienced and talented data engineer who pushes the boundaries and enjoys an exciting and fast paced agile environment, we can offer you the chance to continue to grow … environment, and competitive reward package. About you Technical Skills Azure Data Factory (ADF) Azure Databricks Azure Synapse Analytics Azure Data Lake Storage (ADLS) Azure SQL Database and SQL Server Microsoft Fabric (preferred) Advanced SQL development and performance tuning skills Experience with Python, PySpark, or Scala ...

Data Engineer will work as part of a small but wide-ranging Data team, building and supporting RDT’s data offerings and collaborating closely with the wider Software Engineering, Platform Engineering, QA and Release teams. The Data team at RDT works across … complex stored procedures, relational database design, indexing Knowledge of Azure/cloud data technologies like Data Factory, Data Lake, Synapse, Microsoft Fabric ETL/ELT design and development Power BI modelling and development, awareness/experience of shaping and consuming data ...

team. This role is an exciting opportunity to build Xelix's data platform from the start: the pipelines, data lake and Snowflake warehouse that become the company's single source of truth, built AI-native so a small team delivers in weeks what used … doing Build and run ingestion from our platform databases and business tools (HubSpot, Xero, Intercom, Gong and more) into our data lake and Snowflake warehouse, with a first version of the priority sources live within your first six weeks Work AI-native from day one: AI coding ...

full supply chain from instrument and edge ingestion, through modelling and governance, to exposure for AI, workflow, analytics and customer data lake consumers. You will drive a critical transformation: moving IDBS from a traditional electronic lab notebook capture tool to an enterprise Data Product Provider. … modern lakehouse architecture, including medallion data tiers, transactional storage engines and change data capture patterns (for example Databricks and Delta Lake). Strong grasp of scientific data modelling, including unstructured to structured transformation, data contracts, schema evolution, ontologies and provenance standards ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business … technology teams Essential Experience Proven Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management principles Hands-on SQL experience Experience designing modern data platforms and cloud-based solutions ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business … technology teams Essential Experience Proven Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management principles Hands-on SQL experience Experience designing modern data platforms and cloud-based solutions ...

seeking a Director, Solution Consulting specialising in Marketing Cloud and Data 360. You will be a recognised expert and thought leader in customer engagement and data architecture. You will act as a strategic advisor to our largest, most complex enterprise customers. You will guide them through … handling. Integration architecture: Marketing Cloud Connect, REST/SOAP APIs, API-triggered and event-driven messaging, and ETL/data lake patterns. Data modelling, MDM, SQL, and DevOps/deployment lifecycle. Email deliverability: sender reputation, IP warm-up, and SPF/DKIM/ ...

migration of existing data processes to the new Data Analytics Cloud Platform, building knowledge of Data Lake, Databricks, Unity Catalog and related cloud services. Develop, maintain and optimise Databricks notebooks, SQL processes, data pipelines and transformation logic, ensuring solutions are scalable … experience transforming, modelling and optimising large and sophisticated datasets. Experience working with modern cloud data platforms such as Databricks, Data Lake, and related Azure services. Python experience is beneficial. Experience of automating processes, improving efficiency and implementing scalable analytics solutions. Experience owning and supporting enterprise ...

Role You'll own the data lake — the system of record for millions of financial events a day across million of active users. You decide how that data lands, is stored, retained, and governed on S3 + Snowflake/Databricks, so analytics, finance, and regulators … compute spend. What we're looking for 3+ years in data engineering, with real ownership of a large-scale data lake or lakehouse. Cloud object storage (S3/GCS) plus Snowflake, Databricks, or BigQuery in production. Hands-on with an open table format (Iceberg, Delta ...

Platform. From an MSB perspective the role will require the design, development, support and deployment of the AeroConnect Platform to provide connectivity and data analytic solutions for the manufacturing environments. This will focus on the integration of the latest manufacturing technologies both at the production sites and research … analysis. • Implement and manage data lakes, data warehouses, and other data storage solutions, including SQL and Cloud Lake solutions. Data Security & Compliance • Implement and enforce best architectural practices for data security, ensuring compliance with relevant data regulations ...

exciting opportunity has arisen for a Senior Data Engineer to join a growing data team and contribute to the development of a modern cloud-based data platform. You'll be responsible for developing scalable data pipelines, integrating multiple data sources … processes Strong communication and stakeholder engagement skills Desirable Skills Azure Data Factory Databricks Synapse Analytics Microsoft Fabric Azure SQL Data Lake technologies Experience within regulated sectors Cloud-based data platform experience ...

governance, andoperational performance in a high-volume data environment. This role involvesstrategic and technical leadership in building Azure-based data lake solutions,driving maturity in data management, and engaging with cross-functional teamsto leverage data for organizational success. Key Responsibilities Architect … discipline. 15-17 years of experience in the ITindustry with expertise in delivering cost-effective cloud-based dataanalytics solutions. Proven track record in building datalake architectures and optimizing performance in big data environments. Certification in Azure DataEngineering or Databricks preferred. Strong knowledge of Azuretechnologies, including ADF, ADLS, Databricks ...

Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly with clients to understand requirements and deliver robust data solutions. Troubleshoot … with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills and experience ...

Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly with clients to understand requirements and deliver robust data solutions. Troubleshoot … with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills and experience ...

future of AI, and you are the future of Salesforce. We are seeking a Director, Solution Consulting specialising in Marketing Cloud and Data 360. You will be a recognised expert and thought leader in customer engagement and data architecture. You will act as a strategic advisor … handling. Integration architecture: Marketing Cloud Connect, REST/SOAP APIs, API-triggered and event-driven messaging, and ETL/data lake patterns. Data modelling, MDM, SQL, and DevOps/deployment lifecycle. Email deliverability: sender reputation, IP warm-up, and SPF/DKIM/ ...

want to know about the requirements for this role, read on for all the relevant information. Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business and technology teams Essential Experience Proven Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management ...

Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly with clients to understand requirements and deliver robust data solutions. Troubleshoot … with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills and experience ...

Senior Data Engineer Location : Bolton Salary : Circa £55,000 depending on experience Working Pattern: Hybrid working 2 days per week onsite An exciting opportunity has become available for a Senior Data Engineer to join a leading defence engineering organisation, helping to develop and deliver advanced data solutions across a wide range of business and engineering functions. This role offers the opportunity to transform complex data from engineering systems, simulations, manufacturing operations and business platforms into reliable, accessible and valuable insights. You'll play a key role in designing scalable data ...

Role Description The Technical Analyst – Data Lineage will support a Data Governance, Controls, and Reporting program for a top-tier banking client. Responsible for establishing and validating end-to-end lineage across critical datasets used in operational and regulatory reporting. Translate governance and reporting requirements into … actionable lineage deliverables (source-to-target mapping, lineage diagrams, metadata standards, and audit evidence). Work with Data Platform, Data Engineering, Architecture, Risk, Compliance, and Security teams to define lineage standards, metadata capture, and control points. Maintain lineage artifacts for Critical Data Elements (CDEs ...

Senior Data Engineer Who we are We are an advanced data and business consultancy headquartered in Edinburgh, UK. We are a practitioner-led organisation that collaborates with top consumer brands to drive transformation and foster customer-centricity through our expertise in customer strategy, innovative design … advanced data science and engineering. We work with leading consumer brands to tackle and overcome complex business and customer problems to drive transformation and champion customer-centric agendas. We are proud to include some of the leading UK and global brands among our current clients such as Lloyds ...

Azure Data Engineer | £450 | Outside IR35 | 6 Months Initial | Fully Remote I'm working with a client looking for a Senior Data Engineer to help build and enhance a modern Azure-based data platform. We're keen to speak with engineers who have experience … pipelines within Azure Strong Python development skills for data engineering Azure Data Factory, Azure SQL and Data Lake technologies Data architecture and layered data platform design Metadata-led ingestion and reusable ETL frameworks CI/CD, source control ...

Macquarie, our Data Services Team drives innovation by delivering a diverse suite of data products that empower data-driven decision-making and enhance operational efficiency. With a strong focus on engineering, data science, and analytics, the team delivers innovative solutions that empower … scale data platform powered by modern cloud technologies. In this role, you will manage and enhance a petabyte-scale Data Lake and will create secure, efficient, and scalable environments for our data platforms. You will leverage cloud-native technologies and AWS tools such ...

About the role We are seeking a Process Mining Technical Analyst to provide technical support throughout process mining projects. The role focuses on data preparation, event-log development, process mining configuration, data validation, troubleshooting, and analytical support. The successful candidate must understand process and material flows … particularly within warehouse, transportation, manufacturing, or supply chain environments. They will work closely with process mining consultants, data engineers, project managers, and client teams to ensure that the required data, process logic, KPIs, and dashboards are correctly developed and validated. The role may contribute to identifying ...