11 of 11 Data Lake Jobs in the North East

Bronze layer, working in partnership with the Development and Application Management team. Design and optimise ETL/ELT pipeline frameworks using Databricks, Delta Lake and Azure Data Factory. Ensure Silver and Gold layer data products are fit for purpose for analytics, pricing … ensuring compliance with industry standards. Deep expertise in data modelling — conceptual, logical and physical. Data warehousing and data lake architecture for high‐performance analytics. ETL/ELT pipeline development and optimisation to support large‐scale data processing. Data integration ...

wider technology and business teams to ensure goals and visions are aligned and achieved Help with setting up the data warehousing and lake processes, including collaborating with their architecture teams to figure out what that will look like At times, guide and mentor the junior data … with setting up and using big data storage solutions, including data warehouses, data lakes or data lake houses Able to build and demonstrate a solid understanding of the concepts of real time data streaming, batch data processing ...

Company NW Tech are delighted to be working with a rapidly expanding professional services organisation in their search for a Data Engineer. The Role Key responsibilities include: Design, build and maintain scalable data pipelines to ingest, process and transform structured and unstructured data from … using industry-standard tools and cloud technologies. Knowledge of data engineering concepts, data pipeline development, ETL processes, data lake and data warehousing technologies. Proficiency in working with at least one major cloud data platform Proficiency in Python for data ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. We operate as small teams delivering fast value, blending deep ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

plus 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. Are you ready to shape how data architecture works at scale across services used by millions of people every day? As a Lead Technical Architect, you'll join our Data & Analytics … function in DWP Digital - the team responsible for designing, delivering and evolving the platforms and services that unlock the value of data across the organisation. We're undergoing significant transformation, moving towards cloud-native data solutions while managing highly sensitive data, complex integrations ...

efficient, resilient, and secure. As an AI-forward enterprise , we are constantly pushing the envelope, leveraging the world’s largest security data lake to power our cloud-native Zero Trust Exchange platform. This innovation protects our customers from cyberattacks and data loss by securely connecting … metropolitan areas such as Amsterdam or Frankfurt, reporting to the Sr. Director WW Field PM for DSPM. As a key member of the Data Security Product Organization within the DSPM Field PM team, you will drive the technical and commercial success of our DSPM solutions across the EMEA ...

efficient, resilient, and secure. As an AI-forward enterprise , we are constantly pushing the envelope, leveraging the world’s largest security data lake to power our cloud-native Zero Trust Exchange platform. This innovation protects our customers from cyberattacks and data loss by securely connecting … metropolitan areas such as Amsterdam or Frankfurt, reporting to the Sr. Director WW Field PM for DSPM. As a key member of the Data Security Product Organization within the DSPM Field PM team, you will drive the technical and commercial success of our DSPM solutions across the EMEA ...

Remote) UK Job Description Your role: As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming … distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) · Strong proficiency in Java, Python, or Scala · Solid understanding of event-driven architecture and data streaming patterns · Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure · Familiarity with Docker, Kubernetes, and CI/CD pipelines · Excellent problem ...

About the role: The global economy runs on physical operations, yet the data that powers them remains fragmented and slow. We are building the system of record that connects vehicles, equipment, and sites, creating a central nervous system for the industries that power our world. You will architect … ecosystem that allows our customers and partners to build the next generation of solutions for transport, construction, and utilities, powered by Samsara's data and AI. This is a remote position open to candidates residing in Poland or the United Kingdom. Key Responsibilities: Architect the data ...

About the role: The global economy runs on physical operations, yet the data that powers them remains fragmented and slow. We are building the system of record that connects vehicles, equipment, and sites, creating a central nervous system for the industries that power our world. You will architect … ecosystem that allows our customers and partners to build the next generation of solutions for transport, construction, and utilities, powered by Samsara's data and AI. This is a remote position open to candidates residing in Poland or the United Kingdom. Key Responsibilities: Architect the data ...