1 to 25 of 54 Data Lake Jobs in the North of England

self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. More ❯

to transform care delivery worldwide, ensuring every patient receives the safest, highest-quality care. Through our innovative Healthcare Operations Platform, we're connecting data to unlock trusted insights that enable improved decision-making and help deliver safer healthcare for all. At RLDatix were making healthcare safer, together. Our … efficient ETL (Extract, Transform, Load) data pipelines to integrate data from multiple sources into centralized repositories. Developing data lake solutions based on the medallion architecture (Bronze, Silver, Gold) to ensure structured data processing. Implementing data governance and security policies … within the data lake to maintain compliance and data integrity. Automating data pipeline execution and monitoring to enhance efficiency and reduce manual intervention. Developing and maintaining Python scripts for data processing, automation, and integration to streamline workflows. Monitoring and troubleshooting data More ❯

for our clients and helping them to reach for and realise their vision. Azure and Databricks Architect Slalom is seeking an experienced Azure Data Architect to contribute to its growing Data Capability. The ideal candidate is a professional with experience in designing, developing, validating, and … communicating enterprise data solutions using Azure and Databricks. Deep experience in developing enterprise data management strategies, including data lake/warehouse implementations, data movement, data services, data acquisition, data conversion, and archive/recovery. Experience … advise clients on reference architectures Design and develop scalable Databricks solutions on both Azure and AWS environments Lead the architecture and deployment of data solutions using Databricks Requirements: Expert in capturing end-user requirements and aligning technical solutions to the business objectives Experience in leading, designing, and implementing More ❯

Job Overview: We are seeking an experienced and dynamic Project Manager to lead the modernization of our data platform to SAP Data Sphere. This role is responsible for overseeing the end-to-end execution of the project, including planning, execution, and delivery-ensuring that the project … and technological requirements. The Project Manager will work closely with technical teams, business stakeholders, and external partners to drive the transformation from legacy data systems to a cloud-based SAP Data Sphere environment. Key Responsibilities: Develop detailed project plans, timelines, and resource allocation for the SAP … Data Sphere modernization project. Define project scope, goals, and deliverables that support business objectives in collaboration with senior management and stakeholders. Collaborate with internal stakeholders (business units, IT teams) and external partners (vendors, consultants) to ensure alignment of project goals and technical requirements. Conduct regular project meetings, updates More ❯

this is done on a rota basis. Job Purpose The BI Lead will be responsible for shaping and maintaining the Enterprise BI and Data warehouse estate. You'll be working with both on-prem and cloud technologies, predominantly focussed on the Microsoft stack (SQL/Azure SQL databases … Data Factory, Synapse, Power BI, Power Platform) You will play a critical role in designing, developing, implementing and maintaining robust data solutions on the Azure and Power BI platforms. You will collaborate closely with cross-functional teams to gather requirements, understand business objectives, and translate them … including performance, pastoral, training and coaching Technical Skills: Strong experience of Azure services such as Azure Data Factory, Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics, Logic Apps Strong SQL programming skills Strong experience with Power BI data modelling and More ❯

Role: Data Lead Location: Knutsford Contract Role Job Description: AWS Services: Glue, Lambda, IAM, Service Catalogue, Cloud Formation, Lake Formation, SNS, SQS, Event Bridge Language & Scripting: Python and Spark ETL: DBT Good to Have: Airflow, Snowflake, Big Data (Hadoop), and Teradata Responsibilities: Serve as the … primary point of contact for all AWS related data initiatives and projects. Responsible for leading a team of data engineers and analysts to design, implement, and maintain data solutions on the AWS platform. Gather and analyze business requirements to develop scalable and efficient data solutions on AWS. Design and implement data pipelines using various AWS services such as EMR, Glue, Kinesis, and Redshift. Develop data models and ETL processes to efficiently transform and load data into AWS data lakes and data warehouses. More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is … work with cutting-edge technologies and contribute to exciting projects in a collaborative environment. About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of … a highly regulated industry and with highly sensitive data. Exposure to large data solutions like Snowflake, Trino, Synapse, Azure Data Lake, and Databricks. Experience in data science using R, Stata, or Python. Familiarity with Atlassian tools such as JIRA, Confluence, and BitBucket. Understanding More ❯

Are you an experienced Data Engineer looking to join a leading B Corp organisation in the financial services industry? Keen to join accompany offering a hybrid 3-day office working week? You will be joining a company who work very hard to enable long term financial well-being … by providing tailor made lending solutions. Data is key to our success, and that’s where you come in! You will be working hard to enable effective data driven decisions using your experience of data warehousing and Business intelligence. As a Data … industry, however this is not essential. Experience working in an Azure Data environment with storage tech such as Azure Data Lake, Data warehouse and traditional MSSQL. You will have great experience of MS SQL Server including working with T-SQL. Previous experience working More ❯

Data & Analytics Engineer 6 - 12 Months Contract Newcastle £400 - £500 per day (outside IR35) Sellick Partnership is currently assisting an organisation in Newcastle with the recruitment of a Data & Analytics Engineer. This is a contract for 6 - 12 months, this role is hybrid with 3 days … onsite and 2 from home. Responsibilities of the Data & Analytics Engineer include: Deliver the Data and Analytics service platform and methods Design and develop appropriate secure data architecture such as data warehouses and data lakes for big data, data science, data models Sourcing, accessing, manipulating and engineering ETL data pipelines and processes with data Use programming skills such as SQL, Python and others to expose data from systems Collate, cleanse, synthesise, integrate and interpret data More ❯

Based (Hybrid working model, 2 days a week office based, 3 days remote) Competitive Salary plus performance related bonus The Role: As a Data Ops Engineer, you will be responsible for enhancing the efficiency and reliability of our data management processes, supporting our advanced analytics, machine … learning, and AI initiatives. You will harness your engineering skills to develop and automate data pipelines, ensuring data is seamlessly integrated, processed, and available across our analytics platforms. Your role will include automating data workflows, improving data quality, and ensuring efficient delivery … pipelines. You will work alongside teams across the organization to address their data needs, craft agile solutions, and continuously improve the data environment. What will you be doing? Design and implement efficient ETL processes for data extraction, transformation, and loading. Build real-time data More ❯

Were looking for a Data Architect to join our architecture chapter here at N Brown Group! What will you do as a Data Architect at N Brown? Designing solutions to meet customer needs. This will be end to end and take advantage of key frameworks that … and demonstrable data architecture experience, preferably in designing and implementing cloud-native analytics/data platforms (including data lake/warehouse) technology through all data lifecycle stages Excellent conceptual and logical data modelling and database design experience, including industry … workflows and data needs Appreciation of the modern cloud data stack, headless BI, analytics engineering, data meshes and lake-houses Knowledge of Data Governance Whats in it for you? Hybrid working 24 days holiday (+ 8 bank holidays) with the option More ❯

Introduction to Azure Data Lake Storage (ADLS) Azure Data Lake Storage (ADLS) is a key component in the Azure ecosystem that provides scalable storage for big data analytics. Data Transformation & Modeling One essential aspect of working with data in ADLS is the transformation and modeling process. Companies can leverage Azure Data Factory or Databricks, using languages like PySpark and Scala , to create efficient data processing and transformation workflows. These workflows are designed to handle both batch and streaming data seamlessly. … Furthermore, organizations can develop robust data models within the ADLS environment to optimize their analytics and insights generation. More ❯

Delivery Consultant - Data Analytics, Professional Services Global Competency Center The Amazon Web Services Professional Services (ProServe) team is seeking a skilled Delivery Consultant to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS … Engineering, related field, or equivalent experience Experience with data analytics IT platform implementation with hands-on implementation experience with data lake and data warehouse. Hands-on experience developing software code in one or more programming languages/frameworks such as Python, Spark, SQL … etc. Hands-on experience leading large-scale full-cycle MPP enterprise data warehousing (EDW), data lake and analytics projects PREFERRED QUALIFICATIONS AWS experience preferred, with proficiency in a wide range of AWS services (e.g., EC2, S3, RDS, Lambda, IAM, VPC, CloudFormation) AWS Professional level certifications More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯