1 to 25 of 34 Contract Data Lake Jobs

PLCs and control systems Establish safe, read-only access to that data Lay the foundations for a centralised cloud data lake Enable reliable data visualisation and reporting as the next phase De-risk future analytics, SPC, and optimisation initiatives Key Responsibilities 1. … intrusive Aligned with OT safety principles Work with IT to align on: Network segmentation Firewall rules Cloud connectivity patterns 4. Cloud Data Lake Foundations (Next Phase Readiness) Contribute to the design of a cloud-based data lake capable of ingesting: PLC and machine telemetry ...

flows (statistics, APIs, surveillance intelligence, unstructured sources). Evaluate 2 to 3 infrastructure options, including Azure-based Analytical Platform (e.g., Data Lake, Data Factory, Databricks, or Fabric), Microsoft Fabric "small org" model, and a Hybrid model Produce the Data infrastructure blueprint. Design … Strong practical knowledge of Microsoft 365/Azure investments and services, specifically those for data and analytics (e.g., Azure Data Lake, Azure Data Factory, Databricks, Microsoft Fabric). Experience with Reproducible Analytical Pipelines (RAPs) , including the setup of appropriate Python/R environments ...

Responsibilities Include: Designing and owning conceptual, logical, and physical data models Defining and evolving data warehouse and data lake architectures Providing architectural leadership across relational and NoSQL databases Advising on data integration patterns , including ETL/ELT and streaming architectures Supporting … Modeller Strong expertise in data modelling (conceptual, logical, and physical) Demonstrable experience designing data warehouses and data lake architectures Advanced SQL skills and strong understanding of relational and NoSQL databases Experience with cloud data platforms (AWS, Azure, and/ ...

Title: Data Architect Location: London (Hybrid - minimum 2 days per week in the office) Day Rate: Market rate (Inside IR35) Contract Duration: 6 months Role Overview We are seeking an experienced Data Architect to work with a high-performing data team, designing and delivering … supporting cloud migrations. Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT, Docker, Fargate, FastAPI Data Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Infrastructure and Operations: Terraform, GitHub Actions, Azure DevOps, Grafana, Azure Monitor Desirable Skills and Experience Experience working with ...

Role: Data Architect Location: Edinburgh or Luton (hybrid/onsite as required) Engagement: Contract - Inside IR35 Rate: £550 - £650 per day Security Clearance: Active SC Clearance required Project Description We are seeking an experienced Data Architect to lead the design, implementation, and governance of enterprise-scale … roles High proficiency in SQL and database technologies (e.g. Oracle, SQL Server, PostgreSQL, MySQL) Strong knowledge of data warehouse, data lake, and lakehouse architectures Experience with ETL/ELT frameworks and orchestration tools (e.g. Informatica, Talend, Apache Airflow) Proven experience establishing and maintaining data ...

analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage. Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools … Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

Data Architect (SC Cleared) Location: Edinburgh or Newcastle preferred Other locations considered: Luton, Bristol, Southampton (Hybrid – predominantly onsite ) Contract: 6 months initially (potential to extend) Rate: Up to £69.44 per hour umbrella ( rate may be negotiable ) Clearance: Active SC clearance required Nationality: UK Eyes Only – sole British nationality … required The Opportunity We are seeking an experienced Data Architect to support a high-profile, security-critical programme within a UK government/defence environment. This role focuses on the design, implementation and governance of enterprise-level data architectures , ensuring data is accurate, secure ...

Engineer across data analytics and data engineering domains Strong hands-on experience with: Amazon S3 (data lake patterns, partitioning, lifecycle management) AWS Glue (Jobs, Crawlers, PySpark, orchestration) Amazon Redshift (data modelling, performance tuning, WLM, Spectrum) Advanced Python (PySpark … Proven ability to engage senior stakeholders and clearly communicate technical trade-offs Experience working in Agile delivery environments Nice to Have: Experience with AWS Lake Formation, Lambda, Step Functions, Athena, EMR, DataBrew Familiarity with data quality, lineage, or observability tooling Knowledge of GDS ways of working ...

Title: Senior Data Engineer Location: London (Hybrid - minimum 2 days per week in the office) Day Rate: Market rate (Inside IR35) Contract Duration: 6 months Role Overview We are seeking an experienced Senior Data Engineer to design, develop and maintain scalable data pipelines that … translate business requirements into technical solutions. Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT Data Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Infrastructure and Operations: Terraform, GitHub Actions, Azure DevOps, Azure Monitor Desirable Skills and Experience Experience with enterprise data ...

sites) Duration: 6 month initial contract Inside IR35 Role details: Our client, a prominent player in the Defence & Security sector, is looking for Data Architects to join their team on a contract basis. Whilst the site preference is Edinburgh or Newcastle, the team can also support contractors working … will be required onsite at least 4 days per week. Note, active SC clearance required! Key Responsibilities: Design and implement enterprise-level data architecture solutions, including databases, data warehouses, and data lakes. Develop and maintain logical, physical, and conceptual data models. Define ...

Azure Data Engineer Rate - up to £350/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based … Synapse Analytics. Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs. Collaborate with Data Architects, Analysts, and stakeholders to define data models and ensure best ...

Data Engineer Fully Remote 6 Months Contract £550 Inside IR35 (PAYE Rate) + Holiday Overview We’re looking for a talented and motivated Data Engineer to join a growing Data Engineering team delivering high-quality, enterprise-scale data solutions. This … data (JSON, XML) Experience with Microsoft Azure data services such as Azure Data Factory, Azure Data Lake, Azure SQL, Azure Synapse, Azure Functions, Cosmos DB Familiarity with Git repositories and branching strategies Exposure to additional technologies such as PowerShell, Bicep, YAML ...

Senior Data Engineer Fully Remote 6 Months Contract £600 Inside IR35 (PAYE Rate) + Holiday Overview We’re looking for a talented and motivated Data Engineer to join a growing Data Engineering team delivering high-quality, enterprise-scale data solutions. This … data (JSON, XML) Experience with Microsoft Azure data services such as Azure Data Factory, Azure Data Lake, Azure SQL, Azure Synapse, Azure Functions, Cosmos DB Familiarity with Git repositories and branching strategies Exposure to additional technologies such as PowerShell, Bicep, YAML ...

Data Architect 24 months – until December 2027 Hybrid – occasional travel to Reading Rate TBD Role Requirements: Subject to clearance requirements … Experience: Proven track record as a Data Architect in complex, multinational environments. Technical Expertise: Strong knowledge of Azure services (Data Lake, Data Factory, Synapse) and familiarity with emerging cloud technologies. Security Awareness: Ability to design architectures with strict security boundaries, protective markings, export ...

Data Engineer Buckinghamshire - Contract Are you a Data Engineer who loves building data pipelines, working with cloud technologies, and enabling better data-driven decisions? We’re looking for an experienced Data Engineer to join our client’s Technology team … play a key role in designing, delivering, and optimising modern data solutions.Our client is a retail brand currently undergoing a significant, large-scale transformation programme — making this an exciting time to join and shape the future of their data landscape What You’ll Be Doing Building ...

Permanent Job Summary: AWS Support Engineer/Data Engineer Telecom Domain (JD) Key Skills & Expertise AWS Core Services : S3, Redshift, Glue, Athena, Lake Formation, IAM Data Engineering/ETL: Building and optimizing ETL pipelines Data ingestion, transformation & orchestration using AWS Glue (PySpark/… Python) Working with structured/semi-structured telecom datasets (CDRs, network logs, subscriber data) Data Lake Technologies: Expertise in Apache Iceberg table format Schema evolution, partitioning, compaction & metadata management Query performance tuning with Athena & Redshift Spectrum Redshift Expertise: Data modeling, distribution styles, sort ...

Data Architect Edinburgh 6-Month contract Paying up to 69p/h (Inside IR35) Please note - due to the nature of the work, you will need to hold or be eligible to obtain a high level of UK Security clearance - please only apply if suitable Key Responsibilities: Design … implement enterprise-level data architecture solutions, including databases, data warehouses, and data lakes. Develop and maintain logical, physical, and conceptual data models. Define data management standards, policies, and best practices. Work with data engineers to design and optimize ...

Interim Principal Azure Data Architect Location: North London (hybrid) Contract: Interim Rate:£900 per day outside IR 35 A complex organisation based in North London is seeking an Interim Principal Azure Data Architect to reset, review, and re-implement its data architecture . This … architecture Deep, practical experience across the Azure data stack (for example Azure Data Factory, Synapse, Fabric, Databricks, Data Lake, SQL) Strong background in data modelling , analytics architecture, and large-scale data platforms Experience leading data architecture resets ...

Details Role/Job Title: Data Engineer Work Location: Manchester, UK Mode of Working: Hybrid Office Requirement (Hybrid): Tuesday/Wednesday/Thursday The Role Seeking a Data Engineer profile with deep technical expertise and thought leadership, provides advanced data solutions by using software … process, store, and serve data to others. Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure. Utilizes a deep dive analytical skillset on a variety of internal and external data. Your Responsibilities Writes ETL (Extract ...

skills. Technical Stack: Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: MLflow, Azure ML, Airflow, Docker, Fargate, FastAPI Data: Snowflake, Delta Lake, Redis, Azure Data Lake Infra & Ops: Terraform, GitHub Actions, Azure DevOps, Grafana, Azure Monitor Desirable skills/knowledge/experience: Knowledge … data platforms (e.g. Snowflake, Azure Data Lake). Experience deploying models as APIs (FastAPI, Azure Functions). Understanding of monitoring, model performance tracking, and observability best practices. ...

Automation Leadership Lead and support the selection, design, and transition from fragmented security tooling to a unified SIEM platform and security data lake . Drive a fundamental shift from incident-focused, task-based workflows to preventative security activities and platform optimisation . Proactive Threat Focus Guide … high-availability environments. End-to-End Programme Ownership Full lifecycle ownership of major initiatives including MDR consolidation, SIEM, SOAR, and security data lake deployments , delivering measurable business outcomes. Formal RFP & Vendor Management Expertise Proven experience authoring RFPs, evaluating vendors, and overseeing complex onboarding and integration. Battle-Tested ...

/paternity pay – Life assurance – HolidayPlus – Cycle2work Scheme & more REQ5381 The Senior Systems Analyst is a senior technical specialist responsible for keeping HR data accurate, well-governed, and ready for migration to next-generation HR systems like Oracle Fusion Cloud HCM. The role leads complex data … projects, change control, and regression testing cycles. Collaborate with key stakeholders to define requirements and integration points between core HCM platforms, Data Lake, payroll, and reporting environments. Build advanced executive ready Power BI dashboards, data models, and self-service data sets, and scheduled ...

Azure Data Engineer - Outside IR35 - Hybrid ( 3 Days in London) About the Role The IT Data Engineer is responsible for analysing, designing, and delivering software and data solutions that improve business processes, enhance decision-making, and optimise analytics. Working within a small, high-performing … service readiness and support considerations Skills & Experience Strong Microsoft Azure knowledge, including Azure SQL Database, Azure Data Factory, Azure Data Lake, and Azure Synapse Analytics Solid data engineering background (ETL, data warehousing, data modelling) Advanced SQL skills Programming experience ...

Hadoop Platform Engineer, you'll play a key role in supporting, maintaining, and modernising our on-premise HDFS-based Data Lake and associated Hadoop ecosystem components. You will also help drive the strategic migration of our Hadoop workloads to the cloud, contributing to enterprise-wide simplification … Doing Managing and maintaining large-scale Hadoop clusters across on-prem environments Supporting and optimising our HDFS-based Data Lake and adjacent platform components Working with technologies including Hadoop, Spark, HDFS, YARN, Hive, Oozie , and related tooling Partnering with engineering teams to deliver scalable, high-quality data ...

Technical Data Engineer/Analyst | Contract | Azure | 6 months | Hybrid | Outside IR35 | £400 - £475 | Nottingham | We’re supporting a major data transformation programme and looking for a Technical Data Analyst to help migrate legacy systems into a modern Azure data platform . … Strong SQL skills and experience working with Azure-hosted datasets Power BI reporting/dashboards creation Python experience Exposure to Azure Data Lake, Databricks, or Data Factory is beneficial If this is a role that suits your skill set, you are immediately available ...