Data Engineer (DV Cleared) 6 Month Contract (Inside IR35) Location: London Rate: £700 - £800 per day Skills: DV Clearance ESSENTIAL - Must already hold DV clearance, Cloud technology experience We are looking to recruit a DV Cleared Data Engineer to join a defence organisation based in Central London. This … chances for extensions likely. The role is fully office based in Central London. Key Responsibilities: Technical Leadership: Lead and guide the technical direction of dataengineering projects. Data Pipeline Development: Design, develop, and maintain robust data pipelines using Azure Data Factory (ADF), Azure Synapse Analytics … and SQL Server. Data Integration: Extract, transform, and load data from diverse sources into a new platform. Data Product Development: Collaborate with stakeholders to define and build data products that deliver actionable insights. Team Mentorship: Mentor and develop a junior Data Engineer, fostering their growth More ❯
Job Title: Data Engineer (w. Prophecy) In this role you will: Design, develop, and optimize data pipelines using Azure Databricks, PySpark, and Prophesy. Implement and maintain ETL/ELT pipelines using Azure Data Factory (ADF) and Apache Airflow for orchestration. Develop and optimize complex SQL queries and … Python-based data transformation logic. Work with version control systems(GitHub, Azure DevOps) to manage code and deployment processes. Automate deployment of data pipelines using CI/CD practices in Azure DevOps. Ensure data quality, security, and compliance with best practices. Monitor and troubleshoot performance issues in … data pipelines. To be successful in this role you should meet the following requirements: Must have experience with Delta Lake and Lakehouse architecture. Proven experience in dataengineering, working with Azure Databricks, PySpark, and SQL. Hands-on experience with Prophesy for data pipeline development. Proficiency in More ❯
IR35 Location: Knutsford Cheshire Duration: 6 months + JD -Professional & Technical Skills: - Required Skill: Expert proficiency in PySpark, Hadoop, Python, Git - Strong understanding of dataengineering concepts and ETL processes, Data warehousing, Data Pipeline, SQL - Additional Good To Have Skills: AWS Glue, Knowledge of implementing ETL … and data pipelines in AWS -5+ years of experience Please send in your latest CV LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending More ❯