1 to 25 of 88 Permanent Data Lake Jobs with Hybrid or WFH Options

Title: Azure Data Engineer Rate: Up to £800 P/D Length: 12 month rolling Location: London (Hybrid) Description (Full spec avail): To work with an established team on developing a new strategic big data platform for our customer, we are searching for a Senior Azure … Engineer. The current Oracle and Java stack will be replaced with a new platform that is an Azure-based data lake with APIs and events to enable data consumption by analytics teams. The needs for this multi-year migration project include engineering to … facilitate the transfer of data masters from the old platform to the new one. Key requirements : CompSci or equivalent degree from a top global university Awareness of and comprehension of Agile approaches, including TDD and BDD knowledge. familiarity with working in agile development teams Excellent written and verbal more »

managing subcontractor relationships, developing an integrated schedule, and ensuring the successful delivery of the tool, including integrations with Oracle P6 and an Azure Data Lake. Key Competencies Project Management: Demonstrated leadership in managing complex projects across various teams and locations. Vendor Management: Experience in managing third-party vendor … L5 tool, including necessary integrations. Dependency Management: Manage key dependencies across the client organization, vendor ecosystem, and client supplier for Azure Data Lake and related components. Proof of Concept: Define scope and deployment audience for the proof of concept, with a target stand-up date by July more »

Data Architect/Cloud Data Architect (GCP) Google Cloud/GCP, Machine Learning/Generative AI Remote-based or Hybrid should you prefer (London) £100k-£140k basic salary + bonus Benefits: 25 days holiday + bank holidays Private Healthcare Discounted Gym Membership (Nuffield + Hussle) Life … Insurance, Income Protection, Employee Assistance Program Pension Scheme (max 10%) We are working with an AI/Data Consultancy with core clients within the Retail, Financial Services, Gaming, SaaS sectors. The successful Cloud Architect will work with an array of technologies with clients from several industries & sectors meaning … devising innovative solutions to address their needs, defining project parameters, and supervising the execution of these projects. Role of the Cloud Architect/Data Architect: Utilising advanced data processing and cloud technologies effectively to stimulate innovation. Engaging with clients to create top-notch solutions tailored to more »

consultancy that are recruiting SECURITY ARCHITECTS to work on a very exciting LONG-TERM CONTRACT within the financial service sector. Role: Security Architect (Data Solutions) Rate: Up to £500 per day (inside IR35) Location: Swindon/London – Hybrid (2 days onsite) Duration: 6 months (initially – view to extend … integrations team, you will play a crucial role in ensuring the security and integrity of systems related to service mesh, container platforms, and data solutions. Your responsibilities will involve designing, implementing, and maintaining robust security measures to protect sensitive data, prevent unauthorized access, and mitigate risks. … Key responsibilities: Collaborate with development and operations teams to design secure and scalable architectures for containerized applications, data mesh, and Kafka. Assess and implement security controls for container platforms (e.g., Kubernetes, Docker). Define and enforce container image security practices, including vulnerability scanning, image signing, and runtime security. more »

Data Architect Salary: £90,000 - £110,000 Location: Remote/Hybrid Data Idols are working with a fast-growing technology company who are disrupting the software engineering industry. They are looking for a Data Architect with strong experience in data engineering and … experience in delivering innovative solutions. The Opportunity In this role as a Data Architect, you will play a pivotal role in ensuring the efficiency of their data architecture while heading the migration from legacy systems to modern cloud solutions. You will design and build scalable database and data lake solutions, implement CICD pipelines and automate the deployment of data products into production environments. Skills and Experience Proficiency in AWS Great communication more »

Robert Half is supporting their client which is a Global Consulting Firm in looking for a Dynamics 365 with ideally Databricks Data Lake experience to help support databricks and data lake migration to Dynamics 365. Contract Assignment Details: ASAP Start - 1 week turnaround to … month contrac t and subject to renewal The D365 Project Manager will need experience in: Dynamics 365 Experience *essential* Databricks & Data Lake experience *extreme preference* Databricks Expertise: Showcase your proficiency in Databricks, including your ability to leverage its features for data engineering, data … any projects where you have successfully implemented Databricks solutions, optimised data pipelines, or improved data processing efficiency. Data Lake Migration Experience: Discuss your experience with data lake migration projects, particularly focusing on your role in planning, executing, and overseeing the more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. This role requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal … Engineering. 1+ years in a Lead/Principal Engineer role. 3+ years of experience with GCP. Extensive experience with SQL and Data Lake/Warehouse solutions. Proficiency in languages such as SQL, Python, Java, or Scala. In-depth knowledge of query optimization techniques and experience in fine more »

Role: Senior Data Engineer Business Area: Engineering/Technology Reporting to: Head of Data Location: Hybrid/Remote About Validis Validis is a dynamic fintech company with a leading software platform, built for the extraction and standardisation of accounting data. Validis is both a B2B and … SasS with operations across the UK, US & Australia. We specialize in providing quality data for both audits and financial services, with the guarantee that our product will streamline processes for the financial industry. Our current client base holds a number of blue- chip companies, mainly comprising audit firms … for you to excel in. We believe in the power of being... YOU! About the role We are seeking a highly skilled Senior Data Engineer with a strong focus on Extract, Transform, Load (ETL) processes to join our growing team. This role will be fully remote, offering flexibility more »

We're on the hunt for a top-tier Data Product Manager obsessed with all things data product, BI & AI centred to join the exhilarating journey of a cutting-edge digital tech company's Data Tribe! Workplace Policy | Location: Hybrid Working between … up to £55,000 You will play a key role in delivering outcomes and quantifying real customer problems. Utilising the brand's extensive data, you will lead the product management framework and define/solve customer problems using BI & AI. Excellent communication and product management skills are essential … a great client... what more could you ask for? What else will you be doing? Take ownership of all aspects of the new data platform and ensure it remains aligned with the rest of the business Uncover and measure real customer issues using data analysis tools more »

Data Engineer We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our … client's data capabilities and supporting the launch of our new platform and mobile app. Key Responsibilities: Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs. Build data pipelines to connect APIs, files, databases, and data … tasks. Knowledge of CI/CD approaches for Data Platforms using Bitbucket and Bitbucket Pipelines. Knowledge of AWS data lake approaches using Athena & Apache Iceberg tables. Exposure to visualisation development using Power BI. Knowledge of MS SQL Server, SSIS, Visual Studio, and SSDT projects. more »

Develop and optimize MS SSAS cubes (tabular and dimensional) Develop and improve solutions spanning data processing activities from the data lake (stage) to star schemas and reporting view’s/tables and finally into SSAS. Desired Skills and Experience: You have 5 years experience building … domain understanding, Ideally in finance, marketing, CRM, compliance. You should have a strong understanding of data. Have experience working with large volumes of data (millions or records per day). Can build tabular (or OLAP) cubes properly (with DAX or MDX). Advanced SQL knowledge and ability to … write performance optimized queries. You should have industry standard Data Modelling skills (i.e. Kimball) Whats in it for you? A regular bonus. Competitive salary. Healthcare support, including dental, private medical, and health screening. Wellbeing support And so much more... If the above sounds like it could be you more »

My client are looking for a talented and motivated Big Data Architect (Azure, Databricks, Spark) to be based … in their London office. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives, as they provide increasing numbers of services to consumers across multiple digital channels. You'll be responsible for managing a remote engineering team of …/experience is essential: Strong implementation experience using Spark and Databricks Strong Cloud experience (ideally Azure) Previously heavily involved in an implementation programme Data Warehouse Strong stakeholder management experience Excellent IT background, ideally within Telco/Wireless service providers but not essential Salary: Excellent + bonus + package more »

Digital Marketing Insights Analyst (Python, SQL, Marketing) Location: Alcester (Warwickshire)/Hybrid Salary: Up to £45,000 Keywords in the role: Data Analyst/Insights/Marketing/Digital Agency/SQL/Python/Data Visualisation Career Opportunity An exciting opportunity has come up to … work for a truly innovative organisation located in Alcester (Warwickshire), as they plan to grow the Data and Insights team. They have the motto of “We back everything we do through insights and data”, so you will be an essential part of the team in driving … is likely to open up a further opportunity for you to build a supporting team to assist you in your expertise and ensure data is at the forefront of all our client’s road maps xpertise and ensure data is at the forefront of all our more »

Senior Data Modeler UK - Fully remote £65k - £90k plus Benefits and Bonus TECH STACK: SSAS, SQL, Excel, MDX, PowerBI/Tableau This is an exciting opportunity to join one of the largest media technology brands in the world and lead a major project relating to the development of … their data cubes. ABOUT THE COMPANY This business is a household name in the UK and their products and services are used by millions of people each day. They have recently completed a major migration project to a new cloud data environment and as a result … be responsible for are: Building a variety of SSAS tabular and dimensional cubes Build out Cloud cubes Work on improving current data lake processing activities Work across multiple business stakeholders to ensure that their various requirements are supported by cutting edge technical solutions Document all processes to more »

media programme. You will be able to demonstrate knowledge and understanding of software design patterns including architectural approaches to the development of applications, data, integration, infrastructure and security. You will possess leadership skills in proactively driving forward and communicating solutions effectively. You will have demonstrated evidence of applying … technology to solve business problems with an all-round solution architecture experience within data-rich and analytics-focused environments. You will also have experience of dealing with senior business stakeholders and people across the technology domain. You will equally have experience of frontend SPA frameworks and exposure to … emerge. Demonstrate continued learning and evaluation of the latest methods, tools and technologies. What you’ll bring Experience of application architecture, engineering, integration, data modeling & delivery approaches demonstrating: Front-end to back-end service integration. Content Management. East-to-west cross-platform integration. Security by design. Good knowledge more »

Data Engineer Location: London, UK Hybrid: 3x a week in office Salary: £63,000 About the Client Our client is a top-tier professional services firm known for its exceptional workplace culture and some of the most sought-after office spaces in London. Role Overview Our client is … in search of a skilled Data Engineer to manage and engineer the data warehouse. The opportunity will be amazing for a Data Engineer who is happy to work in a small team. Incredible opportunity to mentor/lead a small Data Engineering … team within a year! Main Responsibilities Build scalable data pipelines on a daily basis Code on a daily basis with Azure SQL and python Develop and maintain the logical and technical architecture to fulfil the client’s information, insights, and reporting needs. Stay informed on the latest developments more »

Data Engineer - Databricks - £70-75,000 - London/Hybrid Scalexperts are partnered with an education business who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function. They are looking for a Data Engineer … to join them to work on building a brand new data platform which is still in early stage development. They are looking to combine all the data into one common data warehouse so that reporting & insight/analytics becomes much clearer and more consistent. … years experience in Data Engineering Azure experience ideally worked with tools such as Synapse, Azure Data Factory, Data Lake etc Experience with SQL is a must, some Python is a bonus Experience of working with a number of different data sources more »

closely with key business stakeholders Experience: Around 3 years’ experience developing with SQL MSSQL, T-SQL Azure DevOps experience preferred Troubleshooting and resolving data … quality issues Documentation Advantageous: Telecoms billing systems or processes Knowledge of Java or Kotlin NoSQL Databases Experience of CRM systems Azure Data Lake/Data Pipelines This role offers a salary of up to £40,000 including generous benefits including a company bonus, remote working more »

actively recruiting for an experienced DevOps Engineer to join them on a permanent basis. Their technology is transforming the maintenance industry, providing a data-driven platform that offers key insights for better decision making. Role details of the DevOps Engineer Apply signal … processing to reduce noise and improve algorithms Manage machine learning models and computational resources for real-time inferencing. Process big data using Datalake/Datawarehouse and ETL tools (Athena, Amazon EMR, Amazon Redshift). Implement CI/CD pipelines for cloud and edge deployment of ML models. Orchestrate more »

Lead Data Engineer - up to £100K - Hybrid London Our client a global brand based out of lovely offices in West London are looking for a Lead Data Engineer to work on a business-critical, brand new, innovative high availability application which will be used by thousands … who is looking to take their next step in their career and wants to take on more responsibility. Technical Skillset: Experience as a data engineer developing and maintenance of ETL/ELT processes Good experience in Data Modeling within a cloud … based data platform Strong experience with SQL Server Azure data engineering stack, including Azure Synapse and Azure Data Lake Python, PySpark and T-SQL In return you will be offered a competitive salary and benefits package, remote working options and an opportunity to more »

Senior Python Software Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … DBT Buy-side asset management (hedge fund, asset manager, investment management) Role: Senior Python Software Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Python, Java, AWS and Iceberg. If you more »

Java Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … DBT Buy-side asset management (hedge fund, asset manager, investment management) Role: Java Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Java, Python, AWS and Iceberg. If you more »

Senior Java Software Engineer (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial … Buy-side asset management (hedge fund, asset manager, investment management) Role: Senior Java Software Engineer (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Java, Python, AWS and Iceberg. If you more »

Python Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … DBT Buy-side asset management (hedge fund, asset manager, investment management) Role: Python Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Python, Java, AWS and Iceberg. If you more »

Java Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services … appreciation of asset classes such as Fixed Income, equities, FX or commodities Role: Java Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with AWS, Glue, Dremio, Snowflake, Python and Java. more »