1 to 25 of 36 Data Lake Jobs in London with Remote Work Options

will be invaluable. Main Responsibilities: Design and implement effective database solutions and models to store and retrieve data including Data Lake and Data Warehousing Assess database implementation procedures to ensure they comply with GDPR and data compliance Design conceptual and logical … the benefits, pros and cons of solution options. Skills & experience required: Strong hands-on experience in Data Warehouse and Data Lake technologies preferably around Azure Extensive experience in implementing solutions around DataBricks, Azure Data Factory, Azure SQL, CosmosDB, Cognite Services, Storage Accounts, Azure … of working with structured and unstructured datasets Able to design a range of architectural solutions Data models and ETL Data lake and data warehouse end to end architecture Experience within media, publishing, research, or a similar consumer focused industry is highly desirable, but more »

Role: Data Modelling Job Type: Permanent Location: London (Hybrid) Ready to utilize your Data analysis and Investigatory skills ? Are you passionate about RDBMS systems and converting data requirements into logical models and physical solutions? We have an exciting role for you as a Data … the future of technology. with some of the brightest global minds in the industry. access to endless learning opportunities. The Role As a Data Modeler, you will utilise your analytical skills to design, implement and create conceptual, logical, and physical data models. Key responsibilities: modelling standards … to convert data requirements into logical models and physical solutions. with data warehousing solutions (e.g. Snowflake) and data lake architecture, Azure Databricks/Pyspark & ADF. retail data model standards - ADRM. communication skills, organisational and time management skills. to innovate, support change more »

or Contract Pay Range: Based on experience level GENERAL DESCRIPTION & RESPONSIBILITIES The Azure AI Solution Architect will lead the creation of high-value data driven solutions leveraging Cyclotron s proven implementation methodology and solutions for enterprise projects, as well as contributing to technical pre-sales activities as required. … and implementing Retrieval Augmented Generation (RAG) Information Architecture Data Modeling principles for relational and dimensional data structures Data Lake design principles, Data Virtualization Strong knowledge of data warehouse concepts and T-SQL relational/non-relational databases for data … SQL/SQL Server 2016+ (SQL, Structure, Stored Procs, Tuning) ETL/ELT, (ADF, SSIS) Data governance (Purview, Unity Catalogue) Databricks Delta Lake Storage Azure Dev OPS DESIRED SKILLS Advanced Analytics Data Technologies Databricks, Delta Lake, Synapse Spark SQL, Pyspark Azure Data more »

Data Architect (fully remote) Salary: £85,000 + company benefits Full time - Permanent Must be able to gain SC Clearance Job Purpose: To work within a team of architects providing support to core infrastructure and business led projects, providing specific data architecture expertise to solution and … The person appointed will be an integral member of the Architecture Team and will be responsible for ensuring that all initiatives explicitly consider data as part of their approach, and that all elements of the data lifecycle are adequately provisioned. They will also be expected to … and data transformation (extract, transform and load) processes and the supporting technologies such as Azure Data Factory, Data Lake, other analytics products Experience of architecting data solution across hybrid (cloud, on premise) data platforms Experience implementing data more »

Data Migration Developer (SC Cleared) London (Hybrid) Permanent £7 0,000 - £90,000 (DOE) + Benefits An experienced Data Migration Developer wanted with active SC clearance. This fantastic opportunity will involve playing a dual role as a Migration Specialist and Developer. Hybrid working with the expectation … to write high-quality, maintainable code using languages such as Python, SQL Server. PC, PowerShell, Sharepoint, Azure, Desktop Support , Snowflake, Azure Data Lake services (ALA) Gen 2. Expertise in development, testing Proof of Concepts (PoCs), delivering Minimum Viable Products (MVPs) is essential for achieving project success. Develop … Plan, design, and execute PoCs to validate new technologies, frameworks, or solutions. Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2. Utilize PowerBI, Tableau, or similar tools to design and create interactive and visually appealing dashboards and reports. Familiarity with data more »

Data Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established organisation within the education sector who are looking for a Data Engineer to join their established IT team. Their current project is based around the creation and implementation of a … brand new Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. This is an opportunity to join a team who are serious about the way that they use data … Excellent understanding of Azure Databricks Experience creating data pipelines using Azure Data Factory Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »

SC Cleared) London (Hybrid) Permanent £70,000 - £90,000 (DOE) Software Developer needed with active SC Security Clearance and strong Python, SQL + Data Visualisation tools (PowerBI/Tableau). Working in London on a hybrid remote basis (typically 2-3 days/week in the office). … + implementing innovative banking applications and systems. Python and SQL programming/development experience. Developing high-quality, maintainable Python and SQL code. Developing data interfaces to connect multiple banking systems including: SQL queries, data retrieval, data manipulation, data modelling + data … web applications. Azure Cloud: designing + implementing Azure cloud based solutions + using data tools like Snowflake and Azure Data Lake Services (ADLS). Developing solutions for Proof of Concept (POC) + Minimum Viable Products (MVP). Advantageous: Banking, JavaScript, HTML, CSS + front-end more »

Java Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

and SQL programming/development experience. Developing high-quality, maintainable Python and SQL code. Developing + implementing innovative Banking applications and systems. Developing data interfaces to connect multiple banking systems including: SQL queries, data retrieval, data manipulation, data modelling + data integration. PowerBI/Tableau Data Visualisation tools to create interactive visual reporting dashboards + integrating visualizations into … web applications. Azure Cloud: designing + implementing Azure cloud based solutions + using data tools like Snowflake and Azure Data Lake Services (ADLS). Developing solutions for Proof of Concept (POC) + Minimum Viable Products (MVP). Advantageous: active SC Security Clearance, JavaScript, HTML, CSS more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Java Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Python Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Our public sector client requires a Senior Data & Analytics Developer to join their team as part of an on-going project on a 12-month contract. You will have the following skills and experience: Knowledge of ETL& ELT, data warehousing/business intelligence methodologies. Experience handling … big data, cloud technology and unstructured data. Star Schema structure & design, Kimball … inmon, and hybrid data warehouse design. Cloud data products such as: Data factory Events Hubs Data Lake Synapse Azure SQL Server Experience developing Databricks and coding with PySpark and Spark SQL. Proficient in ETL coding standards Data encryption techniques more »

Senior Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £100,000 Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great … opportunity to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real impact on a scaling business. You will be working very closely … be up to?: Data Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse. Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as more »

Data Engineer - Python - SQL - London - Up to £65k I'm currently working with an organisation who are globally recognised due to the nature of their work, despite only having a presence within the UK. My client are directly involved and help to organise annual events which attract every … to comprise of some of the latest and most exciting technologies on the market. The role will be responsible for engineering my clients data platform which is at the core of their business. You'll be working with a range of data sources, coding in python … Intelligence, MS Power BI, MS SQL Server, Snowflake, Python, SQL, Data Pipeline, Data Modelling, MDM, T-SQL, Data Lake, Logic Apps, Function App, London more »

Data Architect IAM, Financial Service, Models, Big Data, Warehouses, Data Lakes, Agile, CI/CD Reference: SB/DaAr/01 Sector: Competitive Hybrid Working Town/City: London Contract Type: Contract Closing Date: 24/04/2023 Data Architect IAM … London/Hybrid Contract - 6 Months Competitive Daily Rate Our client needs an experience IAM Data Architect to work an innovative Access Management Programme for a Financial Service organisation. You will lead on Data Architect designs to create build builds data models to fulfil … the strategic data needs of the Access Management Programme in accordance with the policies and standards set out by the Chief Data Office. Must have strong recent Identity and Access Management data technologies project experience within a large Big Data environment. Must more »

Synapri collaborates with a large transport company, who is seeking a Senior Data & Analytics Developer for a 12 months contract. You will be involved in the design, development and configuration of applications, components and tools according to the technical plans set by the Development Technical Lead. Knowledge and … experience required: In-depth working knowledge of ETL/ELT, data warehousing/business intelligence methodologies including dealing with big data, cloud technology and unstructured data Knowledge of star schema structure & design, detailed understanding of Kimball & Inmon and … hybrid data warehouse design Detailed knowledge using cloud data products like Data Factory, Event Hubs, Data Lake, Synapse, Azure SQL server. Detailed knowledge in developing in Databricks and experience in coding with PySpark. Spark SQL ETL coding standards: ensuring that code more »

team reflective of society improves outcomes. We provide support for any needs or adjustments during the application process. Role Overview: As a Senior Data Engineer, your responsibilities include: Developing modern data systems and platforms to drive decision-making. Collaborating with clients to shape their data strategy. Enabling public sector organizations to adopt a data-driven approach. Owning and managing cloud infrastructure using a DevOps approach. Building data pipelines, handling various data types, and integrating error handling. Implementing data system architectures like Data Warehouse … Data Lakes, and Data Meshes. Creating reusable libraries for data pipelines and documenting end-to-end systems on a cloud environment. Adopting a robust DevOps approach and utilizing tools for DataOps. Ensuring software resilience through testing strategies and best practices. Applying SOLID, DRY, and more »

Java Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … DBT Buy-side asset management (hedge fund, asset manager, investment management) Role: Java Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Java, Python, AWS and Iceberg. If you more »

Python Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … DBT Buy-side asset management (hedge fund, asset manager, investment management) Role: Python Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Python, Java, AWS and Iceberg. If you more »

Senior Python Software Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … DBT Buy-side asset management (hedge fund, asset manager, investment management) Role: Senior Python Software Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Python, Java, AWS and Iceberg. If you more »

Senior Java Software Engineer (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial … Buy-side asset management (hedge fund, asset manager, investment management) Role: Senior Java Software Engineer (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Java, Python, AWS and Iceberg. If you more »

Permanent - Hybrid - Azure Data Engineer Azure Data Engineer required for an exciting perm opportunity. Our client, a leading property investment business are looking to hire an Azure Data Engineer to join their growing tech function. The key responsibilities are the following: Data processing, consolidation, clean-up and migration Data Transformation Azure roadmap discussions Maintain Azure Automation Runbooks. Configure virtual cloud instances and monitor backups. The key skills they are looking for are: 3+ years experience within an Azure Data Specialist position Microsoft T-SQL script skills Experience with Azure Data storage such as Azure blob storage/data lake Azure Key vault Active Directory - Azure AD SAML, Enterprise Apps A strong knowledge of databases (SQL/Oracle) Server Administration If you are looking more »