76 to 100 of 105 Permanent Data Lake Jobs in London

fight financial crime, and reduce scams in online payments! The team is very early-stage, and you’d be joining as the Founding Data Engineer, working closely with the Founders who have a previous success story in FinTech. You’ll be taking very high ownership: Designing, building and … maintaining scalable and reliable data storage, processing pipelines, and analytics infrastructure. Apply your expertise in data analysis and model development: conduct experiments and build production-grade, transparent data products that drive impact for the business and our customers. About you; Proficiency with language/… tools for data processing and analytics, such as SQL, Python/Scala, Spark, Airflow, etc Strong understanding of data architectures, data modelling, and designing scalable and fault-tolerant data pipelines and data lakes/warehouses. You’ve worked with cloud more »

with one of the best leading insurance companies, in collaboration with a prestigious bank in London. We're actively seeking a talented Senior Data Engineer to enrich our … dynamic team. Responsibilities: Experience designing data models and developing industrialized data pipelines. Strong knowledge of database and data lake systems, with proficiency in Python and SQL (any flavor). Comfortable with shell scripting (e.g., Bash) and provisioning new infrastructure in leading cloud providers more »

Senior Python Software Engineer (Senior Architecture Programmer Developer Python Java Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial … Buy-side asset management (hedge fund, asset manager, investment management) Role: Senior Python Software Engineer (Senior Architecture Programmer Developer Python Java Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Python, Java and AWS. If you have more »

and Assessments regularly. Create and maintain the Security Architecture for the company and maintain network security Ensure the continual security of the sensitive data that is held within the company. 💸The salary on offer for this Lead InfoSec Engineer Role , is paying £75,000 + Benefits Package + … threats. Strong understanding of key aspects of data security including encryption methods, access management, data warehouse/data lake security etc. Experience with tools like PowerBI, Nessus, CrowdStrike and Sentinel or similar. Experience in leading internal security audits and developing and embedding comprehensive … infosec strategies across the business. Experience managing cyber incident response processes and working with specialist partners. Experience with SQL-based data warehouse solutions. Understanding of network-level security principles and practices Strong understanding of security frameworks and standards such as ISO 27001, NIST, or CIS. Relevant certifications such more »

Python Software Engineer Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager … asset classes such as Fixed Income, equities, FX or commodities Role: Python Software Engineer Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with AWS, Glue, Dremio, Snowflake, Python and Java. more »

include design and development experience with various relevant Microsoft platforms, tools, technologies, patterns, and techniques related to MSFT suites, Azure tools, integration, and data is required. Experience with industry/domains like pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred. Experience with healthcare industry regulations, data … experience using Azure integration tools like Data factory, Logic Apps, etc. Along with knowledge of utilizing Azure SQL Server, Data lake, etc. In-depth knowledge & experience using Visual Studio, with one of the programming languages: C#/Java/JavaScript/Python, and PowerShell. Thorough … Queries, Datatype conversions, etc.). Experience working with APIs, Postman/SOAPUI tools, MS D365, ServiceNow, Azure Analytics tools, Azure Synapse, Azure BYOD & Data verse, Azure DevOps, Informatica, BI tools, etc. is a big plus. General business skills: Excellent communication to translate and explain business requirements to technology more »

Senior Strategy Data & AI Manager At Centrica, our purpose is to energise a greener, fairer future. Achieving this … is made possible through our family of trusted brands and businesses. Across the Centrica group we have established a vast rudimentary data lake comprising of UK & Ireland wide customer and enterprise data for group and our trusted businesses (British Gas, Bord Gais Energy, Centrica Business … Solutions, Centrica Energy and Upstream). This data source presents a huge opportunity to create significant value for our customers, for us to build innovative products, provide new services and improve the capabilities of our Centrica employees to drive our journey as we transition towards NetZero. This is more »

Data Analyst – Full Time – London Hybrid (3 days in office, 2 days remotely) 40 hours per week As a Data Analyst at Mitie, you'll be a key player in our Compliance and Assurance team. Your role will revolve around managing data using various … data platforms and data lakes, crafting dashboards, and generating insights that are self-driven. You'll ensure that all reporting is accurate and timely. You'll also have the opportunity to review and enhance our internal processes to boost contract performance. While your role is hybrid … it may require nationwide travel and occasional stays away from home. Your main responsibilities will include providing data-led insights to improve contracts, managing systems used within the contract, and addressing any issues or queries that arise. You'll create dashboards, tables, and SQL queries/scripts for more »

time to join this ambitious team!! WHAT YOU'LL BE DOING As Senior Machine Learning Engineer, you will sit within the company's Data Science team and report to the Director of Engineering. Their Machine Learning stack runs on on-demand containerised infrastructure – ranging from sub-second latency … TECH STACK: Python, Flask, Redis, Postgres, React, Plotly, Docker. Temporal; AWS Athena SQL, Athena & EMR Spark, ECS Fargate; Azure Synapse/Data Lake Analytics, HDInsight. KEY RESPONSIBILITIES Lead the productionisation of Monolith’s ML models and data processing pipelines, both mid-low-level system and … design and exemplary hands-on implementations using Spark and other tech stacks Shape the ML engineering culture and practices around model & data versioning, scalability, model benchmarking, ML-specific branching & release strategy Concisely break down complex high-level ML requirements into smaller deliverables (epic à task) Proactively identify blockers more »

implemented by a Sales focused Cloud Architect with an ability to secure UK eDV security clearance. With Machine Learning techniques, Encryption and Big Data tools, this firm have solved a critical privacy issue that will benefit National Security and Intelligence clients across the world and is equally impactful … for other sectors, allowing private access to Neural Networks and Data sets for knowledge growth. If you are interested in delivering impactful product presentations and able to highlight mission-critical benefits of a software product, you will be highly valued in this role. You’ll need to lead … consultative selling of B2B software Demonstrable experience working with Privacy technologies such as homomorphic encryption, SMPC, Federated Learning, TEE. Any prior experience with Data management or tooling hugely beneficia (Data Lakes, Snowflake or Databricks). Experience working closely with engineering teams (particularly those working on Machine more »

projects relating to all Azure services relating to DevOps. The key responsibilities are the following: 3rd line support for Azure Dev Application Issues. data consolidation, clean-up and migration Azure roadmap discussions All Azure services for DevOps. Maintain Azure Automation Runbooks. Configure virtual cloud instances and monitor backups. … Azure specialist position Microsoft T-SQL script skills Experience with Azure Data storage such as Azure blob storage/data lake Azure Key vault Active Directory - Azure AD SAML, Enterprise Apps A strong knowledge of databases (SQL/Oracle) Server Administration If you are looking more »

Senior Data Engineer – Higher Education – 6 Months (Rolling) - London - £522.50 One of the UK’s leading higher education clients now requires a Senior Data Engineer on an initial six-month contract to improve their learning engagement platform. The Data Engineer will be predominantly responsible … for setting up and configuring a new Azure Data Lake. The ideal Data Engineer will have the following skills/experience: Proven Experience working on Azure Data Factory Previously worked with Python and SQL Previously worked with Power BI Interpersonal and Stakeholder Management Skills … position and would require you onsite 1 – 2 day(s) per week onsite at their office in London. If you’re an experienced Data Engineer looking for an exciting new opportunity with a leading Higher Education client, please apply more »

with business, change and technology resources Create business cases detailing cost, timeline and resource estimates Coordinate and participate in detailed design exercises Identify data requirements and enhancements required to the companies enterprise data model. Requirements: Experience delivering formal business projects within private equity, investment management, investment … back-office functions, and their requirements Experience designing and producing compelling analytical solutions for Investment Professionals using qualitative and quantitative measures Knowledge of data architectures, data warehouses, data lakes etc. This is a great opportunity to join a growing change team and work across more »

Job Description - Senior Data Engineer Nigel Frank International are working alongside a market leading legal firm who are on the search for an experienced Data Engineer to join their growing team. This Azure cloud focused organisation are currently having a huge focus on building out their … data centric team, which consists of Data Engineers and Analysts with great experience and enthusiastic personalities. If you are a technically sound Data Specialist with experience working alongside senior stakeholders and are confident in communicating with technical and non-technical individuals, then this is … you! Role & Responsibilities Help drive business growth through building new and developing existing relationships. Work on end to end solution delivery across Azure Data projects. Take a leading role on Azure focused work, guiding more junior members of the team and upskilling accordingly. Skills & Qualifications Strong knowledge of more »

Who we are At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in fair and equitable way. With … and business analysts you will be accountable for the results and delivery of the team, with a focus on innovation. Working in the Data and BI domain, you will gain valuable experience and progress your career, using newer technologies and defining best practices to deliver a self-service … technical debt, or other means) Occasionally, being able to lend hands-on support to the team working on and using the following technologies:Data Warehousing, Data Modelling, Database Design, ETL, AWS Redshift, SQL Server, Power BI, Cloud/DevOps AWS, Docker, Terraform, Bitbucket, Bamboo, Team City more »

Senior Azure Data Engineer (Consultancy) £70,000-£80,000 salary Hybrid (London) Immediate start One of my long-standing consultancy clients, one of the UK's leading Microsoft Solutions Partners for over 20 years and experts in digital transformation with Azure, have just reached out with an urgent … hire for a Senior Azure Data Engineer to join the team. **This is a permanent position ( no contractors will be considered ), and you must have full right to work in the UK to apply** They have a new project starting in mid-February, so are looking ideally for … interviews next week, and they are looking to have this position filled by next Friday . Essentials: Experience in a consultancy . Azure Data Engineer certification . Experience working with Dynamics 365 Experience with Azure Synapse , Data Factory , Data Lakes 4+ years as a more »

capabilities for the prospect to order, marketing, and field service Experience integrating ISVs with D365 Experience with connecting D365 with Azure data lake Expertise in understanding complex technology & applying it in a practical way to create business solutions Minimum Experience: Bachelors or advanced degree in an analytic … the ability to balance multiple demands Proven ability to write effective system and process documentation -including business and system requirements, process diagrams, and data flow charts Exceptional customer service skills follow up with clients and team members and takes the initiative to anticipate and solve problems Effective time more »

Big Data Architect - Hybrid - £120K My client is a leading trading platform that is looking to add a talented Big … Data Architect. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives. You'll be responsible for managing a remote engineering team, driving improvements in design, processes, and implementation to improve operational management, scalability, and extensibility. … The following skills/experience is essential: -Proven experience as an Architect and excellent knowledge of Big Data -Excellence experience across Azure -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc -Excellent experience of ETL, data warehousing and handling a variety more »

Big Data Architect - Hybrid - £110K My client is a global telecommunications company that are looking to add a talented Big … Data Architect. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives. You'll be responsible for managing a remote engineering team, driving improvements in design, processes, and implementation to improve operational management, scalability, and extensibility. … The following skills/experience is essential: -Proven experience as an Architect and excellent knowledge of Big Data -Great understanding of Cloud e.g. Azure and or AWS -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc -Excellent experience of ETL, data more »

Lead Big Data Engineer - Hybrid - £120K My client is a leading trading platform that is looking to add a talented Senior Big … Data Engineer You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives. You'll be responsible for managing a remote engineering team, driving improvements in design, processes, and implementation to improve operational management, scalability, and extensibility. … The following skills/experience is essential: -Proven experience as a Lead Big Data Engineer with excellent knowledge of Big Data -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc -Excellent experience of ETL, data warehousing and handling a more »

Solution Data Architect - Hybrid - £120K My client is a global telecommunications company that are looking to add a talented Solution … Data Architect. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives. You'll be responsible for managing a remote engineering team, driving improvements in design, processes, and implementation to improve operational management, scalability, and extensibility. … The following skills/experience is essential: -Proven experience as an Architect and excellent knowledge of Big Data -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc -Excellent experience of ETL, data warehousing and handling a variety of data more »

Hands on Experience as a software engineer in a globally distributed team working with Scala, Java programming language (preferably both) Experience with big-data technologies Spark/Databricks and Hadoop/ADLS is a must Experience in any one of the cloud platform Azure (Preferred), AWS or Google … Experience building data lakes and data pipelines in cloud using Azure and Databricks or similar tools. Spark Developer certification from any of (Databricks, MAPR, Cloudera or Hortonworks) is added advantage but not required Practice with Unix command line tools Familiarity working with agile methodology Strong database … and data analysis skills A history of producing secure and clean code that is stable, operational, consistent and well-performing Methodology know-how to ensure that project deliverables meet industry best practices Strong analytical, problem-solving, and synthesizing skills (know how to figure things out) Keen to develop more »

A global leader in the design, marketing and distribution of premium lifestyle products is seeking a customer data platform product manager, to join their global customer insights team. You will be responsible for leading the development of their customer data platform. The ideal candidate will understand … customer facing businesses, have ROI-driven digital marketing acumen, be data fluent, and play a pivotal role to bridge the gap between business and technical teams. Responsibilities: Bridge the gap between the business and IT; ensure all requirements are documented, understood, and delivered. Own customer data … and EMEA, managing best practice communication and guidelines. Serve as the first point of contact for platform-related questions and support resolution of data issues. Understand consumer privacy regulations like GDPR and work with DPO, legal, engineering, and marketing teams to ensure compliance. Work to define data more »

with Architecture decisions and strategy Requirements: TypeScript/JavaScript, Node.js, and React. Strong database skills (SQL) and RESTful API design experience. Working with data pipelines and data architecture Desired Skills: Experience with Python. Familiarity with AWS and Data Platforms Knowledge of Enterprise SaaS development … data lakes like snowflake This is a role that would be great for a Software Engineer that wants to drive the architecture for a product that has the potential to make a huge impact across this particular sector. Must be eligible to work in the UK and be more »

The role We are looking for a Senior Data Scientist to help us improve our FlexiPay Acquisitions. Who are we? Our mission is to build the place where small businesses get the funding they need to win. We do this by uniting cutting-edge data and … and other lifecycle management. Work with our Collections and Technology teams to help set up appropriately automated collections processes. Provide requirements to our data team to ensure all necessary data for analysis on FlexiPay is suitably stored within our data lake. Proactively problem solving more »