451 to 475 of 530 Data Lake Jobs

Software/Data Engineer – Python | C# | Cloud Data Platforms Location: City of London (hybrid – 2–3 days in office) Type: Full-time, permanent Sector: Investment Management We are looking for a Software/Data Engineer to join a growing team focused on transforming core … technology systems and data pipelines within a leading investment management environment. This is a hands-on role involving the modernisation of market data processes, resolution of production issues at the root cause, and delivery of reliable, scalable solutions. You will be joining a collaborative team tasked … with replacing legacy infrastructure and delivering long-term improvements across data platforms and critical operational systems. Key Responsibilities Rebuild and optimise Python-based data pipelines, improving performance, reliability and scalability. Investigate and address root causes of recurring production issues. Enhance data throughput and system More ❯

include design and development experience with various relevant Microsoft platforms, tools, technologies, patterns, and techniques related to MSFT suites, Azure tools, integration, and data is required. Experience with industry/domains like pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred. Experience with healthcare industry regulations, data … experience using Azure integration tools like Data factory, Logic Apps, etc. Along with knowledge of utilizing Azure SQL Server, Data lake, etc. In-depth knowledge & experience using Visual Studio, with one of the programming languages: C#/Java/JavaScript/Python, and PowerShell. Thorough … Queries, Datatype conversions, etc.). Experience working with APIs, Postman/SOAPUI tools, MS D365, ServiceNow, Azure Analytics tools, Azure Synapse, Azure BYOD & Data verse, Azure DevOps, Informatica, BI tools, etc. is a big plus. General business skills: Excellent communication to translate and explain business requirements to technology More ❯

Overview: 3 contract data engineers to supplement existing team during implementation phase of new data platform. Main Duties and Responsibilities: Write clean and testable code using PySpark and SparkSQL scripting languages, to enable our customer data products and business applications. Build and manage data … a structured, trackable and safe manner. Effectively create, optimise and maintain automated systems and processes across a given project(s) or technical domain. Data Analyse, profile and plan work, aligned with project priorities. Perform reviews of code, refactoring where necessary. Deploy code in a structured, trackable and safe … manner. Document your data developments and operational procedures. Ensure adherence to data/software delivery standards and effective delivery. Help monitor, troubleshoot and resolve production data issues when they occur. Contribute to the continuous improvement of the team. Contribute to the team's ability More ❯

Data Ops Engineer Job Description Do you have experience with Microsoft Azure and a passion for data operations? We are looking for a Data Ops Engineer to join our team and help optimize our cloud-based data operations and pipelines. You will … work closely with our Data Engineering and Design teams to ensure the reliability, scalability, and efficiency of our data solutions on Azure. About the company You will be part of an international organization with a strong focus on sustainability, technological innovation, and long-term growth. Their … structure. They operate globally with a clear vision: to create a positive and lasting impact on both people and the planet, driven by data-based decision making. Key Responsibilities: Data Operations & Monitoring • Ensure the availability and performance of Azure solutions (Data Factory, Synapse, SQL More ❯

will develop end-to-end ETL processes with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc. You will use Scrum methodology, and be part of a high performance team You will document your solutions in More ❯

digital analytics, technologies and tools to integrate, digitalise and analyse fragmented, complex processes - turning them into simplified, actionable information. And as a result, data is transformed into intelligence for the right people, in the right place, at the right time. By bringing clarity to risks, we empower teams … mitigate risks across the entire organisation. We do this by helping them to: Transform current business processes into fully digitalised applications to collect data efficiently. Bring data to life by integrating operational processes with culture, risks, and incidents throughArtificial Intelligence (AI) and Machine Learning (ML). … feedback from leadership, project teams, and clients based on project delivery. Channel feedback and market requirements for continuous improvement. Leverage dss+ data lake to derive thought leadership content. Collaborate with dss+ Marketing team to manage internal and external marketing efforts across various channels. Who you are With More ❯

We're looking for a Data & AI Solution Architect who's passionate about leveraging advanced technologies to shape intelligent, future-proof ecosystems in leading European consulting and project management firm. Join our client's international team, bringing innovation and sustainable value to complex projects across Europe. Location: Remote … 75K RESPONSIBILITIES ️ Client Discovery: Engage with stakeholders to understand their business, technical environments, and digitalization goals. AI-Driven Solutions: Design scalable, cloud-based data & AI architectures tailored to the needs of the Real Estate and Construction sectors. Technical Advisory: Guide clients in areas like predictive analytics, data lakes, IoT integration, and generative AI use cases. Tech Stack Leadership: Support the definition and implementation of modern tech stacks, including data platforms and MLOps pipelines. Innovation Strategy: Drive future-ready data initiatives, focusing on sustainability, operational excellence, and smart infrastructure. Internal Collaboration: Work More ❯

A prestigious organization based in London is seeking a dynamic and versatile Data Engineer/Analytics Engineer to contribute to the development, enhancement, and management of their data systems, pipelines, and reporting infrastructure. This role will focus on designing and maintaining efficient data pipelines … while building a scalable data warehouse architecture. A major aspect of this position will involve integrating new data sources to create a unified Single Customer View. Additionally, collaboration with the Analytics and Insights teams is essential to ensure they have seamless access to the necessary data … evolve the Single Customer View to consolidate data from various sources. Demonstrate hands-on experience with Microsoft Azure technologies (including Synapse Analytics, Datalake, Azure SQL), as well as familiarity with DevOps and GitHub practices. This role could accommodate 1 visit a month/fully remote for the right More ❯

Pro currently has an exciting opportunity for a motivated and detail-orientated individual to join its Insurance Services team as a Data Analyst within the Digital Services area. The job holder will be involved in building data mapping processes for various bordereaux (both Risk and Claims … using data ingestion/analysis tools such as Intrali, Quantemplate or Matillion. The project centres on the extraction, transformation and loading (ETL) of data from various sources into data warehouses and data lakes. This is the perfect role for an aspiring Data … Liverpool office. This vacancy however is suitable for an individual who is fully remote and we support home working. Main Duties and Responsibilities Data collection and processing; gathering data from various sources, pre-processing and preparing datasets for analysis. Creation and management of both Risk and More ❯

promise of AI. GX has built specialised knowledge AI assistants for the banking and insurance industry. Our assistants are fed by sector-specific data and knowledge and easily adaptable through ontology layers to reflect institution-specific rules. GX AI assistants are designed for Individual Investors, Credit and Claims … professionals and delivering 10x improvements by supporting them in their day-to-day tasks. Responsibilities: Helping to architect, design, implement, and optimise our data ingestion, transformation, and spreading pipelines and processes. Developing data models, processing pipelines, and back-end services supporting the data science … building integrations, and analytics. Desired skills: A university degree in Mathematics, Computer Science, Engineering, Physics or similar. 5+ years of relevant experience in Data Engineering, warehousing, ETL, automation, cloud technologies, or Software Engineering in data related areas. Ability to write clean, scalable, maintainable code in Python More ❯

with vehicle telematics, connected car platforms, or automotive retail solutions (e.g., Dealer Management Systems). Data & Analytics: Exposure to data lake/warehouse solutions, real-time analytics, or ML pipeline architectures. TOGAF or Other Enterprise Architecture Framework: Certification or hands-on experience applying enterprise-wide More ❯

Architect looking to make your mark in the banking sector? Our client is seeking an enthusiastic and skilled individual to join a critical data remediation programme within the Markets Platform Surveillance Team. This is a fantastic opportunity to contribute to a dynamic environment and enhance the organization's … As a Solutions Architect, you will play a pivotal role in improving our CI/CD platform and ensuring the seamless integration of data into our surveillance systems. Your expertise will help shape the future of our data handling and surveillance efforts. Key responsibilities include: Data Integration : Pulling data into the surveillance system from various sources, including data lakes and data warehouses on Google Cloud Platform (GCP). Platform Enhancement : Improving the CI/CD platform using Terraform and ensuring efficient deployment processes. Pipeline Tracking : Utilizing tools like More ❯

will be responsible for a range of backend systems such as Software applications that include areas such as: Payment Gateway, Settlement, Transaction Fraud Monitoring, Datalake Service and the Core Banking System. You will oversee their deployment, development, enhancements and production operations. You should have extensive experience and skills in Software More ❯

ability to design, develop, and deploy cutting-edge artificial intelligence and machine learning solutions on cloud platforms. You will be familiar with big data tools and technologies for handling large datasets and have hands-on experience with cloud providers like Google Cloud Platform (GCP) . Responsibilities: Utilise cloud … e.g. ) to build and deploy scalable AI solutions. Process and analyse large datasets to train and evaluate AI/ML models. Collaborate with data scientists to optimise model performance and accuracy. Develop and maintain AI/ML pipelines for data ingestion, processing, and model training. Integrate … advancements in AI/ML and cloud technologies. Contribute to the development of AI/ML strategy and best practices. Requirements: Knowledge of data structures, algorithms, and software design principles. Experience with machine learning frameworks: Preferably hands-on experience with cloud platforms (GCP) and their AI/ML More ❯

bottom , and Apollo GraphQL sits in the middle. We keep our data in DynamoDB , Postgres and snowflake for our data-lake using one or the other as best suits a particular workload. You can learn more about our tech stack at While we're looking More ❯

Urgent contract - outside IR35 💥 🤓 Staff Data Scientist ⌨️ Python, GCP, Spark, PyTorch 🌍 London 1 day per week 🗓️ Initial 3 months, likely to extend to 4/5 months ⏰ Starting on Monday 16th June **This role is paying £500-£600 per day, outside IR35** Consultative project, coming … in to audit & assess the newly built platform. Utilise data to understand potential ROI. Customer centric B2C. Incredibly large data lake with 20m+ unique users. This is super clean, slick & well written. Very important for this one that we engage someone with strong business logic More ❯

Our team here at MRJ is delighted to bring to market a brand-new opportunity. ROLE: Head of Data (Analytics & Engineering) This expanding group (4000+ employees) continues to defy their market with sustained growth and has recently embarked on a buy and build strategy following a major investment … years ago. A brand-new role working closely with the CTO, you’ll be responsible for building and leading a small team of data engineers and analysts shaping and delivering data products that support better decision-making across the business. Whether it’s building modern data … CRM dashboards, you’ll be driving innovation in a company that’s big on insights, automation, and making things work smarter. Head of Data – Key Responsibilities: Defining & Delivering Data Products: Lead the development of enterprise-level data & analytics products, ensuring strategic alignment with business More ❯

Our team here at MRJ is delighted to bring to market a brand-new opportunity. ROLE: Head of Data (Analytics & Engineering) This expanding group (4000+ employees) continues to defy their market with sustained growth and has recently embarked on a buy and build strategy following a major investment … years ago. A brand-new role working closely with the CTO, you’ll be responsible for building and leading a small team of data engineers and analysts shaping and delivering data products that support better decision-making across the business. Whether it’s building modern data … CRM dashboards, you’ll be driving innovation in a company that’s big on insights, automation, and making things work smarter. Head of Data – Key Responsibilities: Defining & Delivering Data Products: Lead the development of enterprise-level data & analytics products, ensuring strategic alignment with business More ❯

Urgent contract - outside IR35 Staff Data Scientist ⌨️ Python, GCP, Spark, PyTorch London 1 day per week ️ Initial 3 months, likely to extend to 4/5 months ⏰ Starting on Monday 16th June **This role is paying £500-£600 per day, outside IR35** Consultative project, coming … in to audit & assess the newly built platform. Utilise data to understand potential ROI. Customer centric B2C. Incredibly large data lake with 20m+ unique users. This is super clean, slick & well written. Very important for this one that we engage someone with strong business logic More ❯

deploy state-of-the-art models (eg, deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. Collaborate closely with product, design, and DevOps to integrate AI features into our platform. Continuously evaluate new … team as we scale beyond our seed round. Key Responsibilities 1. Architecture & Hands-On Development Define and implement end-to-end AI pipelines: data collection/cleaning, feature engineering, model training, validation, and inference. Rapidly prototype novel models (eg, neural networks, probabilistic models) using PyTorch, TensorFlow, JAX, or … a multi-quarter AI roadmap aligned with product milestones and fundraising milestones. Identify and evaluate opportunities for AI-driven competitive advantages (eg, proprietary data, unique model architectures, transfer/few-shot learning). Collaborate with business stakeholders to translate big problems into technically feasible AI solutions. 3. Data More ❯

Overview This role is critical to the success of the digital services strategy, cloud infrastructure, and overall data platform. Sitting within the broader Digital Client technology team, this hire will focus on improving release and support processes, and enhancing infrastructure performance, supportability, scalability, and cost efficiency. This person … using Azure Python SDK, Terraform , and GitHub Runners Expertise in automating serverless PaaS solutions (Azure App Services, Databricks , Cosmos DB, SQL, Data Lake, HDInsight) Proficient in writing Azure Resource Manager (ARM) templates and Terraform scripts Understanding of cloud security (RBAC, audit logging, authentication) Experience troubleshooting network and More ❯

Overview This role is critical to the success of the digital services strategy, cloud infrastructure, and overall data platform. Sitting within the broader Digital Client technology team, this hire will focus on improving release and support processes, and enhancing infrastructure performance, supportability, scalability, and cost efficiency. This person … using Azure Python SDK, Terraform , and GitHub Runners Expertise in automating serverless PaaS solutions (Azure App Services, Databricks , Cosmos DB, SQL, Data Lake, HDInsight) Proficient in writing Azure Resource Manager (ARM) templates and Terraform scripts Understanding of cloud security (RBAC, audit logging, authentication) Experience troubleshooting network and More ❯

in designing data models. SQL knowledge. Experience with software testing (preferably Cucumber) Experience with application integration (API, ActiveMQ, Kafka, data lake, etc.). Experience with object-oriented languages (preferably JAVA and C#). Experience with cloud services and CICD (preferably GitHub and OpenShift). Experience … For the complete overview of all terms and conditions of employment, please visit Conditions - Werken bij Schiphol Group. About the Team The IT & Data organization is building the airport of the future. We do this with smart digital solutions, tools, and applications. With the latest technology, we keep … the airport running smoothly. Our enthusiastic team works on data-driven improvements to our processes, passenger flows, and information provision. This helps to provide the best possible experience for travelers, customers, and employees, both on and around the airport. Choose your destination What are your talents? What dreams More ❯

in designing data models. SQL knowledge. Experience with software testing (preferably Cucumber) Experience with application integration (API, ActiveMQ, Kafka, data lake, etc.). Experience with object-oriented languages (preferably JAVA and C#). Experience with cloud services and CICD (preferably GitHub and OpenShift). Experience … the complete overview of all terms and conditions of employment, please visit Conditions - Werken bij Schiphol Group . About the Team The IT & Data organization is building the airport of the future. We do this with smart digital solutions, tools, and applications. With the latest technology, we keep … the airport running smoothly. Our enthusiastic team works on data-driven improvements to our processes, passenger flows, and information provision. This helps to provide the best possible experience for travelers, customers, and employees, both on and around the airport. Choose your destination What are your talents? What dreams More ❯

Full-time | 6-Month Contract We're looking for a Senior BI Developer to join a leading insurance firm on a high-impact data project. You’ll build scalable Power BI solutions, enable actionable insights, and ensure customers can pursue their financial goals through clean, intelligent reporting. Key … Responsibilities: Deliver robust BI solutions using Power BI, including semantic modelling and DAX Analyse, transform, and visualise complex data sets using SQL and/or Python Produce and maintain governance documentation (data lineage, dictionaries, architecture mapping) Collaborate within agile teams to support delivery of key business … pressure with senior stakeholders Comfortable in agile, fast-paced delivery environments ⭐ Desirable: Insurance sector experience Familiarity with cloud platforms (Azure, AWS, GCP) Experience with DataLake/ETL tools (e.g. Databricks, Synapse, Dataiku) Documenting technical data requirements and designing data tests Qualifications: BSc or higher in Computer More ❯