201 to 225 of 284 Data Lake Jobs

technology, such as Microsoft’s Blazor Framework, you will be responsible for building various applications using Web APIs and messaging systems. From a data perspective, you will work with SQL Server using T-SQL, and there are currently plans to move to the cloud in the near future … with the following would be beneficial: Devops Automated Testing MS Logic and Power Apps AI + Machine Learning Analytics: Analysis Services, Data Lake Analytics, Data Catalog DevOps: Application Insights TypeScript, NodeJS Blazor KendoUI The Team The IT team is responsible for providing clients and staff more »

closely with key business stakeholders Experience: Around 3 years’ experience developing with SQL MSSQL, T-SQL Azure DevOps experience preferred Troubleshooting and resolving data … quality issues Documentation Advantageous: Telecoms billing systems or processes Knowledge of Java or Kotlin NoSQL Databases Experience of CRM systems Azure Data Lake/Data Pipelines This role offers a salary of up to £40,000 including generous benefits including a company bonus, remote working more »

Role: Senior Data Engineer Location: UK (Remote-first with monthly travel to London required) Recently listed as a "RegTech Top Performer" in Market Fintech's RegTech Supplier Performance Report, CUBE is pioneering the development of machine automated compliance. We are a global RegTech business defining and implementing the … change for the financial services industry. We deliver our services through a SaaS platform, powered by an innovative combination of AI and proprietary data ontology, to simplify the complex and everchanging world of compliance for our clients. At CUBE, we are creating the future and are a company … detection, classification, entity extraction, summarisation, and recommendations. Available to customers and partners as APIs and via a UI. Role mission: Establish a strong data architecture in GCP for the backend of AI/ML/DS Services supporting a SaaS product. Build cost-efficient, low latency data more »

fight financial crime, and reduce scams in online payments! The team is very early-stage, and you’d be joining as the Founding Data Engineer, working closely with the Founders who have a previous success story in FinTech. You’ll be taking very high ownership: Designing, building and … maintaining scalable and reliable data storage, processing pipelines, and analytics infrastructure. Apply your expertise in data analysis and model development: conduct experiments and build production-grade, transparent data products that drive impact for the business and our customers. About you; Proficiency with language/… tools for data processing and analytics, such as SQL, Python/Scala, Spark, Airflow, etc Strong understanding of data architectures, data modelling, and designing scalable and fault-tolerant data pipelines and data lakes/warehouses. You’ve worked with cloud more »

skilled resources and growing your career. Candidates must have the following Strong Developer experience on C# Azure, Logic Apps Database experience SQL Server Data Factory/Data Warehousing/ETL Skills required: Experience of developing technology solutions for large, complex business change programmes Experience of working … their pros and cons in the context of large organisations. Integration Architectures and patterns, including knowledge of Enterprise Service Bus. Working knowledge of data warehousing, data lakes, data migration and Big Data. Good secure coding standards such as OWASP. Auditing and monitoring approaches and more »

Senior Java Software Engineer (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial … Buy-side asset management (hedge fund, asset manager, investment management) Role: Senior Java Software Engineer (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Java, Python and AWS. If you have more »

and Assessments regularly. Create and maintain the Security Architecture for the company and maintain network security Ensure the continual security of the sensitive data that is held within the company. 💸The salary on offer for this Lead InfoSec Engineer Role , is paying £75,000 + Benefits Package + … threats. Strong understanding of key aspects of data security including encryption methods, access management, data warehouse/data lake security etc. Experience with tools like PowerBI, Nessus, CrowdStrike and Sentinel or similar. Experience in leading internal security audits and developing and embedding comprehensive … infosec strategies across the business. Experience managing cyber incident response processes and working with specialist partners. Experience with SQL-based data warehouse solutions. Understanding of network-level security principles and practices Strong understanding of security frameworks and standards such as ISO 27001, NIST, or CIS. Relevant certifications such more »

include design and development experience with various relevant Microsoft platforms, tools, technologies, patterns, and techniques related to MSFT suites, Azure tools, integration, and data is required. Experience with industry/domains like pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred. Experience with healthcare industry regulations, data … experience using Azure integration tools like Data factory, Logic Apps, etc. Along with knowledge of utilizing Azure SQL Server, Data lake, etc. In-depth knowledge & experience using Visual Studio, with one of the programming languages: C#/Java/JavaScript/Python, and PowerShell. Thorough … Queries, Datatype conversions, etc.). Experience working with APIs, Postman/SOAPUI tools, MS D365, ServiceNow, Azure Analytics tools, Azure Synapse, Azure BYOD & Data verse, Azure DevOps, Informatica, BI tools, etc. is a big plus. General business skills: Excellent communication to translate and explain business requirements to technology more »

Open Targets (OT) is a unique public-private partnership working to deliver experimental data and informatics platforms that enable researchers to make more informed decisions about target selection for drug discovery. OT is a shared initiative between the European Bioinformatics Institute (EMBL-EBI), a global leader in the … management, integration and analysis of public domain life science data; world-leading pharmaceutical companies GSK, Sanofi, Bristol Myers Squibb, Pfizer and Genentech; and the Wellcome Sanger Institute. Generative AI has revolutionised the way we interact with knowledge. To benefit from the advances in LLM technology inside Open Targets … collaborative, and international team, you will be responsible for: Developing and implementing a knowledge graph framework on top of the existing data lake to improve our data sharing and analysis pipelines to assist drug discovery user stories. Working closely with data provision and more »

You will be responsible for designing, developing, and implementing solutions using Microsoft PowerApps and overseeing the ETL processes necessary for integrating and maintaining data across our business systems. This role demands a high level of technical expertise, problem-solving skills, and the ability to collaborate with cross-functional … applications using Microsoft PowerApps. Collaborate with stakeholders to understand requirements and deliver solutions that meet business needs. ETL Processes: Handle ETL tasks for data integration, transformation, and loading between various sources and destinations. Ensure data quality and consistency across systems. Data Management: Work with … SQL databases, data lakes, and other storage solutions to manage data used within PowerApps. Implement data governance and security measures. Application Lifecycle Management: Use best practices for version control, testing, and deployment of PowerApps solutions. Monitor and optimize app performance and user experience. Collaboration more »

considerations IaaS and PaaS solutions Should have direct implementation experience - Azure Data Factory, SQL DWH , Enterprise Service Bus and Data Lake Knowledge of Power BI, SSRS, SSAS Familiarity with alternative approaches such as file transfers (sFTP), EDI (multiple standards), subscribe-publish message bus, RESTful/… SOAP APIs, XML/Jason. Familiarity with alternative tools such as Mulesoft, Informatica, SAS. Experience with systems architecture techniques including context diagram, data flow diagram, process (swim lane) diagram and entity-relationship diagram. Experience with statistical quality management techniques such as six sigma, CQI, Kaizen. Personal skills Proven more »

will love at Sidetrade As a key member of our team, you will join a technical squad composed of QA, Software Engineers, Devops, Data Scientists, and Data Engineers to take up challenges related to new functionalities, scalability, security, ergonomy, etc. You will participate in the quality … language Familiar with the issues involved in web development Understand and challenge a rich technical stack (Micro-services, High-availability, Multitenancy, Data Lake) Knowledge of Gherkin is a plus Your first 90 days... Join our Immersive Bootcamp Collaborate with the team and participate to the roadmap to more »

Cloud Architect/Data Architect Google Cloud/GCP, Machine Learning/Generative AI Remote-based or Hybrid should you prefer (London) £90k-£120k basic salary + bonus Benefits: 25 days holiday + bank holidays Private Healthcare Discounted Gym Membership (Nuffield + Hussle) Life Insurance, Income Protection, Employee … Assistance Program Pension Scheme (max 10%) We are working with an AI/Data Consultancy with core clients within the Retail, Financial Services, Gaming, SaaS sectors. The successful Cloud Architect will work with an array of technologies with clients from several industries & sectors meaning you will find your … devising innovative solutions to address their needs, defining project parameters, and supervising the execution of these projects. Role of the Cloud Architect/Data Architect: Utilising advanced data processing and cloud technologies effectively to stimulate innovation. Engaging with clients to create top-notch solutions tailored to more »

Cloud Architect/Data Architect Google Cloud/GCP, Machine Learning/Generative AI London Based - New Offices, Refurbed in the Heart of a buzzing area £90k-£120k basic salary + bonus Benefits: 25 days holiday + bank holidays Private Healthcare Discounted Gym Membership (Nuffield + Hussle) Life … Insurance, Income Protection, Employee Assistance Program Pension Scheme (max 10%) We are working with an AI/Data Consultancy with core clients within the Retail, Financial Services, Gaming, SaaS sectors. The successful Cloud Architect will work with an array of technologies with clients from several industries & sectors meaning … devising innovative solutions to address their needs, defining project parameters, and supervising the execution of these projects. Role of the Cloud Architect/Data Architect: Utilising advanced data processing and cloud technologies effectively to stimulate innovation. Engaging with clients to create top-notch solutions tailored to more »

Senior Strategy Data & AI Manager At Centrica, our purpose is to energise a greener, fairer future. Achieving this … is made possible through our family of trusted brands and businesses. Across the Centrica group we have established a vast rudimentary data lake comprising of UK & Ireland wide customer and enterprise data for group and our trusted businesses (British Gas, Bord Gais Energy, Centrica Business … Solutions, Centrica Energy and Upstream). This data source presents a huge opportunity to create significant value for our customers, for us to build innovative products, provide new services and improve the capabilities of our Centrica employees to drive our journey as we transition towards NetZero. This is more »

car fleet with c.700k vehicles, it is crucial we continue to evolve and adapt through this period. We are committed to ensuring our data and processes are successfully maintained and enhanced to keep our customers moving. We are therefore recruiting for a Data Product Owner to … purpose today and ready for the challenges of the future, providing a bridge between our operational teams and technology department and facilitating better data decision making for our customers. Reporting to the Data Product Manager, you will: Play a vital role in owning and developing the … their need’s; successfully gathering and acting on user feedback and effectively communicating on updates and issues. Become an expert in Asset Risk data systems and processes and provide business knowledge when interacting with internal stakeholders and 3rd parties. Collaborate with key business stakeholders from a variety of more »

time to join this ambitious team!! WHAT YOU'LL BE DOING As Senior Machine Learning Engineer, you will sit within the company's Data Science team and report to the Director of Engineering. Their Machine Learning stack runs on on-demand containerised infrastructure – ranging from sub-second latency … TECH STACK: Python, Flask, Redis, Postgres, React, Plotly, Docker. Temporal; AWS Athena SQL, Athena & EMR Spark, ECS Fargate; Azure Synapse/Data Lake Analytics, HDInsight. KEY RESPONSIBILITIES Lead the productionisation of Monolith’s ML models and data processing pipelines, both mid-low-level system and … design and exemplary hands-on implementations using Spark and other tech stacks Shape the ML engineering culture and practices around model & data versioning, scalability, model benchmarking, ML-specific branching & release strategy Concisely break down complex high-level ML requirements into smaller deliverables (epic à task) Proactively identify blockers more »

Senior Azure Data Engineer (Consultancy/Healthcare) £85,000-£95,000 salary Hybrid (London) One of my long-standing consultancy clients, one of the UK's leading public-sector consultancies, have landed a new project with the NHS and now are on the lookout for a Senior Azure … Data Engineer to join the team with healthcare and consulting experience. **This is a permanent position (no contractors will be considered), and you must have full right to work in the UK to apply** They are on the lookout for a Senior Data Engineer to join … their team, with experience in consulting and healthcare/NHS - and this is an urgent hire. Essentials: Experience in a healthcare sector. Azure Data Engineer certification. Experience in a consulting environment. Excellent ability building data warehouses in Azure Experience with Azure Synapse, Data Factory more »

SENIOR DATA ENGINEER (EU Remote Opportunity) Xcede are delighted to be working with a very exciting Web3/Blockchain organisation with a remote working culture. Their company makes life easier for organisations in the Web3 space by providing managed services across a range of operational tasks and responsibilities … in one space. As a Senior Data Engineer in the company, you will have several clear tasks that are essential to the smooth running of processes that make this Product so unique. Responsibilities Design and implement both batch & stream Data Pipelines around the data stores & data lake. Lead by example, always aiming to work towards software engineering best practice and disaster prevention (rather than recovery). Maintain and optimise the infrastructure across the company. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years more »

to join one of the largest media technology brands in the world and lead a major project relating to the development of their data cubes. ABOUT THE COMPANY This business is a household name in the UK and their products and services are used by millions of people … each day. They have recently completed a major migration project to a new cloud data environment and as a result are now looking to scale out their various analytics teams. ABOUT THE ROLE In this role you will join their Data insights team and be responsible … be responsible for are: Building a variety of SSAS tabular and dimensional cubes Build out Cloud cubes Work on improving current data lake processing activities Work across multiple business stakeholders to ensure that their various requirements are supported by cutting edge technical solutions Document all processes to more »

a significant sign-on bonus and increased PTO accrual. We are developing and maintaining several Next-Generation systems; including a modern data lake that ingests data from numerous sources in various formats, received at different intervals. Register for this in-person event to learn more … but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law. more »

a significant sign-on bonus and increased PTO accrual. We are developing and maintaining several Next-Generation systems; including a modern data lake that ingests data from numerous sources in various formats, received at different intervals. Register for this in-person event to learn more … but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law. more »

a significant sign-on bonus and increased PTO accrual. We are developing and maintaining several Next-Generation systems; including a modern data lake that ingests data from numerous sources in various formats, received at different intervals. Register for this in-person event to learn more … but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law. more »

a significant sign-on bonus and increased PTO accrual. We are developing and maintaining several Next-Generation systems; including a modern data lake that ingests data from numerous sources in various formats, received at different intervals. Register for this in-person event to learn more … but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law. more »

a significant sign-on bonus and increased PTO accrual. We are developing and maintaining several Next-Generation systems; including a modern data lake that ingests data from numerous sources in various formats, received at different intervals. Register for this in-person event to learn more … but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law. more »