176 to 200 of 254 Permanent Data Lake Jobs

Job Title: Data Analyst Location: Devon (2 days per week in the office - this is not fully remote role) Salary: up to £40k About Us: If you are passionate about data, this is an incredibly exciting time to join our team. We are in a period … of transformation as we build our all-new Azure data lake. Leveraging the vast amounts of data captured from our tech, we deliver cutting-edge analytics that drive change across the businesses we serve. We are seeking a dynamic Data Analyst/Scientist to … join our team and help shape the future of our data capabilities. Role Overview: As a Data Analyst/Scientist, you will work as part of our data team, reporting to our Lead Data Analyst/Scientist. You will be responsible for more »

Lead Data Engineer A brand new and exciting opportunity has recently arisen for a Lead Data Engineer with an excellent knowledge in ETL, Azure Data Factory, Azure Databricks and CRM Implementations to join one of the UK's Largest Charity based in London. As … the Lead Data Engineer you will be implementing a new CRM (Salesforce) and also leading the migration to Azure. This is an excellent opportunity for an Lead Data Engineer who is looking to work for the Largest UK Charity who are working on exciting projects and … this is the perfect opportunity for you! Skills that are required for a Lead Data Engineer are: Experience in Azure (ADF and Datalake) Experience working with ETL pipelines Previous experience Managing or Mentoring Engineers CRM Implementation experience Lead Data Engineer/Senior Data Engineer more »

SENIOR DATA ENGINEER (EU Remote Opportunity) Xcede are delighted to be working with a very exciting Web3/Blockchain organisation with a remote working culture. Their company makes life easier for organisations in the Web3 space by providing managed services across a range of operational tasks and responsibilities … in one space. As a Senior Data Engineer in the company, you will have several clear tasks that are essential to the smooth running of processes that make this Product so unique. Responsibilities Design and implement both batch & stream Data Pipelines around the data stores & data lake. Lead by example, always aiming to work towards software engineering best practice and disaster prevention (rather than recovery). Maintain and optimise the infrastructure across the company. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years more »

time to join this ambitious team!! WHAT YOU'LL BE DOING As Senior Machine Learning Engineer, you will sit within the company's Data Science team and report to the Director of Engineering. Their Machine Learning stack runs on on-demand containerised infrastructure – ranging from sub-second latency … TECH STACK: Python, Flask, Redis, Postgres, React, Plotly, Docker. Temporal; AWS Athena SQL, Athena & EMR Spark, ECS Fargate; Azure Synapse/Data Lake Analytics, HDInsight. KEY RESPONSIBILITIES Lead the productionisation of Monolith’s ML models and data processing pipelines, both mid-low-level system and … design and exemplary hands-on implementations using Spark and other tech stacks Shape the ML engineering culture and practices around model & data versioning, scalability, model benchmarking, ML-specific branching & release strategy Concisely break down complex high-level ML requirements into smaller deliverables (epic à task) Proactively identify blockers more »

Innovative music client now requires a Data Administrator to join their team and support the day-to-day management of their data processes. This role will support critical functions, ensuring the accuracy and efficiency of our client’s data operations. Key Responsibilities: Oversee the … management of data ensuring daily files are delivered and processed. Monitoring the availability of data within our client’s data lake. Timely analysis and reporting in reference to our client’s data processes. Maintenance of data tables, ensuring they are … ad hoc basis. Identify and analyse where processes can be improved/additional checks could be made. Key Requirements: Strong experience as a Data Administrator working with complex data lakes. Solid SQL experience. (Tableau experience is desirable). Experience with Cloud technologies is desirable (AWS/ more »

Innovative music client now requires a Data Administrator to join their team and support the day-to-day management of their data processes. This role will support critical functions, ensuring the accuracy and efficiency of our client’s data operations. Key Responsibilities: Oversee the … management of data ensuring daily files are delivered and processed. Monitoring the availability of data within our client’s data lake. Timely analysis and reporting in reference to our client’s data processes. Maintenance of data tables, ensuring they are … ad hoc basis. Identify and analyse where processes can be improved/additional checks could be made. Key Requirements: Strong experience as a Data Administrator working with complex data lakes. Solid SQL experience. (Tableau experience is desirable). Experience with Cloud technologies is desirable (AWS/ more »

CENTRAL LONDON – HYBRID (3 DAYS A WEEK) £50,000 - £70,000 A great opportunity for a BI Engineer to bridge the gap between Data Engineering and BI reporting at an asset management firm expanding their data and analytics team. THE COMPANY Join a forward-thinking asset … returns. With a focus on secured loans, high-yield bonds, and structured credit, they operate at the forefront of the financial markets, leveraging data and analytics to drive informed decision-making. THE ROLE AND RESPONSIBILITIES As a BI Engineer, you will be responsible for supporting data … fast-paced environment, working with cutting-edge technologies such as Alteryx, Tableau, SQL, and Python. Responsibilities: Contribute to the setup and maintenance of data infrastructure, including data lakes, warehouses, and SQL Server databases. Utilize your technical expertise in SQL and Python to extract, transform, and analyse more »

AWS, Azure). o Experience with microservices architecture, APIs, and integration patterns. o Proficiency in security architecture and best practices. o Familiarity with data architecture, including data warehousing, data lakes, and big data technologies. o Full Stack Development: Strong background in both more »

of cloud platforms (AWS, Azure). Experience with microservices architecture, APIs, and integration patterns. Proficiency in security architecture and best practices. Familiarity with data architecture, including data warehousing, data lakes, and big data technologies. Full Stack Development: Strong background in both front more »

looking for someone to help lead the team in this transition. The right person will be both technically capable of working within a Data environment as well as leading a team of BI Developers. The role is suited for a creative and driven individual who can effectively take … making process Work with management to develop the reporting system Develop ETL processes using Kimball methodology Key skills Microsoft Azure, Synapse, Data lake SQL PowerBI Proven experience of leading a team What’s on Offer Up to £60k Salary + Pension Hybrid working -3 days on site more »

Senior Azure Data Engineer (Consultancy) £70,000-£80,000 salary Hybrid (London) Immediate start One of my long-standing consultancy clients, one of the UK's leading Microsoft Solutions Partners for over 20 years and experts in digital transformation with Azure, have just reached out with an urgent … hire for a Senior Azure Data Engineer to join the team. **This is a permanent position ( no contractors will be considered ), and you must have full right to work in the UK to apply** They have a new project starting in mid-February, so are looking ideally for … interviews next week, and they are looking to have this position filled by next Friday . Essentials: Experience in a consultancy . Azure Data Engineer certification . Experience working with Dynamics 365 Experience with Azure Synapse , Data Factory , Data Lakes 4+ years as a more »

across various Salesforce technologies. Familiarity with Agile/Kanban methodologies. Proven track record in reporting and case management strategy. Exposure to data lake and financial application environments. Apply Now : If you're ready to embrace this exciting challenge and drive transformation within a dynamic organization, seize this more »

that a truly decentralized future is the best option for our species as we advance. Our core product, the risk rating protocol, uses data found on blockchains, primarily token balances and transactions, to assess the risk of a crypto asset. The purpose of such risk rating is to … enable your immigration to the UK. Job Description : Xerberus is a risk rating protocol; a crucial part of this protocol is to collect data from validators. The protocol combines various technologies but is fundamentally built on the substrate framework. This is no easy undertaking, and you must have … responsibility will be building the on-chain presence of Xerberus. Qualifications and Skills Must haves: Extensive experience with Google Cloud Profound understanding of data lakes Profound understanding of large data sets and data transformation Additionally plus points: Experience with Agile, DevOps, and CICD frameworks more »

team. Job title: Head of Integrations Job type : Full time, Permanent Location: London - Hybrid Qualifications Significant experience of implementing an Enterprise Service Bus, Data lakes and design patterns. Experience with Azure Experience managing a team Experience of automating tasks using Azure Dev-Ops, Terraform, PowerShell, Puppet, C# or more »

A global leader in the design, marketing and distribution of premium lifestyle products is seeking a customer data platform product manager, to join their global customer insights team. You will be responsible for leading the development of their customer data platform. The ideal candidate will understand … customer facing businesses, have ROI-driven digital marketing acumen, be data fluent, and play a pivotal role to bridge the gap between business and technical teams. Responsibilities: Bridge the gap between the business and IT; ensure all requirements are documented, understood, and delivered. Own customer data platform development and product roadmap, promoting its value proposition and communicating new features to internal stakeholders. Manage customer data platform implementation process Partner and collaborate with regional customer insight teams in US and EMEA, managing best practice communication and guidelines. Serve as the first point of more »

the team guiding and leading the python competency within LGIM The increased popularity in Python, creating technical solutions and automating financial processes and data flows has become essential to teams across the business. This multi-faceted role will involve building financial products, advising teams on technical decisions across … technical stakeholders Passionate about continuous development and learning Experience working with front-end languages (e.g. JavaScript, React, HTML, CSS) Experience working with big data and/or data lakes Whatever your role, we reward performance and behaviour with a package that looks after all the things more »

My client are looking for a talented and motivated Big Data Architect (Azure, Databricks, Spark) to be based … in their London office. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives, as they provide increasing numbers of services to consumers across multiple digital channels. You'll be responsible for managing a remote engineering team of …/experience is essential: Strong implementation experience using Spark and Databricks Strong Cloud experience (ideally Azure) Previously heavily involved in an implementation programme Data Warehouse Strong stakeholder management experience Excellent IT background, ideally within Telco/Wireless service providers but not essential Salary: Excellent + bonus + package more »

We are unable to sponsor for this permanent Full time role* *Position is bonus eligible* Prestigious Enterprise Company is currently seeking an Enterprise Data Architect with Azure Cloud and MDM experience. Candidate will be responsible for developing data architecture plans and driving the plans to fruition … in collaboration with business and IT. You will play a key role in driving a number of data and analytics initiatives including: cloud data transformation, data governance, data quality, data standards, CRM, MDM, Generative AI and data science. … with cloud data technologies such as Azure data factory, Azure Data Fabric, Azure storage, Azure data lake storage, Azure data bricks, Azure AD, Azure ML etc. Experience with big data technologies such as Cloudera, Spark, Sqoop, Hive more »

NO SPONSORSHIP DATA ARCHITECTURE SALARY: $161K - $200K plus 12% bonus LOCATION: Remote except in : California, Delaware, District of Columbia, Kentucky, New Hampshire, New Jersey, New York, Pennsylvania, Vermont, West Virgina You will be developing data architecture plans for cloud data transformation, data governance, data quality, data standards. CRM MDM generative AI and data science Microsoft azure Real Time integration ETL data warehousing data catalog analytics BI operation datastores azure data bricks azure AD azure ML cloud era Spark … with cloud data technologies such as Azure data factory, Azure Data Fabric, Azure storage, Azure data lake storage, Azure data bricks, Azure AD, Azure ML etc. Experience with big data technologies such as Cloudera, Spark, Sqoop, Hive more »

Enterprise Data Architect Salary: Open + bonus Location: Remote *We are unable to provide sponsorship for this role* Qualifications 12+ years of relevant experience Strong cloud data architecture knowledge (preference for Microsoft Azure) Experience developing architecture strategies and plans to enable cloud data transformation … MDM, data governance, and data science capabilities. Design reusable data architecture and best practices to support batch/streaming ingestion, efficient batch, Real Time, and near Real Time integration/ETL, integrating quality rules, and structuring data for analytic consumption by end … with cloud data technologies such as Azure data factory, Azure Data Fabric, Azure storage, Azure data lake storage, Azure data bricks, Azure AD, Azure ML etc. Experience with big data technologies such as Cloudera, Spark, Sqoop, Hive more »

consulting services elevate the unique abilities and business aspirations of customers and employees and build relationships based on trust and value. The Lead Data Architect will design and implement solutions using a range of AWS infrastructure, including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, RDS, Athena, Kinesis … Quicksight. We also widely use other tech such as Snowflake, DBT, Databricks, Informatica, Matillion, Airflow, Tableau, Power BI etc. The Lead Data Architect will liaise with clients to define requirements, refine solutions and ultimately hand over to our own Managed Service Teams or to our clients own technical … learn new things and share our ideas, so that clients get the best return on their investments. Essential experience: Shaping & designing solutions (notably data analytics, data integration, data platform) Driving the performance of assurance activity to delivery appropriate quality Leading the production of solutions more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Python Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Data Platform Manager Location: dmg::media Headquarters – London Position: Permanent Package Description Our benefits package increases the longer you’ve been with us. Here’s what to expect: 25 days’ holiday (increasing by 1 per year up to a total of 30) Upon joining you will be automatically … many other benefits…. Job Introduction DMG:Media own some of the world’s biggest news brands, and as such processes billions of data points every month in order to provide insights and targeting criteria for teams and stakeholders as part of our ambition to be the world … Required Demonstrable experience of working with Databricks Demonstrable experience with and knowledge of Azure components - Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure Synapse etc. Demonstrable experience in Azure Devops/any relevant tools. Experience in any IAC tools. Bachelor's degree in more »

Role: Data Modelling Job Type: Permanent Location: London (Hybrid) Ready to utilize your Data analysis and Investigatory skills ? Are you passionate about RDBMS systems and converting data requirements into logical models and physical solutions? We have an exciting role for you as a Data … the future of technology. with some of the brightest global minds in the industry. access to endless learning opportunities. The Role As a Data Modeler, you will utilise your analytical skills to design, implement and create conceptual, logical, and physical data models. Key responsibilities: modelling standards … to convert data requirements into logical models and physical solutions. with data warehousing solutions (e.g. Snowflake) and data lake architecture, Azure Databricks/Pyspark & ADF. retail data model standards - ADRM. communication skills, organisational and time management skills. to innovate, support change more »