51 to 75 of 108 Permanent Data Lake Jobs in the UK

Java Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Data Engineer - London - Hybrid £60,000 - £70,000 + Package You will be responsible for the engineering of the data platform which is essential to the running and evolution of their mass participation event portfolio. This involves working with databases, coding in Python, integrating data from API's, building automated ingest and curation data pipelines, and using Azure cloud services to hydrate their core data system and downstream systems used for key business functions and analytics. You will be reporting into the Head of Data, working closely … thousands of Charities that they work with. Tech Stack: Python and SQL Demonstrable knowledge and skills in Azure Cloud Stack - Azure Data Lake, Azure Data Factory, Azure Logic Apps, Azure Function App and Azure SQL Managed Instance or Microsoft SQL Server. Skilled in T-SQL more »

elevate the unique abilities and business aspirations of customers and employees and build relationships based on trust and value. Role Overview The Principal Data Architect will have following responsibilities: Transformational Leadership: Lead and guide the development of cloud data platforms, leveraging your extensive experience to drive … innovation and change. Effective Communication: Collaborate seamlessly with C-suite executives, translating business vision into actionable data initiatives that deliver tangible value. Data Strategy Expertise: Shape robust data strategies that align with organizational goals, emphasizing business intelligence (BI) and AI/ML capabilities. Team … Building: Assemble and nurture high-performing data teams, fostering a culture of excellence and driving multi-million-pound benefits. Solution Implementation: Successfully drive complex, large-scale data solutions from concept to execution. Continuous Learning: Demonstrate a commitment to personal and team growth, staying abreast of industry more »

FT 35 hours per week Hybrid Home and Hub; London or Ashford Saga is recruiting a Lead Data Engineer for our central Data & Analytics team. You will be managing a team of Data Engineers and report directly to the Director of Data Engineering. Working as our Lead Data Engineer, youll be fully responsible for the implementation of data solutions and products within our Azure environments and technology stack. You will lead a team of Data Engineers, optimise data architecture, ensure data … Languages, here at Saga we use SQL, Phyton, R. ELT Experience Extensive experience working on large and complex projects designing and developing ELT process, DataLakes and Data Warehouses. Agile Working Experience in delivering results in an Agile way of working. Clear concise Communication, able to work with technical more »

including integration with third party systems. Architecture Development: Define the overall solution architecture for D365 CE/Power Platform projects, including system integrations, data models, security, and scalability considerations. Technical Leadership: Provide technical leadership and guidance to development teams throughout the project lifecycle, ensuring adherence to best practices … Conduct detailed requirement analysis, identify gaps, and propose appropriate d365 CE/Power Platform components and customizations to meet client needs. Integration and Data Management: Design and implement integrations between D365/Power Platform/LOB systems, leveraging connectors, APIs, and data manipulation techniques to ensure … D365/Power platform/integration. Deep understanding of relevant Azure services such as Azure logic apps, API service, Web Jobs , Data Lake, Data Factory, Synapse, and Azure Functions. Lead experience working with MS SQL Server, SSRS, SSIS, KingswaySoft and/or other prominent data more »

Technologies: Enterprise Data Architect Data Engineer Financial Services Insurance Our client, one of the worlds largest commercial insurance companies with operations in 54 countries and territories has a need for a skilled Data Architect/Data Engineer to join its London based … team. The role is 3 days onsite and 2 days remote. The role: Do you have data engineering or architecture experience within the financial services industry? If you are interested in growing your skills and career within one of the largest commercial insurers in the world, then we … functional data management solutions Hands-on experience architecting and implementing large scale multi field master data management, data lake, business intelligence, data warehouse, and data quality solutions are a must have. Experience in architecting enterprise knowledge graph capability from more »

Data Architect We are searching for an experienced Data Architect About RSM Consulting brings together multiple teams across Transactions, Risk & Consulting, ABA, and Outsourcing to provide client-centric solutions for RSM s current and future clients within the middle market. Our Consulting team has a major … empower our people to make an impact and develop their own unique career path. About the team and your role Our Digital and Data Advisory practice, as part of our broader Business Transformation client offering, consists of three teams: Digital Finance team working with clients to understand how … Data Tools (SSDT), SQL Server Reporting Services (SSRS), Azure Data Resources, Azure Data Factory, Azure Data Lake, Azure Data Bricks and Azure Analysis Services. Able to support clients and prospects in their evaluation of Business Intelligence solutions providing information more »

Job Title: AWS Data Architect Location: United Kingdom (U.K.) - Hybrid The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy dedicated to delivering exceptional value to our clients in the public sector. Our company culture promotes collaboration, autonomy, and rapid learning, empowering our … work environment focused on deliverable outcomes, along with a range of benefits to support our employees well-being and professional development. Key Responsibilities: Data Architecture Design: Collaborate with stakeholders to understand data requirements and design scalable and secure data architectures on AWS. Develop data models, data flow diagrams, and architectural documentation to support financial applications. Cloud Data Management: Design, implement, and manage cloud-based data solutions on AWS, including data lakes, data warehouses, and analytics platforms. Ensure the scalability, performance, and cost more »

a successful, dynamic, and creative global business then we want to hear from you. The Opportunity: We have an exciting opportunity for a Data Warehouse Architect to join a rapidly growing data team in Clarion. The role will report into the Senior Architect, with responsibility to … overcome complex challenges, and grow your design through developing skills with the new initiatives we are looking to explore. Key Responsibilities: Analyse existing data design and suggest improvements that promote performance, stability, and interoperability. Work with product management and business subject matter experts to translate business requirements into … Analytics platform including Azure Synaps Azure Logic Apps, Azure Functions, Azure Storage Azure SQL Data Warehouse, Azure Data Lake, Azure Databricks Azure Cosmos DB, Azure Data Factory, Azure Search, Azure Stream Analytics Delta Lake and Data Lakes Apache more »

html Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? Position: Lead Data Engineer Lead Data Management and Architecture: Spearhead the design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to build a highly scalable and robust data … efficiency, and quality. Proficiency in Microsoft Azure Data Services, including Azure SQL Database, Azure Data Factory, Azure Data Lake Storage, and Azure HDInsight. Advanced skills in SQL programming, with the ability to design, optimize, and maintain complex queries and databases. Strong experience in more »

or Contract Pay Range: Based on experience level GENERAL DESCRIPTION & RESPONSIBILITIES The Azure AI Solution Architect will lead the creation of high-value data driven solutions leveraging Cyclotron s proven implementation methodology and solutions for enterprise projects, as well as contributing to technical pre-sales activities as required. … and implementing Retrieval Augmented Generation (RAG) Information Architecture Data Modeling principles for relational and dimensional data structures Data Lake design principles, Data Virtualization Strong knowledge of data warehouse concepts and T-SQL relational/non-relational databases for data … SQL/SQL Server 2016+ (SQL, Structure, Stored Procs, Tuning) ETL/ELT, (ADF, SSIS) Data governance (Purview, Unity Catalogue) Databricks Delta Lake Storage Azure Dev OPS DESIRED SKILLS Advanced Analytics Data Technologies Databricks, Delta Lake, Synapse Spark SQL, Pyspark Azure Data more »

aspirations for strategic expansion and growth to be achieved through both organic and acquisitive means. The Role: We are currently hiring for a Data Architect, who will be accountable for architecting, enhancing, managing, and supporting a highly available, distributed, cloud data platform for Sysco International business … units and enterprise data. The Architect will collaborate with the International business units, US architecture team and Sysco 3rd party Vendors to create data solution andl ensure alignment between the international businesses in the deployment of initiatives. The role will also be the point of escalation for the … architecting enterprise-level comprehensive data management strategies, data architecture for large systems, and with the modernization of data lake/warehouse environments. Expertise in both leading and hands-on experience in data engineering and management activities such as Data more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Data Engineering Lead Salary - Circa £65,000 Are you someone with a proven track record in data engineering, ready to lead and innovate? We have an exciting opportunity for an experienced Data Engineering Manager to manage a data development team who are … responsible for delivering IT data solutions across Aviva. As demand for data continues to grow across the organisation, we are in need of an experienced team lead from a technology … background to manage development projects through the full project life cycle with specific focus on ETL/data store (data lake/warehouse) in an Amazon Web Services environment. A bit about the job: This is a great opportunity for the right technology-aware individual more »

Senior Data Engineer (No Sponsorship Available) I am seeking an experienced Data Engineer who has experience managing green field projects and implementing modern data platforms that connect business systems and data sources to drive insights through data analytics. The ideal … candidate will have experience using Azure Platforms for consolidating data sources and making them accessible to the wider business to support growth and business strategy. Must have strong communication skills and be comfortable liaising with key stakeholders and other business units to understand business needs and gather requirements. … Designing and building data infrastructure and ETL pipelines Experience with Azure Platform including Data Factory, Synapse, and Data Lake DB development experience with SQL Software development experience in relevant languages like Python or C# Experience with Data Modelling and associated tools more »

Data Architect IAM, Financial Service, Models, Big Data, Warehouses, Data Lakes, Agile, CI/CD Reference: SB/DaAr/01 Sector: Competitive Hybrid Working Town/City: London Contract Type: Contract Closing Date: 24/04/2023 Data Architect IAM … London/Hybrid Contract - 6 Months Competitive Daily Rate Our client needs an experience IAM Data Architect to work an innovative Access Management Programme for a Financial Service organisation. You will lead on Data Architect designs to create build builds data models to fulfil … the strategic data needs of the Access Management Programme in accordance with the policies and standards set out by the Chief Data Office. Must have strong recent Identity and Access Management data technologies project experience within a large Big Data environment. Must more »

team reflective of society improves outcomes. We provide support for any needs or adjustments during the application process. Role Overview: As a Senior Data Engineer, your responsibilities include: Developing modern data systems and platforms to drive decision-making. Collaborating with clients to shape their data strategy. Enabling public sector organizations to adopt a data-driven approach. Owning and managing cloud infrastructure using a DevOps approach. Building data pipelines, handling various data types, and integrating error handling. Implementing data system architectures like Data Warehouse … Data Lakes, and Data Meshes. Creating reusable libraries for data pipelines and documenting end-to-end systems on a cloud environment. Adopting a robust DevOps approach and utilizing tools for DataOps. Ensuring software resilience through testing strategies and best practices. Applying SOLID, DRY, and more »

Job Description Data Architect Salary: £90,000 - £110,000 Location: Remote/Hybrid Data Idols are working with a fast-growing technology company who are disrupting the software engineering industry. They are looking for a Data Architect with strong experience in data engineering and experience in delivering innovative solutions. The Opportunity In this role as a Data Architect, you will play a pivotal role in ensuring the efficiency of their data architecture while heading the migration from legacy systems to modern cloud solutions. You will design and build scalable database and data lake solutions, implement CICD pipelines and automate the deployment of data products into production environments. Skills and Experience Proficiency in AWS Great communication more »

Intelligent Open Commerce Platform connects FMCG Brands, Distributors, and Local Merchants on a single, equitable marketplace, empowering them with real-world insights and data to help them make better decisions. RedCloud enables FMCG Brands to seize new opportunities in emerging markets, facilitates access to more buyers & streamlines operations … manage the engineering budget, ensuring efficient allocation of resources. Technical Excellence: o Ensure the engineering team follows best practices for software development, architecture, data, security and quality assurance. o Drive the adoption of modern development tools, technologies, and processes to improve efficiency and product quality. o Facilitate technical … performance indicators (KPIs) and metrics to measure the effectiveness of the engineering team and impacts to customer. o Regularly review and analyse performance data to identify areas for improvement. o Prepare and present detailed reports on engineering activities and outcomes to senior management and the board. Data more »

are looking for an experienced, commercially-focused and passionate leader who will grow and manage the new customer analytics team as a senior data scientist. You will be building analytics models using a range of data science approaches, such as machine learning and statistical techniques, along … with wider analytical approaches such as time series and analytics with unstructured data e.g. NLP. They recently used gradient boosting machine learning to predict radio listening behaviour for a client, taking into account advertising spend. Commercial Skills The Successful Candidate Is Likely To Have: Ability to talk confidently … AWS and how to integrate R or Python analytical workflows would be highly desirable Proven track record with accessing client customer databases and data lakes Knowledge of the major secondary data-sets available, and experience of merging these to create additional insights Experience with web scraping more »

Data Engineer - Python - SQL - London - Up to £65k I'm currently working with an organisation who are globally recognised due to the nature of their work, despite only having a presence within the UK. My client are directly involved and help to organise annual events which attract every … to comprise of some of the latest and most exciting technologies on the market. The role will be responsible for engineering my clients data platform which is at the core of their business. You'll be working with a range of data sources, coding in python … Intelligence, MS Power BI, MS SQL Server, Snowflake, Python, SQL, Data Pipeline, Data Modelling, MDM, T-SQL, Data Lake, Logic Apps, Function App, London more »

working on a Remote first basis (once a month in the office on average). Senior Data Engineer - Remote First (offices in lake district) - Up to £66,000 + Great Benefits Purpose of Job Advise on and ensure the maximum return of value from the company's … Engineers. Providing Technical guidance to Data Engineers Knowledge, Experience and qualifications Excellent level of knowledge & experience in Azure Data, including DataLake, Data Factory, DataBricks, Azure SQL (Indicative experience = 5yrs+) Build and test processes supporting data extraction, data transformation, data structures, metadata, dependency and workload management. Knowledge on Spark architecture and modern Datawarehouse/Data-Lake/Lakehouse techniques Build transformation tables using SQL. Moderate level knowledge of Python/PySpark or equivalent programming language. PowerBI Data Gateways and DataFlows, permissions. Creation, utilisation more »

Proficient in using Microsoft Visual Studio, Microsoft Azure, Azure Functions, Logic Apps, Data Factories. Azure SQL, Azure BLOB Storage, Data Lake, Power BI. Proficient using DevOps and code deployments Modis International Ltd acts as an employment agency for permanent recruitment and an employment business for more »

Python Software Engineer Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager … asset classes such as Fixed Income, equities, FX or commodities Role: Python Software Engineer Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with AWS, Glue, Dremio, Snowflake, Python and Java. more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services … appreciation of asset classes such as Fixed Income, equities, FX or commodities Role: Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with AWS, Glue, Dremio, Snowflake, Python and Java. more »