51 to 75 of 289 Data Lake Jobs

a significant sign-on bonus and increased PTO accrual. We are developing and maintaining several Next-Generation systems; including a modern data lake that ingests data from numerous sources in various formats, received at different intervals. Register for this in-person event to learn more … but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law. more »

You will be responsible for designing, developing, and implementing solutions using Microsoft PowerApps and overseeing the ETL processes necessary for integrating and maintaining data across our business systems. This role demands a high level of technical expertise, problem-solving skills, and the ability to collaborate with cross-functional … applications using Microsoft PowerApps. Collaborate with stakeholders to understand requirements and deliver solutions that meet business needs. ETL Processes: Handle ETL tasks for data integration, transformation, and loading between various sources and destinations. Ensure data quality and consistency across systems. Data Management: Work with … SQL databases, data lakes, and other storage solutions to manage data used within PowerApps. Implement data governance and security measures. Application Lifecycle Management: Use best practices for version control, testing, and deployment of PowerApps solutions. Monitor and optimize app performance and user experience. Collaboration more »

Azure Data Engineer - SC Cleared A number of azure data engineers are required for a programme starting in June. Skills required: - Developing data pipelines for ETL/ELT processes. - Building and maintaining data warehouses and data lakes. - Implementing data integration and transformation solutions. - Ensuring data quality and integrity. - Performance tuning and optimization This role is based from home with travel to London 2 days per week. To be considered for the position please send over an updated CV. Due to the nature and urgency of more »

will include… You will be able to produce a variety of reports focusing on a range of areas, including; Security, Performance, compliance audits, data collected from various IT Systems and tools. Strong ability to maintain and develop technical documentation, including system configurations, network diagrams, operating procedures to support … clients IT Environments. You will be analysing large data-sets to identify trends, patterns and anomalies, and have the ability to extract worthwhile insight to be included in the reports. Be an SME around identifying opportunities where automation report created can be used, using scripting languages and reporting … tools to enhance efficiency and scalability. What you've got… Experienced background in Report Writing, Data Analysis, or technical documentation within the IT/Tech industry. Experience on Microsoft office applications! Particularly Excel + Word, for documenting and report writing purposes. Being confident on Azure is a must more »

Data Architect SQL, PowerBI, Azure synapse data warehouse, ETL Leading data transformation & strategy within the business Southampton based 2-3 days per week Spectrum IT has partnered with a leading green energy consultancy who supports and empowers companies with the journey to net zero. … having impacts across the education sector, parts of the NHS and within private sector companies across the UK. As part of a large Data transformation within the business they are building a new Azure synapse data warehouse and consolidating multiple forms and streams of data into 1 centralised platform. The Data architect will be a crucial part of this project helping to analyse the current data estate, identify opportunities and weaknesses then build a roadmap for the data strategy. Key Skills: Highly advanced level of SQL querying more »

Data Scientist vacancy for our … Zurich based client in the financial sector . Your tasks: Developing data infrastructure for Trading Analytics, including Databases and Data Lake Creating Machine Learning and Financial models for Trading Execution, Market Making and Sales Being responsible for data quality, including mining, cleansing, and … code and algorithms, using Python and Scala Preparing software applications, user interfaces, APIs, dashboards, and automated reports Contributing to the execution of Big Data solutions as well as presenting results from AI and financial models to stakeholders Your experience/knowledge: 4+ years of experience as a data more »

Brussels, 50% WFH. Strong written and spoken communication skills in English and proficiency in French or Dutch are a bonus. Are you a data Engineer looking for a new challenge? Our client based in Brussels embraces the flexibility of a hybrid working model, with an expectation of … on-site and 50% remote work. As a Data Engineer, you will be supporting the data team in preparing and securing data for various uses like reporting, analytics, and applications and will have a focus on IT Production activities related to data pipelines. Key Responsibilities: Design and implement the data model on the datalake. Analyse the best sources of data and define business and technical rules for integration. Prototype solutions for business validation in collaboration with IT delivery data engineers. Work with IT Delivery more »

opportunity My client is a leading Regulatory Body professional services organisation, who are looking for an experienced BI Developer to join their growing Data & Analytics … team. In this role, you will be responsible for the design, development, and management of their data warehouse and data lake environments, supporting critical reporting and analytics capabilities. Key responsibilities include: Working closely with the data and BI analysis team to design, develop … and maintain reporting and analytical solutions Identifying and resolving data issues, managing the database aspects of the reporting and analytics platforms Collaborating with database administrators to ensure optimal data warehouse performance Developing and refining reporting and analytical requirements with business analysts and project managers Ensuring data more »

Hoist Finance is a leading financial services company committed to innovation and excellence and is currently looking to recruit a Data Engineer to join their team. The purpose of the role is to integrate data from all types of sources into the Hoist Finance data platforms. Key Skills Needed: 3 years experience as a Data Engineer Intermediate knowledge of one of the popular RDBMS (e.g. SQL Server, Oracle, MySQL, PostgreSQL) Knowledge of BI Stack design and implementation Any … knowledge in some of the following areas is an advantage:- Snowflake, DBT, Azure Technologies including Azure Data Factory, Azure Data Lake, Azure DevOps, Powershell, GIT, Python. Excellent communication and interpersonal skills As a Data Engineer you will be: Developing data integration more »

We are currently seeking a Snr Data Engineer who has experience with the Azure Data stack to join the Business Intelligence team. The team is part of a wider team that includes the MS D365 implementation team (on-going project), Oracle ERP team and Digital Applications … part of the solution design About the Candidate Essential experience Experience with the following technologies Azure Synapse, Data Factory, Databricks, SQL Db, Datalake, Key Vault Azure Dev Ops and CI/CD pipelines Coding in SQL and PySpark/Python DW/Data Vault concepts Power … AP, AR etc) - Highly desirable Preferred experience Knowledge of D365 Finance module and building data models and reports from the export to Datalake functionality Working knowledge with Microsoft D365 Data (Dataverse) Integration with datalake Understanding of core Finance principles and terminology. Knowledge of Azure AI services more »

Java Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … DBT Buy-side asset management (hedge fund, asset manager, investment management) Role: Java Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Java, Python, AWS and Iceberg. If you more »

Python Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … DBT Buy-side asset management (hedge fund, asset manager, investment management) Role: Python Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Python, Java, AWS and Iceberg. If you more »

Senior Python Software Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … DBT Buy-side asset management (hedge fund, asset manager, investment management) Role: Senior Python Software Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Python, Java, AWS and Iceberg. If you more »

Senior Java Software Engineer (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial … Buy-side asset management (hedge fund, asset manager, investment management) Role: Senior Java Software Engineer (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Java, Python and AWS. If you have more »

Senior Data Architect Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to Be Yourself At Work. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that … agile and entrepreneurial culture. Your Capco Day/Key Responsibilities You will accompany and lead complex agile consulting projects supporting our clients with data architecture design and delivery. You will work with technology leaders across Financial Services to provide best practice guidance for data management and … procedures, architectures and technologies in one or more of the following topics: Contextual Datamodelling, Entity Relationship Modelling, Logical & Physical Datamodelling and Data Lake design. Experience designing and implementing cloud data migration and storage patterns on one or more of AWS, GCP and Microsoft Azure Experience more »

Job : Data Architect Salary : £80,000 - £90,000 Type : Permanent As a Data Architect, you will you will play a critical role in driving our data strategy, data architecture and designing data solutions. You will contribute and oversee the implementation … of our data strategy that supports our financial services operations by providing data architecture consultancy, collaborating with all areas of our organisation to understand business requirements and develop scalable data architectures that enable efficient data management, analytics, and integration. You will be … and their integration with data architectures. Comprehensive knowledge of data modelling, data design principles, and data lake and warehousing concepts. Leadership qualities with a collaborative and team-oriented approach. Strong analytical mindset and problem-solving abilities to address complex technical challenges. more »

Data Intelligence Platform are: • Efficiently load and transform data into a DWH • Provide advanced orchestration to use Data Lake based approach • Integration with 3rd party sources, open-source APIs • Data movement in both batch and real-time change data capture • Leverage Big Data technologies (Spark) to ingest, clean & transform data • Apply Machine Learning on DWH to proactively figure out issues and generate insights • Create dashboards in Oracle Analytics Cloud to drive decision-making Your Opportunity You will be responsible for applying your extensive … knowledge as a data engineer and building Digital Government Data Platform . Our Ideal Candidate We are looking for a strong Data Engineer who thrives on research and development projects. Be technically strong and hands-on, who works efficiently with other product groups and more »

business in the coming years. We’re looking for an engineer to help us build BPP’s platforms, products and user experiences. The Data Engineering team will enable BPP to leverage data, to inform and optimise how we deliver scalable, secure and performant experiences that delight … pipelines to extract data from various source systems (log files, APIs, databases) and load them into our data lake/data warehouse confidentially using modern data tools and technologies Transform data into highly accessible and usable structures … as AWS, GCP, Azure) Good understanding of data modelling methods and data partitioning and compaction methods in Data Lake Experience of working with event driven architectures or real time streaming analytics Confident in writing and reading code in multiple languages Possess a deep more »

Delivery Manager – Data Ops Location: Hybrid - London Package: Negotiable + Benefits Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them to provide great customer service and grow through the provision … of superior data services The Delivery Manager for Data Operations is responsible for ensuring the successful and timely delivery of data to the business. You will lead a team of Brown & Brown data specialists, manage resources, act as a bridge between data … engineering design patterns and best practice, including data pipelines. Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL Server, Azure Cosmos DB, Azure Power Platform, Power BI. The rewards: negotiable basic salary and all the normal benefits you’d more »

brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Data Engineer role sits within the Engineering team of the Data Services department responsible for all data applications across the company’s divisions globally from Big Data, Data Warehousing, Business … business hours and weekends when required You Have These: Exposure to, and ideally experience with, modern data architectures (e.g. data lake, lake house, data mesh) and accompanying technologies (e.g. Azure Synapse, Snowflake, Amazon Redshift) Awareness of data governance and all more »

Purpose of Position Pantheon require a passionate hands-on Data Support Engineer to support the delivery of change to existing systems as well as conduct analysis for root cause & software issues. Pantheon is at the start of a multi-year programme to establish itself as a data … technologies (ETL, SQL Database, Reporting) Knowledge of Dimension Modelling Strong SQL skills, experience in writing complex SQL queries Knowledge of Azure Data Lake, Data Factory, Databricks and Functions Essential Experience Experience in supporting traditional Data Warehouses Exposure in building Azure based data ingestion and transformation pipelines, data lake, data warehouse/data marts etc. Experience working with Agile development methodologies such as Kanban/Scrum A natural problem-solving attitude. Conversant with current industry and technology trends. Experience with dealing directly with stakeholders more »

brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Lead Data Engineer role sits within the Data Services department, you will work actively to unlock the value of data by building and enabling product teams and data practitioners to use the … and needs assessment. You Have These: Team management experience Exposure to, and ideally experience with, modern data architectures (e.g. data lake, lake house, data mesh) and accompanying technologies (e.g. Azure Synapse, Snowflake, Amazon Redshift) Awareness of data governance and all more »

What can you expect as a Senior Data Engineer... Working for a respected Microsoft Solutions Partner that will help you gain Microsoft certifications; Joining a rapidly expanding and innovative organisation with exciting plans for 2024, that will give you the freedom to grow as an Azure Data … Working with clients across various industries on exciting projects that will see you utilising the latest products within the Microsoft Azure and SQL Data analytics stack; A flat hierarchy and no-door policy. You won’t have a “manager” but a mentor who will help you grow from … experience working with one or more of the following Azure data services (ADS): Azure Data Factory, Azure Data Lake Store and Azure Data Lake Analytics with uSQL, Azure Databricks, Azure SQL DB and Azure SQL DW/Azure Synapse Analytics more »

Description Due to continued growth we are currently looking for Senior Data Engineer to join our Professional Services division - you will be part of a cross functional Data consulting team spanning data engineering, visualisation, analytics and science. You will be working with our clients … across multiple sectors, helping them to explore next-generation data techniques and tools to drive incremental business value from their data assets. A day in the life of an Aiimi Senior Data Engineer: You will be responsible for collaborating with business subject matter experts …/Tools SQL coding skills (essential) Python coding skills (essential) Experience with Azure, or other cloud platform, tools (ADF, Azure, Databricks, Data Lake Storage, SQL DWH) Familiarity with distributed systems (Spark, Databricks etc.) Familiarity with semi-structured and unstructured data Benefits Up to 10% of more »

Job title – Analyst Developer (Data engineering, Databricks, python) Location – Birmingham We will consider new graduates with some knowledge or classwork in SQL and python who are passionate about data engineering and learning Azure Databricks, but may not have a full complement of relevant work experience. About … of the development lifecycle including support. The primary focus for this candidate will be on data engineering, using Azure Data Lake, Azure Databricks with python and other related Azure Data services to support the strategic and tactical goals of Federated Hermes’ data … architecture • active engagement in knowledge sharing • develop Azure Databricks pipelines to interact with data held in Azure SQL, Azure Data Lake ,and Azure Synapse SQL Pool (data warehouse) facilitating operational and analytics data use cases (In lieu of specific Azure Databricks more »