76 to 100 of 255 Data Lake Jobs

closely with key business stakeholders Experience: Around 3 years’ experience developing with SQL MSSQL, T-SQL Azure DevOps experience preferred Troubleshooting and resolving data … quality issues Documentation Advantageous: Telecoms billing systems or processes Knowledge of Java or Kotlin NoSQL Databases Experience of CRM systems Azure Data Lake/Data Pipelines This role offers a salary of up to £40,000 including generous benefits including a company bonus, remote working more »

to join one of the largest media technology brands in the world and lead a major project relating to the development of their data cubes. ABOUT THE COMPANY This business is a household name in the UK and their products and services are used by millions of people … each day. They have recently completed a major migration project to a new cloud data environment and as a result are now looking to scale out their various analytics teams. ABOUT THE ROLE In this role you will join their Data insights team and be responsible … be responsible for are: Building a variety of SSAS tabular and dimensional cubes Build out Cloud cubes Work on improving current data lake processing activities Work across multiple business stakeholders to ensure that their various requirements are supported by cutting edge technical solutions Document all processes to more »

Data Platform Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established, global organisation within the education sector who are looking for a Data Platform Engineer to join their established IT team. Their current project is based around the creation and … implementation of a brand new Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. You will join a growing team. This is an opportunity to join a team who are … Excellent understanding of Azure Databricks Experience creating data pipelines using Azure Data Factory Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »

Data Engineer £35,000 To £45,000 (Dependent on Experience) Norwich Hybrid (2/3 Days per Week Onsite) An exciting opportunity for a data engineering professional to take full ownership of new projects. Join a longstanding business with a talented and dedicated internal IT team … as well as an environment that fosters personal progression. This job role is ideal for someone with a strong background in data engineering and an interest in data analysis. Duties: Lead the implementation and ongoing management of data strategy and analysing raw data for trends and patterns Design & build robust data systems Conduct advanced data analysis Participate in Agile ceremonies and practices Required Skills: ETL Data Pipeline development experience Designing, developing and maintaining data lakes and warehouses SQL Database Design, Coding and Maintenance more »

Alexander Ash are currently working with a global firm who are looking for a Data Architect to join their multi-disciplinary team. This is an exciting opportunity for any Data Architect to join a team of skilled and experienced consultants and seek to identify improvements and … existing tools as the organisation takes on one of it's biggest bodies of work. Skill Requirements & Respinsibilites Creating the blueprint for how data is stored, accessed, and used within an organization. Specific Microsoft technology awareness (data Fabric and Data Mesh a priority) establish … data governance policies and procedures to ensure data quality, consistency, privacy, and compliance with relevant regulations. define the overall data architecture, including data warehouses, data lakes, data marts, and other data repositories. collaborate with cross-functional more »

and platforms. Role purpose/summary Collaborate with stakeholders to understand business requirements and translate them into effective solution designs for our party data model data platform. Architect and implement cloud-based solutions that leverage popular data platforms to enable efficient storage, processing, and … analysis of large-scale data. Design scalable and resilient architectures that ensure high availability, fault tolerance, and disaster recovery for our data platform. Assess and select appropriate data platforms and technologies based on functional and non-functional requirements, considering factors such as performance, scalability, security, and … platforms such as Amazon Web Services (AWS) (e.g., S3, RDS, Redshift, Athena), Microsoft Azure (e.g., Blob Storage, SQL Database, Data Lake Analytics), or Google Cloud Platform (e.g., Cloud Storage, BigQuery). Deep understanding of cloud computing concepts, including infrastructure as code, serverless computing, and containerization. more »

Please review the job details below. Maxar is looking for an enthusiastic Staff DevOps Engineer or Senior Staff DevOps Engineer to join our Data Intelligence team. We are looking for someone energetic and talented to further our mission of delivering a high-quality analytics environment and platform to … The Data Intelligence team owns and maintains a variety of infrastructure and services in AWS, including new full-stack data lake houses (commercial & government) intended to allow for more Maxar teams to build analytics solutions. Your primary focus will be to maintain and improve upon … the data lake houses, with a secondary focus on the team's existing AWS infrastructure. What you'll do day-to-day (with your colleagues): Support the deployment and management of solutions in AWS. Work and communicate with Maxar employees as well as external consultants. Follow and more »

Review clients' requirements Working closely with key business stakeholders Experience: Around 3 years' experience developing with SQL MSSQL, T-SQL Troubleshooting and resolving data … quality issues Documentation Advantageous: Telecoms billing systems or processes Knowledge of Java or Kotlin NoSQL Databases Experience of CRM systems Azure Data Lake/Data Pipelines This role offers a salary of up to £40,000 including generous benefits including a company bonus, remote working more »

Review clients' requirements Working closely with key business stakeholders Experience: Around 3 years' experience developing with SQL MSSQL, T-SQL Troubleshooting and resolving data … quality issues Documentation Advantageous: Telecoms billing systems or processes Knowledge of Java or Kotlin NoSQL Databases Experience of CRM systems Azure Data Lake/Data Pipelines This role offers a salary of up to £40,000 including generous benefits including a company bonus, remote working more »

Python Software Engineer Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager … asset classes such as Fixed Income, equities, FX or commodities Role: Python Software Engineer Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with AWS, Glue, Dremio, Snowflake, Python and Java. more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services … appreciation of asset classes such as Fixed Income, equities, FX or commodities Role: Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with AWS, Glue, Dremio, Snowflake, Python and Java. more »

Java Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services … appreciation of asset classes such as Fixed Income, equities, FX or commodities Role: Java Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with AWS, Glue, Dremio, Snowflake, Python and Java. more »

business in the coming years. We’re looking for an engineer to help us build BPP’s platforms, products and user experiences. The Data Engineering team will enable BPP to leverage data, to inform and optimise how we deliver scalable, secure and performant experiences that delight … pipelines to extract data from various source systems (log files, APIs, databases) and load them into our data lake/data warehouse confidentially using modern data tools and technologies Transform data into highly accessible and usable structures … as AWS, GCP, Azure) Good understanding of data modelling methods and data partitioning and compaction methods in Data Lake Experience of working with event driven architectures or real time streaming analytics Confident in writing and reading code in multiple languages Possess a deep more »

Delivery Manager – Data Ops Location: Hybrid - London Package: Negotiable + Benefits Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them to provide great customer service and grow through the provision … of superior data services The Delivery Manager for Data Operations is responsible for ensuring the successful and timely delivery of data to the business. You will lead a team of Brown & Brown data specialists, manage resources, act as a bridge between data … engineering design patterns and best practice, including data pipelines. Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL Server, Azure Cosmos DB, Azure Power Platform, Power BI. The rewards: negotiable basic salary and all the normal benefits you’d more »

brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Data Engineer role sits within the Engineering team of the Data Services department responsible for all data applications across the company’s divisions globally from Big Data, Data Warehousing, Business … business hours and weekends when required You Have These: Exposure to, and ideally experience with, modern data architectures (e.g. data lake, lake house, data mesh) and accompanying technologies (e.g. Azure Synapse, Snowflake, Amazon Redshift) Awareness of data governance and all more »

Purpose of Position Pantheon require a passionate hands-on Data Support Engineer to support the delivery of change to existing systems as well as conduct analysis for root cause & software issues. Pantheon is at the start of a multi-year programme to establish itself as a data … technologies (ETL, SQL Database, Reporting) Knowledge of Dimension Modelling Strong SQL skills, experience in writing complex SQL queries Knowledge of Azure Data Lake, Data Factory, Databricks and Functions Essential Experience Experience in supporting traditional Data Warehouses Exposure in building Azure based data ingestion and transformation pipelines, data lake, data warehouse/data marts etc. Experience working with Agile development methodologies such as Kanban/Scrum A natural problem-solving attitude. Conversant with current industry and technology trends. Experience with dealing directly with stakeholders more »

brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Lead Data Engineer role sits within the Data Services department, you will work actively to unlock the value of data by building and enabling product teams and data practitioners to use the … and needs assessment. You Have These: Team management experience Exposure to, and ideally experience with, modern data architectures (e.g. data lake, lake house, data mesh) and accompanying technologies (e.g. Azure Synapse, Snowflake, Amazon Redshift) Awareness of data governance and all more »

Data Architect - Consulting - FS A leading global consulting firm is looking for a Data Architect to join their team! As the successful candidate, you will be in charge of designing and implementing scalable architecture and lead a global rollout of the client's digital content platform. … office and it is offering up to £155,000 + bonus + excellent benefits! Required skills: More than 5 years of experience in Data Architecture implementing data migrations to at least one cloud platform including AWS, GCP and/or Azure Data … modernisation and data ingestion experience Experience leading at least one implementation of Databricks and/or Snowflake is required Data Lake and data storage design experience for both structure and unstructured data Experience working for a consultancy or for a financial more »

as a Power BI Expert Analyse large datasets and draw on your expertise with Power BI to provide expert reporting and intelligence into data driven decision making for key Customer Focused areas across the business. Work with data engineers across IT & Data teams to … provide guidance and consultancy on producing an efficient and accurate reporting infrastructure. To mentor and provide training to the Data Team, to develop their skills with Power BI and surrounding processes. Experience & Skills Required Expertise with Data Visualisation and Report Presentation using Power BI. Able to … design, data transformation and engineering for reporting purposes. Proficiency with the Azure Suite, Data Factory, SQL DB, Data Lake Storage What’s in it For You? Amazing company to work for! Exciting project at SME level within a large enterprise. 9 months contract more »

Data Engineering in Animal Health London/Kent – approx. 80% remote £60-70k basic salary plus 10% bonus If you’re as much of an animal lover as you are a data engineer, you won’t find a better opportunity to use your skills for … good. In this newly created role you’ll be setting up the data infrastructure that will help this thriving veterinary care company to hugely improve outcomes for pets – and their two-legged friends[MW1] . It's a role with the potential to be both personally and professionally … a UK work visa already in place. Able to set up, maintain and support a cloud data platforms/data lake such as Snowflake A solid understanding of analytics, reporting and dashboarding technologies Proficiency in API integration, and data extraction methodologies. Strong coding more »

Job summary An exciting new opportunity is available to join the the Data Quality & Standards team as a new Data Quality & Standards Specialist. The role will support the Data Quality & Standards Manager and DQ leads across the Trust to deliver continued improvement in the … quality of data and information systems by identifying any Data Quality issues and developing potential solutions along with users, asset owners, administrators, and system providers This will cover a wide variety of aspects including the use of the front-end Information Systems by operational staff, technical … improvements to these systems, improvements to the data processing and supporting delivery of complete, timely and accurate data in the Trust's back end Data Warehouse This role requires someone with an attention to detail, aptitude for identifying errors in the Trusts reporting data more »

Python or TensorFlow ) Familiarity with natural language processing or AI technologies ( e.g LLMs such as ChatGPT or BARD , Embeddings , Prompt Engineering ) Experience with data pipelines and preferably processing of document s ( e.g using Google Cloud Fusion/Azure Data Factory ) Strong background in either Python/… Service Orientated Architecture, API-Centric Design, Twelve-Factor App, FAIR, etc.). Experience supporting digital platforms, including Integrations, Release Management, Regression Testing, Integrations, Data Obfuscation, etc. Knowledge of Azure … Data Factory/GCP Cloud Data Fusion , Microsoft Azure Machine Learning or GCP Cloud ML Engine , Azure Data Lake , Azure Databricks or GCP Cloud Dataproc . Familiarity with big data technologies and distributed computing frameworks, such as Hadoop, Spark, or Apache more »

have created is unique and difficult to replicate, with our ‘best of both’ approach combining deep human expertise with advanced digital, tech and data capabilities. This combination not only allows us to deliver excellent customer experiences, but to do so efficiently and at scale. We are proud of … of a business that cares too Want to continue to grow professionally and be the best version of yourself Job Description The Lead Data Engineer is a key role to ensure Shawbrook unlocks the value contained in its data across the organisation in a well-governed … and table formats (Delta etc) This is an incredibly exciting role that rarely becomes available. You will own a well-designed data lake serving a 50+ user community who run '000s of queries across TBs of data each month with a mandate to take it more »

Azure Head of Data Engineering Salary- £90,000 - £110,000 + Excellent benefits Location - Birmingham/Hybrid Key skills - Azure - Databricks - Data factory - Data Lakes - Synapse - Modelling - Agile Role purpose: We are actively seeking a dynamic professional to play a pivotal role in the … organisation and contributing to the exciting digital transformation journey. Reporting directly to the Chief Data Officer, you will lead team of skilled data engineers to architect, build, and maintain a new data lakehouse solution and pipelines that drive our digital transformation initiatives and support … to-date and accessible to relevant stakeholders. Technical/Professional Qualifications/Requirements: Significant Microsoft Azure stack experience is a must: Data Lake, Data Factory, Synapse, Databricks, Power BI Extensive experience in data engineering and in a leadership or management position. Strong in more »

Key Responsibilities Assist the Data Team Lead in system improvements. Develop, maintain, and troubleshoot software components. Identify and solve data/software issues. Collaborate with stakeholders and peers. Plan tasks and deployments. Conduct peer reviews and advocate for best practices. Ensure compliance with IT and Security … systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. Building Azure data pipelines. Agile methodology experience. more »