201 to 225 of 285 Data Lake Jobs

remote position with ad hoc office requirements (if required). The successful candidate will support our business intelligence function through analysis of complex business problems and issues, using data from internal and external sources to provide insight to decision-makers. Experience with cloud platforms such as Azure and Databricks would be advantageous, particularly as we continue to evolve … our data infrastructure, but is not essential for success in this role. Key Responsibilities: Reporting Produce reports and dashboards on Microsoft Dynamics using Power BI for all UK Tax business units, reviewing and validating data to ensure accuracy. Create specifications for reports and analysis based on business needs or available data elements, providing consultation … and leading cross-functional teams to address business issues. Ensure consistency in reporting and empower employees to run and update their own reports. Familiarity with Azure Data Lake , Azure Synapse , or Databricks to support scalable and integrated reporting solutions. Business Intelligence Use Microsoft Dynamics and Power BI to conduct business intelligence reviews, uncover actionable insights, and support More ❯

Snr Data Engineer - Global Accounts, Professional Services, AWSI-SDT-APJ-Japan Job ID: Amazon Web Services Japan GK AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training and Certification, optimize with AWS Support and Managed Services, and … practices and conduct skills transfer workshops. AWS consultants collaborate with customers and partners to address security and compliance, performance and scale, availability and manageability. They advise customers on data platforms using the full range of AWS services. They also assist with the non-technical change management work on policies, processes and people changes. At AWS, we're looking … on keyboard capacity, technical leadership experience, and ability to learn fast in a fast paced environment. They will focus on customer solutions that enables customers to be a data-first organization. Key job responsibilities Expertise - Collaborate with AWS field sales, pre-sales, training and support teams to help partners and customers learn and use AWS services such as More ❯

Data Engineer – 3 Month Contract – Hybrid – Cardiff VIQU have partnered with an NHS client who are seeking a Data Engineer to support an ongoing project. The successful Data Engineer will support the modernisation of the data estate, migrating legacy SQL Server warehouses into Azure. You will play a key role in shaping … the new cloud data platform. Responsibilities: Build and optimise ETL/ELT pipelines with Azure Data Factory, Synapse, and SQL Database. Lead the migration of on-premises SQL Server/SSIS workloads into Azure. Design data lakes, marts, and models to support analytics and reporting. Integrate external sources including Google Cloud Platform. Drive data governance with tools like Azure Purview. Collaborate with architects, BI teams, and stakeholders to ensure seamless data access. Apply DevOps (ADO, GitHub) and Agile practices for delivery. Key skills & experience: Strong experience with SQL Server, T-SQL, and SSIS. Hands-on with Azure SQL, Data Factory, Synapse, and Data Lake. Track record More ❯

Overview Role Details We are looking for an Enterprise Data Modeller What you'll be doing As an Enterprise Data Modeller you'll be responsible for managing the enterprise conceptual and logical data model for how Brit ingest, manage, and move data across the underwriting journey, from initial submission through to post-bind processing and data lake & analytics. You'll be analysing and evolving the overall data model, working closely with the business, technology & data stakeholders. In this position you'll take … full ownership of the design and management, and translate business requirements into conceptual and logical data models. You'll have the opportunity to present explain and advocate data modelling principles and strategy to wide audience, including both technical and non-technical colleagues and senior stakeholders. In addition there will be the opportunity to collaborate with stakeholders More ❯

Role Title: Lead Data Engineer (Hybrid 2-3 days onsite) Location: Glasgow Duration: Until 31/12/2026 Day Rate: £382.50 Inside IR35 Role Description Join us as a Lead Data Engineer . You will focus on designing and building data pipelines, including real-time event streaming solutions. You will lead one of … our data engineering teams, setting technical standards, reviewing code, and ensuring high-quality delivery across projects. Key Responsibilities Design, build and maintain scalable data architectures and pipelines. Implement and manage data warehouses and data lakes, ensuring data security, durability and accessibility. Develop data processing and analysis algorithms to … handle complex, large-scale datasets. Collaborate with data scientists to support machine learning model deployment. Lead and mentor a team of data engineers, setting coding standards and driving best practices. Partner with senior stakeholders to align data solutions with business strategy. Manage risk and ensure compliance with governance and control frameworks. Contribute to strategic More ❯

attach relevant documents. *Remote* *Direct Placement* *Overview:* Join the Data Architecture team focused on building real-time and batch serverless integrations for a modern data lake environment. You'll develop cloud-native solutions that connect enterprise apps and third-party data providers, ensuring secure and efficient data flows. This role requires … AWS expertise, and the ability to collaborate in an Agile environment. *Key Responsibilities:* * Design, develop, and maintain cloud-native serverless integrations using Python or Java. * Build and optimize data flows across AWS services and databases (Redshift, DynamoDB, Snowflake, Aurora, etc.).Ja * Ensure code quality through testing, code reviews, and adherence to design best practices. * Participate in Agile ceremonies … in *Python or Java*, AWS SDK, and related frameworks. * Hands-on experience with *AWS serverless technologies*: Lambda, Glue, SQS, Step Functions, API Gateway, CloudFormation, S3, etc. * Expertise in *data integration* and working with varied data formats (JSON, XML, Parquet, delimited, etc.). * Experience with *cloud data warehouses* (Redshift, Azure, Snowflake). * Strong knowledge of More ❯

Position: Technical Architect (Data) Type: Contract 3 months initially w/likely extensions IR35: Inside Scope Working Arrangements: 3 days p/week in London office, 2 days remote Technical Architect - Data Integration Programme We're working with a well-known organisation on a major data integration and migration programme, moving from ServiceNow to … Oracle. As the Technical Architect, you'll shape the migration strategy, design data models and pipelines, and lead on the implementation of scalable, secure, and high-performing solutions. You'll work closely with engineers, analysts, and stakeholders, providing … technical leadership throughout the project lifecycle. Essential experience: Proven background in technical architecture & large-scale data migration Hands-on expertise with ServiceNow, Oracle, Elastic & Data Lake solutions Strong knowledge of data modelling, ETL, and integration best practices This is a chance to take ownership of a high-impact programme at enterprise scale, within More ❯

your career to the next level in the exciting world of finance? Our client, a leading organisation in the financial sector, is seeking a talented Microsoft SQL DBA & Data Developer to join their dynamic Data Services team. This is an incredible opportunity to make a significant impact on data environments, drive transformation, and innovate … within a supportive and flexible work culture! Position: Microsoft SQL DBA & Data Developer Contract Type: Permanent Annual Salary: £45,000 - £52,000 Working Pattern: Full Time Location: Leicester/Hybrid Working Available Job Purpose: As a Microsoft DBA & Data Developer, this role will be 70 percent DBA and 30 percnet Development. You will be at the … heart of maintaining and evolving my client's data environments, both traditional MS SQL Server and cutting-edge Azure Data Services. You'll manage system security, support data delivery projects, and engage in transformative initiatives that shape the future of data. Key Responsibilities: Oversee daily management and maintenance of data systems. Ensure More ❯

daily to our panel of over 24 million registered members to understand opinion and behaviors around the world. We have a strong reputation as a source of accurate data and we're trusted by the world's biggest brands to get it right, making us the most quoted market research source in the world. With operations in the … India and Asia Pacific, YouGov has one of the world's largest research networks. About Brandindex BrandIndex is YouGov's flagship brand intelligence platform that transforms consumer survey data into insights for businesses: it monitors thousands of brands globally to deliver a comprehensive view of brand health. Through continuous data collection and analysis, BrandIndex enables customers … and MySQL Exposure to Docker, Kubernetes, AWS, Helm, Terraform, Vault, Grafana, ELK Stack, New Relic Relevant experience in the maintenance of data APIs and data lake architectures, including experience with Apache Iceberg, Trino/Presto, Clickhouse, Snowflake, BigQuery. Master's degree in Computer Science or Engineering-related field Get to know us better YouGov is More ❯

Software Engineer - Core Financial Analytics Location New York Business Area Engineering and CTO Ref # Description & Requirements The Core Financial Analytics team provides the foundational pricing, analytics, and data infrastructure that powers Bloomberg's markets business. The group delivers cross-asset solutions for curves, volatility surfaces, consensus pricing, screening tools, and listed derivatives, ensuring that clients and internal … systems have access to accurate, transparent, and real-time market data. The CFA department is made up of four specialized teams : The Market Data Analytics team delivers high-performance, cross-asset market data systems that power critical pricing, risk, and analytics for Bloomberg's Terminal and Enterprise clients. The team builds scalable, adaptable platforms that transform … producing real-time FX rates and fair values for commodities such as oil, gas, metals, and agricultural products. Leveraging modern C+, advanced algorithms, and a robust data lake ecosystem, the team delivers transparent, accurate, and high-quality pricing that powers trading, valuation, risk management, and regulatory workflows worldwide. The Futures & Options (F&O) team empowers key market More ❯

the end-to-end architecture for AI/ML solutions on Azure, from concept and design to deployment. Develop high-level solution designs that integrate with clients' existing data platforms and infrastructure. Client Engagement: Work closely with enterprise clients to understand business challenges and identify opportunities where AI/ML can drive value (e.g. predictive maintenance in manufacturing … modeling in insurance). Translate these needs into solution roadmaps and technical plans. Technical Leadership: Provide hands-on technical leadership to delivery teams. Guide Azure AI Engineers and Data Engineers in implementing best practices for data preparation, model development, and cloud deployment. Mentor team members in advanced AI techniques and review designs/code to ensure … suitable for junior candidates ). Azure Expertise: Deep hands-on knowledge of Azure data and AI services - including Azure Machine Learning, Azure Databricks, Azure Data Lake/Synapse, Azure Cognitive Services (Text, Vision, Speech), Azure OpenAI and Azure AI Foundry. Ability to architect solutions that leverage these services cohesively. Architectural Skills: Strong skills in system More ❯

the end-to-end architecture for AI/ML solutions on Azure, from concept and design to deployment. Develop high-level solution designs that integrate with clients' existing data platforms and infrastructure. Client Engagement: Work closely with enterprise clients to understand business challenges and identify opportunities where AI/ML can drive value (e.g. predictive maintenance in manufacturing … modeling in insurance). Translate these needs into solution roadmaps and technical plans. Technical Leadership: Provide hands-on technical leadership to delivery teams. Guide Azure AI Engineers and Data Engineers in implementing best practices for data preparation, model development, and cloud deployment. Mentor team members in advanced AI techniques and review designs/code to ensure … suitable for junior candidates ). Azure Expertise: Deep hands-on knowledge of Azure data and AI services - including Azure Machine Learning, Azure Databricks, Azure Data Lake/Synapse, Azure Cognitive Services (Text, Vision, Speech), Azure OpenAI and Azure AI Foundry. Ability to architect solutions that leverage these services cohesively. Architectural Skills: Strong skills in system More ❯

the end-to-end architecture for AI/ML solutions on Azure, from concept and design to deployment. Develop high-level solution designs that integrate with clients' existing data platforms and infrastructure. Client Engagement: Work closely with enterprise clients to understand business challenges and identify opportunities where AI/ML can drive value (e.g. predictive maintenance in manufacturing … modeling in insurance). Translate these needs into solution roadmaps and technical plans. Technical Leadership: Provide hands-on technical leadership to delivery teams. Guide Azure AI Engineers and Data Engineers in implementing best practices for data preparation, model development, and cloud deployment. Mentor team members in advanced AI techniques and review designs/code to ensure … suitable for junior candidates ). Azure Expertise: Deep hands-on knowledge of Azure data and AI services - including Azure Machine Learning, Azure Databricks, Azure Data Lake/Synapse, Azure Cognitive Services (Text, Vision, Speech), Azure OpenAI and Azure AI Foundry. Ability to architect solutions that leverage these services cohesively. Architectural Skills: Strong skills in system More ❯

Position: Technical Business Analyst (Data) Type: Contract 3 months initially w/likely extensions IR35: Inside Scope Working Arrangements: 3 days p/week in London office, 2 days remote Technical Business Analyst - Data Integration Programme We're working with a well-known organisation on a major data integration and migration programme, moving from … a Technical Business Analyst to bridge the gap between business stakeholders and delivery teams. You'll gather and translate requirements, map current and future-state processes, and ensure data quality, governance, and compliance are at the heart of the solution. Working closely with architects, engineers, and business teams, you'll play a key role in ensuring the programme … Proven background in Technical Business Analyst positions Excellent understanding of data migration/integration programmes Experience of working with Data Warehousing and Data Lake Solutions An exciting opportunity to shape a critical transformation, influencing both technical delivery and business outcomes. More ❯

Involvement in school improvement initiatives. Familiarity with school/trust Financial Management Systems (FMS). Knowledge of school/trust budget planning. Ability to manage a data lake, including data ingestion, storage, governance, and integration with analytics tools. Advanced proficiency in Microsoft Office suite. Strong customer relationship management skills. Skilled in technical writing. Competence in More ❯

or Leadership role Strong knowledge of SQL Server, SSIS, SSAS, ETL pipelines Experience would be highly useful with PowerBI, Azure services (Data Factory, Synapse, Data Lake), CI/CD, and DevOps Strong communication skills with the ability to bridge technical and business discussions. Collaborative mindset with experience driving results in dynamic environments. Knowledge of Front More ❯

or Leadership role Strong knowledge of SQL Server, SSIS, SSAS, ETL pipelines Experience would be highly useful with PowerBI, Azure services (Data Factory, Synapse, Data Lake), CI/CD, and DevOps Strong communication skills with the ability to bridge technical and business discussions. Collaborative mindset with experience driving results in dynamic environments. Knowledge of Front More ❯

or Leadership role Strong knowledge of SQL Server, SSIS, SSAS, ETL pipelines Experience would be highly useful with PowerBI, Azure services (Data Factory, Synapse, Data Lake), CI/CD, and DevOps Strong communication skills with the ability to bridge technical and business discussions. Collaborative mindset with experience driving results in dynamic environments. Knowledge of Front More ❯

or Leadership role Strong knowledge of SQL Server, SSIS, SSAS, ETL pipelines Experience would be highly useful with PowerBI, Azure services (Data Factory, Synapse, Data Lake), CI/CD, and DevOps Strong communication skills with the ability to bridge technical and business discussions. Collaborative mindset with experience driving results in dynamic environments. Knowledge of Front More ❯

or Leadership role Strong knowledge of SQL Server, SSIS, SSAS, ETL pipelines Experience would be highly useful with PowerBI, Azure services (Data Factory, Synapse, Data Lake), CI/CD, and DevOps Strong communication skills with the ability to bridge technical and business discussions. Collaborative mindset with experience driving results in dynamic environments. Knowledge of Front More ❯

or Leadership role Strong knowledge of SQL Server, SSIS, SSAS, ETL pipelines Experience would be highly useful with PowerBI, Azure services (Data Factory, Synapse, Data Lake), CI/CD, and DevOps Strong communication skills with the ability to bridge technical and business discussions. Collaborative mindset with experience driving results in dynamic environments. Knowledge of Front More ❯

multi-account Organization. This should include: • Networking and DNS components, Compute, Storage and Backup platforms, Logging, Messaging, and Alerting services, Organisational account management platforms, Serverless platforms, Data Lake/Lake House platforms, services & architecture, IAM roles and policies, Security and audit tools and practices • Experience with implementing complex Terraform IaC and multi-branch CI/CD More ❯

starter to serve as an ADVANA Developer supporting the Southern Command Operations, Planning, and Engagement Support (SCOPES) program. This position will reside in the Office of the Chief Data Officer as part of a project spanning various development, data science, and knowledge management functions. This position requires a strong background in software development, data engineering principles, and cloud technologies. The ADVANA Developer will contribute to building and enhancing capabilities that enable data-driven decision-making for SOUTHCOM. Responsibilities: • Design and Development: Participate in the full software development lifecycle, including requirements gathering, system design, development, testing, and deployment of applications and data pipelines within the ADVANA environment. • Data Engineering: Develop and maintain robust and scalable data pipelines to ingest, transform, cleanse, and integrate data from various DoD source systems into the ADVANA data lake. • Cloud Technologies: Utilize and contribute to the development within ADVANA's cloud based architecture, leveraging cloud-native services for data storage, processing, and analytics. More ❯

This is an exciting opportunity for a Senior Data Engineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector … transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior Data Engineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior Data Engineer will be responsible for, but not limited to: Design and maintain More ❯

1. (Mandatory) Demonstrated experience in data architecture. 2. (Mandatory) Demonstrated experience with and understanding of database structure principles 3. (Mandatory) Demonstrated experience in data modeling and design, including SQL development and database administration. 4. (Mandatory) Demonstrated experience in data visualization, data migration and data modeling. 5. (Mandatory) Demonstrated experience in … relational database management systems (DBMS). 6. (Mandatory) Demonstrated experience in DBMS software, including SQL Server. 7. (Mandatory) Demonstrated experience in database and cloud computing design, architectures and data lakes. 8. (Mandatory) Demonstrated experience in configuration and administration of enterprise level data stores, ETL and ELT methods, and batch and streaming data transport. 9. More ❯