101 to 125 of 282 Data Lake Jobs

Eir Evo Talent are working with one of Europes leading Telco providers, who are looking to add further Data resources into the business. The Engineer joining the … business will play a pivotal part in designing, developing, and maintaining their Data Infrastructure, as well as playing a huge part in their Greenfield Data Lake programme of work. The Engineer will play a part in: Design, Maintain and Build the businesses Data Pipelines & Processes Speak with other members of the team to … translate Data requirements into Tech solutions. Design, build, and maintain the data warehouse, data lakehouse, and other data repositories. Implement Data best practices & Governance Skills: 2+ years of experience as a Data Engineer or similar role. Experience working with Python SQL Experience Working experience with Kubernetes Solid understanding More ❯

Sr. Delivery Consultant - Data Analytics, Professional Services Job ID: Amazon Web Services Colombia S.A.S. - E40 The Professional Services (ProServe) team is seeking a skilled Sr. Delivery Consultant - Data Analytics to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS solutions that … through their cloud journey, providing technical expertise and best practices throughout the project lifecycle. Possessing a deep understanding of AWS products and services, as a Sr. Delivery Consultant - Data Analytics you will be proficient in architecting complex, scalable, and secure solutions tailored to meet the specific needs of each customer. You'll work closely with stakeholders to gather … processing. Key job responsibilities As an experienced technology professional, you will be responsible for: - Help the customer to define and implement data architectures (Data Lake, Lake House, Data Mesh, etc). Engagements include short on-site projects proving the use of AWS Data services to support new distributed computing More ❯

West Country - Hybrid - 3 Days Work from home per week Shape a greenfield data platform from day one, setting the standards for architecture, engineering and governance that will guide a major financial services organisation for years to come. You’ll define how data is designed, delivered and used—while steering the migration to Databricks and mentoring … smarter decisions across the business. What you'll do This is a large-scale data transformation. You’ll own the migration of the existing data lake into Databricks while helping them develop new capabilities in data governance, data quality and data management. Right now, most delivery is handled by … technical lead with deep engineering knowledge and practical architecture skills. You'll take ownership of the platform migration and assurance, leading the migration of the existing data lake into Databricks. You'll assure engineering quality from third-party suppliers and contribute hands-on to coding, pipeline development and modelling of core data entities. You'll More ❯

West Country - Hybrid - 3 Days Work from home per week Shape a greenfield data platform from day one, setting the standards for architecture, engineering and governance that will guide a major financial services organisation for years to come. You’ll define how data is designed, delivered and used—while steering the migration to Databricks and mentoring … smarter decisions across the business. What you'll do This is a large-scale data transformation. You’ll own the migration of the existing data lake into Databricks while helping them develop new capabilities in data governance, data quality and data management. Right now, most delivery is handled by … technical lead with deep engineering knowledge and practical architecture skills. You'll take ownership of the platform migration and assurance, leading the migration of the existing data lake into Databricks. You'll assure engineering quality from third-party suppliers and contribute hands-on to coding, pipeline development and modelling of core data entities. You'll More ❯

Shape the Future of Data - Azure Data Architect - Hybrid - London SE1 Job Title: Data Architect - Azure Platform Specialist Location: Hybrid - 1-2 days per week in London (SE1). 3-4 days remote Salary: £90 - £115K OTE including bonus Start: ASAP The Client: A Microsoft-focused digital consultancy at the forefront of AI, Cloud … and Data transformation. As a Microsoft Fabric Featured Partner, they design and deliver cutting-edge data solutions to clients in sectors including finance, pharma, energy, insurance, and retail. The Candidate: Were looking for a confident and technically strong Azure Data Architect with experience shaping modern, scalable data platforms. The role would suit … more of the following platforms: Azure Synapse Analytics and Azure Databricks, and supporting data technologies like Power BI, Microsoft Purview, Azure SQL Database, Azure Data Lake, etc. Excellent stakeholder engagement and communication skills. Able to consult, advise, architect and estimate project work. Strong analysis, requirements gathering and data modelling. Solid data More ❯

Data Architect x2 Cheltenham OR London Permanent and Contract assignments available MUST be Green Badged to work onsite Support the creation of cross-organisational data labelling standards, data lineage and provenance standards, data quality standards, and data discovery standards. Engage with Data Platform Product, Information Managers, Solutions Architects … and others to ensure that policy recommendations are being considered across data architecture teams. Working within your data office team to shape practical data policies and aligning that information cross-organisation to enable a cohesive data strategy. Skills/Experience: Good at understanding complexity and abstracting that into a form that is … consumable for a non-technical audience. Experience of achieving data interoperability between 2 or more systems or organisations. Experience of working with and developing data standards and the negotiation and collaboration that this requires. Experience working with or developing data models, ontologies, data catalogues, data lakes and data More ❯

Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Description: We are looking for a seasoned AWS Data Engineer to join our team and contribute to the development of scalable, secure, and high-performance data solutions. This role involves modernizing mainframe legacy systems, building robust … data pipelines, and enabling advanced analytics using AWS-native technologies. You’ll collaborate with cross-functional teams and play a key role in shaping our data strategy. Skills Must have : Proven experience in designing and maintaining scalable data lakes using AWS S3, with strong understanding of data lifecycle, access control, and performance … AWS CloudFormation and Terraform to automate and manage cloud resources. Experience developing ETL workflows using AWS Glue, querying data with Athena, and managing access and governance with Lake Formation. Strong command of AWS Lambda for serverless data processing and Boto3 for programmatic interaction with AWS services. Demonstrated experience working with GDPR-compliant architectures and handling More ❯

Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Description: We are looking for a seasoned AWS Data Engineer to join our team and contribute to the development of scalable, secure, and high-performance data solutions. This role involves modernizing mainframe legacy systems, building robust … data pipelines, and enabling advanced analytics using AWS-native technologies. You’ll collaborate with cross-functional teams and play a key role in shaping our data strategy. Skills Must have : Proven experience in designing and maintaining scalable data lakes using AWS S3, with strong understanding of data lifecycle, access control, and performance … AWS CloudFormation and Terraform to automate and manage cloud resources. Experience developing ETL workflows using AWS Glue, querying data with Athena, and managing access and governance with Lake Formation. Strong command of AWS Lambda for serverless data processing and Boto3 for programmatic interaction with AWS services. Demonstrated experience working with GDPR-compliant architectures and handling More ❯

Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Description: We are looking for a seasoned AWS Data Engineer to join our team and contribute to the development of scalable, secure, and high-performance data solutions. This role involves modernizing mainframe legacy systems, building robust … data pipelines, and enabling advanced analytics using AWS-native technologies. You’ll collaborate with cross-functional teams and play a key role in shaping our data strategy. Skills Must have : Proven experience in designing and maintaining scalable data lakes using AWS S3, with strong understanding of data lifecycle, access control, and performance … AWS CloudFormation and Terraform to automate and manage cloud resources. Experience developing ETL workflows using AWS Glue, querying data with Athena, and managing access and governance with Lake Formation. Strong command of AWS Lambda for serverless data processing and Boto3 for programmatic interaction with AWS services. Demonstrated experience working with GDPR-compliant architectures and handling More ❯

Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Description: We are looking for a seasoned AWS Data Engineer to join our team and contribute to the development of scalable, secure, and high-performance data solutions. This role involves modernizing mainframe legacy systems, building robust … data pipelines, and enabling advanced analytics using AWS-native technologies. You’ll collaborate with cross-functional teams and play a key role in shaping our data strategy. Skills Must have : Proven experience in designing and maintaining scalable data lakes using AWS S3, with strong understanding of data lifecycle, access control, and performance … AWS CloudFormation and Terraform to automate and manage cloud resources. Experience developing ETL workflows using AWS Glue, querying data with Athena, and managing access and governance with Lake Formation. Strong command of AWS Lambda for serverless data processing and Boto3 for programmatic interaction with AWS services. Demonstrated experience working with GDPR-compliant architectures and handling More ❯

Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Description: We are looking for a seasoned AWS Data Engineer to join our team and contribute to the development of scalable, secure, and high-performance data solutions. This role involves modernizing mainframe legacy systems, building robust … data pipelines, and enabling advanced analytics using AWS-native technologies. You’ll collaborate with cross-functional teams and play a key role in shaping our data strategy. Skills Must have : Proven experience in designing and maintaining scalable data lakes using AWS S3, with strong understanding of data lifecycle, access control, and performance … AWS CloudFormation and Terraform to automate and manage cloud resources. Experience developing ETL workflows using AWS Glue, querying data with Athena, and managing access and governance with Lake Formation. Strong command of AWS Lambda for serverless data processing and Boto3 for programmatic interaction with AWS services. Demonstrated experience working with GDPR-compliant architectures and handling More ❯

based environment. We're looking for an established DBA with a strong background in SQLServer but who wants to be part of the journey Databricks/Data Lake in an Azure environment. The Role: As the Lead DBA/Lead Database Administrator you'll be responsible for the line management of 1 member of the team and … will be part of an overall data function that is expected to grow significantly over the coming years. You will be responsible for designing, building and managing the database management strategy and will play a key role in the transformation programme. You will work closely with the infrastructure team and some 3rd parties to drive proactive monitoring, incident … strength in SQLServer - Experience in performance testing, tuning and optimisation - Skills in enterprise level architecture, systems analysis and the development of scalable solutions - Knowledge of modern data lake solutions such as Azure Data Lake, Dedicated, SQL Pools, Delta Live Tables and Microsoft Fabric - SSRS, SSIS - Be proficient in Azure processes/Data More ❯

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. Aker builds and operates ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary technology solutions drive performance and reduce costs while helping our … clients to improve the management and sharing of data across their organisations. In 2022, Aker Systems was proud to win the Scale up Business of the Year award by the British Business Excellence Awards. In 2020 Aker Systems was recognised as a One to Watch on the Sunday Times Tech Track and was also recognised at the Thames … and cloud-native solutions. Data Platforms designing modern data platforms with appropriate architecture coving Data Mesh, Data Fabric, Data Lake etc. Data/Analytics - solving enterprise data and analytics problems using technology Cloud - hands-on Public Cloud experience in either AWS/Azure/Google More ❯

customer service and innovation. We serve both government and commercial sectors, offering a range of solutions such as Healthcare IT, Human Services, Identity Credentialing, Cloud Computing, and Big Data Analytics. With clients in the US and abroad, we hold key contract vehicles including GSA IT Schedule 70, NIH CIO-SP3, GSA Alliant, and DHS-Eagle II. Join us … experience in designing, developing, maintaining, and optimizing complex databases (PostgreSQL, MongoDB) in cloud environments. This role involves supporting critical systems like Maryland Health Connection, with a focus on data integrity, performance, security, and cost-efficiency. Database Architecture & Design: Lead the design, development, and maintenance of complex enterprise databases, data lakes, and data warehouses, including … data modelling, schema design, and security architecture. Data Platform Management: Administer, monitor, and optimize performance for PostgreSQL and MongoDB databases, ensuring high availability, replication, and disaster recovery. This includes managing user accounts, patching, and storage. ETL & Data Strategy: Design, develop, and support robust ETL processes for extracting, transforming, and loading complex data More ❯

evolving Lloyds managing agent thats leading the way across multiple lines, including Property, Casualty, and Specialty. As part of a major transformation, theyre building a modern, business-driven data platform from the ground up and theyre looking for a Senior Data Engineer to help shape it. About the Business This Lloyds managing agent is authorised and … regulated by the PRA and FCA, managing a high-performing syndicate. They are known for underwriting excellence and are investing heavily in data and technology to support their long-term growth. Why this role? You'll play a key role in delivering a robust, scalable data platform that unlocks better MI, improves data quality … This is a genuinely exciting opportunity to influence the data direction of a Lloyds business, not just maintain it. Key responsibilities: Design and build Data Lake and Data Warehouse solutions Create scalable, automated batch and streaming data pipelines Optimise metadata, catalogue, lineage, and data quality processes Support business teams More ❯

and science capabilities for ROW Ops. We develop scalable analytics applications, AI/ML products and research models to optimize operation processes. You will work with Product Managers, Data Engineers, Data Scientists, Research Scientists, Applied Scientists and Business Intelligence Engineers using rigorous quantitative approaches to ensure high quality data/science products for our … customers around the world. As a Data Engineer, you will play a crucial role in supporting the team by creating and maintaining the data infrastructure necessary for the advanced analytics and machine learning solutions. Our team solves a broad range of problems that can be scaled across ROW (Rest of the World including countries like India … Route for $MM savings • Deep Learning models to synthesize attributes of addresses • Abuse detection models to reduce network losses Key job responsibilities 1. Design, develop, and maintain scalable data pipelines to support ML model development and production deployment. 2. Implement and maintain CI/CD pipelines for the data and ML solutions. 3. Collaborate with data More ❯

POSITION OVERVIEW As a data scientist, you'll play a pivotal role in developing and enhancing our innovative supply chain solutions. You'll collaborate closely with a talented team of passionate engineers and industry experts, applying data engineering and data science techniques to optimize supply chain processes. Your expertise will directly contribute to providing … machine learning models to improve the accuracy of supply chain ETA s. Analyze large, complex datasets to extract meaningful insights and identify trends. Design, build, and maintain scalable data pipelines and data lakes to ensure efficient data flow and storage for analytics purposes. Collaborate with cross-functional teams to integrate analytics solutions into our … products. Design and build data visualization tools to communicate findings to stakeholders. Continuously research and apply the latest techniques in AI and machine learning to supply chain problems. Contribute to the development of our analytics product suite, ensuring scalability and efficiency. Communicate complex data science concepts to non-technical stakeholders. Key Responsibilities 1. Advanced Predictive Models More ❯

with defect tracking processes and tools. Thorough experience in understanding, analyzing, and white-box testing (end-to-end) of integrations built using/with Azure integration tools like Data factory, LogicApps, Functions, API Management, Data … catalog, WebApps, Integration service environment, configuring monitoring & diagnostics, etc., and connectivity & security configurations. Experience in understanding, analyzing, and white-box testing Azure data storage (Data lake, Synapse, etc.) & access tools, APIs, cloud connectivity, and ETL solutions. In-depth understanding of and experience with SOAP, XML, REST, JSON, EDI, XSLT, Async/Sync, Request/Response … and practice/experience of identifying and high-level investigating performance issues to pin-point problem areas Experience with MS D365, ServiceNow, Azure Analytics tools, Azure Data lake, Azure Synapse, Azure BYOD & Data verse, Azure DevOps, Informatica, BI tools, etc., is a big plus. The role will be based in Trumbull, Connecticut USA. The salary More ❯

What we're all about. It isn't often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle serious criminal activity. Now, its potential is virtually limitless. Working at Quantexa isn't just intellectually … to join us. Opportunity Applications is an Engineering function within Quantexa's R&D department that is focused on internally building real-world applications of the Quantexa Platform. Data Engineers are focused on building the data infrastructure and processing capabilities that power Quantexa's platform and applications. This role encompasses two closely related teams working on … network building Data Feeds Building standardised and reusable code for processing various third party/open source data sets Managing an internal data lake for the provision of this data by other teams for testing and analytics Owning general best practices for ingesting and processing data to get it More ❯

the modern workforce. Are you ready to move the world forward? Apply now. A Brief Summary of This Position: The IT Analytical Engineer is part of the IT Data and Analytics team.This group is responsible for capturing data from numerous disparate sources of all types, modeling it and transforming it into simple information models, and working … technical solutions and strategies for business intelligence needs; Help to build and support Valmont's self-service analytics platform; Understand and work with business partners to fulfill their data and information needs; Gather requirements from assigned business teams, and work with other Engineers to build out the data models; Have a deep understanding of BI tools … relevant experience or Associate's degree with 5+ years of relevant experience or 9+ years of relevant experience. Experience with DataBricks, Azure services (such as Azure Data Lake Storage, Azure SQL Database, Azure Synapse Analytics), and Azure Data Factory (ADF). Proficiency in SQL, data manipulation, analysis, and visualization. Some experience with Python More ❯

Working at GSR is an opportunity to be deeply embedded in every major sector of the cryptocurrency ecosystem. About the role: This role sits within GSR's global Data Engineering team, where you'll contribute to the design and development of scalable data systems that support our trading and business operations. You'll work closely with … stakeholders across the firm to build and maintain pipelines, manage data infrastructure, and ensure data is reliable, accessible, and secure. It's a hands-on engineering position with scope to shape the way data is handled across the business, working with modern tools in a fast-moving, high-performance environment. Your responsibilities may include … an equivalent framework such as Spark Structured Streaming or Kafka Streams)? Select Which statement best describes your hands on responsibility for architecting and tuning cloud native data lake/warehouse solutions (e.g., AWS S3 + Glue/Redshift, GCP BigQuery, Azure Synapse)? Select What best reflects your experience building ETL/ELT workflows with Apache Airflow (or More ❯

Databricks Data Engineer - Newcastle (hybrid) - £450/pd Please note - this role will require you to attend the Newcastle-upon-tyne based office 2-3 days per week. To be eligible for this role you must have the unrestricted right to work in the UK - this organisation is not able to offer sponsorship. A leading construction organisation is … seeking an experienced Azure Databricks Data Engineer to support the ongoing development and optimisation of their cloud data platform. Key Responsibilities: Enhance and scale the existing Azure Databricks environment. Collaborate with data architects and analysts to deliver robust data pipelines. Implement best practices for data engineering, performance tuning, and security. … with stakeholders to understand data requirements and deliver solutions. Required experience: Strong hands-on experience with Azure Databricks and Spark. Solid understanding of Azure Data Lake, Data Factory, and Synapse. Proven track record in building scalable data pipelines and ETL processes. Experience working in hybrid environments and cross-functional teams. Logistical More ❯

Volt is Immediately Hiring for - Data Modeler & Architect-Remote As a Data Modeler & Architect, You will: Requirements (Must Haves) : Qualifications Experience with data modeling for Microsoft enterprise data warehousing, including analytical models. Experience working directly with client stakeholders and business users on data needs analysis. Development and implementation of transactional …/dimensional data models, source-target mapping, data transformation logic, data standards, data quality resolution. Experience developing conceptual, logical, and physical data models. … Demonstrated experience with the definition, design, and development of subject specific domain data models supporting reporting and queries. Experience with and knowledge of Azure Data Lake Services, Azure Synapse Analytics, Azure SQL MI, and other related services. This is a Full Time ,Contract opportunity. Location : Remote Contract : 6+ Month (Possibly Conversion) Pay Rate : $60.00 - $70.00 More ❯

e.g. CRM, Loyalty management, CDP, Offer Management Systems) Ensuring optimized integration of MarTech tools with existing enterprise platforms (e.g. CDP, CMS, Marketing automation, Analytics) Designing solution, application, and data architecture to maximize the impact of marketing efforts of an organization Developing feasibility studies, technical concepts, executing technical proofs of concept, and scaling software solutions Performing technology assessments and … management and support Designing work packages/modules in IT implementation projects Evaluating products, SW packages, and solutions, including comparative studies across organizations' systems (e.g., ERPs, HR systems, Data Analytics) Assessing quality assurance for IT implementation Communication and Collaboration Crafting compelling narratives, translating complex ideas for both technical and non-technical audiences Delivering impactful presentations, leading modules, presenting … methodologies, design patterns and associated tooling (API and Microservices architecture) Structured and unstructured databases and usage patterns Data platform architecture and associated patterns (e.g. Data Lake, Data Warehouse, Lakehouse, etc.) Data analytics, AI and GenAI architecture Application modernization, programming paradigms and approaches (e.g. object-oriented) Mainframe architecture Process automation approaches and More ❯

e.g. CRM, Loyalty management, CDP, Offer Management Systems) Ensuring optimized integration of MarTech tools with existing enterprise platforms (e.g. CDP, CMS, Marketing automation, Analytics) Designing solution, application, and data architecture to maximize the impact of marketing efforts of an organization Developing feasibility studies, technical concepts, executing technical proofs of concept, and scaling software solutions Performing technology assessments and … management and support Designing work packages/modules in IT implementation projects Evaluating products, SW packages, and solutions, including comparative studies across organizations' systems (e.g., ERPs, HR systems, Data Analytics) Assessing quality assurance for IT implementation Communication and Collaboration Crafting compelling narratives, translating complex ideas for both technical and non-technical audiences Delivering impactful presentations, leading modules, presenting … methodologies, design patterns and associated tooling (API and Microservices architecture) Structured and unstructured databases and usage patterns Data platform architecture and associated patterns (e.g. Data Lake, Data Warehouse, Lakehouse, etc.) Data analytics, AI and GenAI architecture Application modernization, programming paradigms and approaches (e.g. object-oriented) Mainframe architecture Process automation approaches and More ❯