51 to 75 of 280 Data Lake Jobs

This newly created Data Engineer Managers position is an excellent opportunity for a hands-on Senior Data Engineer/Technical Lead/Engineering Team Lead etc looking to move into a management position. The postholder will lead and mentor a team of 3 Data Engineers whilst overseeing data platform development and optimisation. … Our client is a well-established and rapidly growing global ecommerce business with its headquarters based in London. The Data Engineer Manager will play a pivotal role at the heart of our clients data & analytics operation. Having implemented a new MS Fabric based Data platform, the need is now to scale up and meet … the demand to deliver data driven insights and strategies right across the business globally. Therell be a hands-on element to the role as you'll be troubleshooting, doing code reviews, steering the team through deployments and acting as the escalation point for data engineering. This is a hybrid role based in Central/West London More ❯

Data Lead This role can be based in either UK or Portugal Who we are? Verifile is an award-winning leading provider of CV verification and background screening services using innovative technology and methodology. We carry out background checks on candidates to enable our clients to make informed and long-term rewarding recruitment decisions. As Data Lead, youll be the driving force behind ensuring our data is accurate, secure, and fully leveraged. Youll create a single source of truth, turning information into actionable insights and uncovering opportunities that give us a competitive edge. Youll design and evolve Verifiles data infrastructure, adopting emerging technologies to boost performance and efficiency. Partnering with … approach. Experience in SaaS or platform-based businesses is a plus. Experience in data roles (data engineering, BI, analytics or architecture). Data lake storage, SQL database, NoSQL Sound understanding of database architecture and relevant underpinning concepts, including relational data modelling, frameworks, warehouse and data lake design, performance More ❯

up of product, development, commercial, operations, marketing, partnerships and more - all focused together on making Octopus the go-to name in EV charging. We are seeking a passionate data professional to drive the electrification of transport by transforming complex information into strategic assets. You will work with a rich variety of datasets, including charge point telemetry, user behaviour … we can teach that), but a passion for the transition to net zero is an excellent start What We Work With dbt for data modelling Databricks Delta Lake for data lake and warehouse storage and querying Python as our main programming language Jupyter and Jupyter Hub for notebook analytics and collaboration Circle CI for … task orchestration Google Analytics, Amplitude and Firebase for client applications event processing Airflow for job scheduling and tracking Parquet and Delta file formats on S3 for data lake storage Streamlit for data applications Why else you'll love it here Wondering what the salary for this role is? Just ask us! On a call with More ❯

Purpose of the Role: To design, build, and maintain the systems that collect, process, and analyse data - including pipelines, data warehouses, and data lakes - ensuring data is accurate, accessible, and … secure. Key Responsibilities: Develop, maintain, and optimise scalable data pipelines and data storage solutions. Design and implement data warehousing and data lake architectures. Ensure robust data governance, security, and compliance across all systems. Collaborate with cross-functional teams to gather requirements and deliver solutions that support business objectives. Apply … machine learning and data mining techniques where appropriate to add value. Support change and transformation initiatives by providing reliable data systems. Identify risks, implement controls, and follow secure coding practices. Provide strategic input on data architecture, technology adoption, and best practices. Skills & Competencies: Strong knowledge of database structures, data modelling, and data More ❯

make over 10,500 daily deliveries of our own chilled and frozen produce and that of third parties. Why is this exciting for your career as a Senior Data Engineer? The MBE Programme presents a huge opportunity for colleagues across the technology function to play a central role in the design, shape, delivery and execution of an enterprise … operational excellence agendas, whilst supporting managing our cost base effectively in the future. The MBE Programme will streamline and simplify core processes, provide easier access to quality business data and will invest in the right technology to enable these processes. What you'll be doing: As a Senior Data Engineer, you will play a key role … in shaping and delivering enterprise-wide data solutions that translate complex business requirements into scalable, high-performance data platforms. In this role, you will help define and guide the structure of data systems, focusing on seamless integration, accessibility, and governance, while optimising data flows to support both analytics and operational needs. Collaborating More ❯

and Intelligence challenges through IT solutions. We emphasize teamwork and focus on achieving goals to complete deliverables efficiently, on-time, and under budget. We are currently seeking a Data Engineer/Data Architecct to join our team to support our Government Partner. Primary Job Duties and Required Work Experience: Design, build, and maintain data pipelines that efficiently ingest, process, and transform data from various sources for analysis Collaborate with data scientists and analysts to understand data requirements and ensure data quality and accessibility. Develop and implement data governance policies and procedures to ensure data integrity and security. Stay current on … processing and analysis. Data Visualization: Proficiency in creating interactive dashboards and visual representations of data, potentially using tools like Tableau. Experience with data lake and data lake technologies and best practices Job Requirements • Active TS/SCI + Full Scope Poly U.S. Government Security is required. • Education and Years of More ❯

Role: Head of Data Management Location: Milton Keynes (Hybrid 2 Days On-site Weekly) Salary: £55,000 - £70,000 Benefits: Bonus, Company Cars, Flexible Benefit Package Network IT is recruiting for a Head of Data Management to join a leading automotive brand's UK IT function. In this senior role, youll lead a high-performing data … IT, youll take ownership of operational excellence, stakeholder engagement, and vendor performance across a broad data estate including Azure Data Factory and Data Lake technologies. The role will combine hands-on technical understanding with strategic planning, people leadership, and commercial management. Key Responsibilities: Lead and manage a data-focused IT team … ideally within complex enterprise environments. Strong experience in IT service management, strategy planning, and business process alignment. Hands-on knowledge of Azure Data Factory, Data Lake , and data pipeline architecture. Proven experience managing data security, access, and regulatory compliance. Familiarity with automation tools (AI, RPA) and Agile project delivery (e.g. Scrum More ❯

with GenAI consulting specialist? Do you have real-time Data Analytics, Data Warehousing, Big Data, Modern Data Strategy, Data Lake, Data Engineering and GenAI experience? Do you have senior stakeholder engagement experience to support pre-sales and deliver consulting engagements? Do you like to solve the most … complex and high scale (billions+ records) data challenges in the world today? Do you like leading teams through high impact projects that use the latest data analytics technologies? Would you like a career path that enables you to progress with the rapid adoption of cloud computing? AWS Professional Services Public Sector ANZ are hiring a highly … learn and use services such as AWS Glue, Amazon S3, Amazon DynamoDB, Amazon Relational Database Service (RDS), Amazon Elastic Map Reduce (EMR), Amazon Kinesis, Amazon Redshift, Amazon Athena, AWS Lake Formation, Amazon DataZone, Amazon SageMaker, Amazon Quicksight and Amazon Bedrock. Solutions: Support pre-sales and deliver technical engagements with partners and customers. This includes participating in pre-sales visits More ❯

Data Architect page is loaded Data Architectremote type: On-Sitelocations: Crawleytime type: Full timeposted on: Posted Todaytime left to apply: End Date: October 6, 2025 (19 days left to apply)job requisition id: RLocation: Crawley, United KingdomIn fast changing markets, customers worldwide rely on Thales. Thales is a business where brilliant people from all over the … working, or the ability to flex your start and finish times. Where possible, we support a working pattern that suits your lifestyle and helps you reach your ambitions. Data Architect Thales Group's global CortAIx initiative already employs over 600 AI and data specialists, being the first patent applicant in AI for critical systems in Europe … AI innovation, bringing together cutting-edge technology, talent, and research to deliver AI solutions that are ethical, transparent, explainable, and operationally effective.We are seeking a talented and experienced Data Architect to join our dynamic team. The ideal candidate will possess a strong background in data architecture principles and practices, with the ability to design, implement, and More ❯

solutions that support the Sales Compensation division. The ideal candidate will have experience with Microsoft SQL Server, Azure SQL, Azure Data Factory, and Azure Data Lake Storage Gen2 (ADLS Gen2). This position requires a dynamic, hard-working professional with a solid technical background and a desire to work in a fast-paced, large corporate … environment.Job Description Key Responsibilities: Assist in the design and creation of logical and physical data models. Develop, implement, test, and optimize complex stored procedures, functions, and views using T … SQL in Microsoft SQL Server and Azure SQL databases. Design and implement scalable, secure data pipelines using Azure Data Factory and Azure Data Lake, supporting both batch and incremental processing. Establish and promote data integration best practices including naming conventions, metadata standards, and pipeline orchestration patterns. Identify and resolve gaps in More ❯

Overview We're seeking a Senior Data Scientist to lead the development of advanced analytics and AI/ML solutions that unlock real value across our business. This is a contract role for 6 months . In this contract role, you'll work with proprietary and B2B research datasets to design, deliver, and scale data-driven … Research, and Technology, you'll help turn strategic ideas into working MVPs-ensuring high standards of methodology, quality, and business relevance throughout. You'll also help shape the data science environment by working alongside our tech teams to support a robust and flexible infrastructure, including sandbox environments for onboarding and evaluating new data sources. This is … analytics "products" could be refined and productionized in the future. Work with Tech colleagues to improve the Data Science workspace, including providing requirements for Data Lake, Data Pipeline, and Data Engineering teams. Expand on the tools and techniques already developed. Help us understand our customers (both internal and external) better so More ❯

Data Services Manager, Must live within 2 hours of London and be able to come in for ad-hoc meetings when required. Primarily home based though. Role 90% management and 10% technical and you will manage a team of 6. Salary £ 80000 - 85000 + good benefits. Expanding financial services client are looking for a Data Services … years and is looking to further develop their management career. Guiding a team of 6 you will be responsible for supporting the day to day operations of the data function, with a focus on leading and mentoring data engineers to deliver high quality, scaleable data solutions. Working across the business with multiple stakeholders you … mentoring, coaching, team development etc) Very strong technical skills that will include - SQL, SSIS, SSRS, SAS, Power BI, Power Platform, Azure Data Factory, Azure Data Lake, Databricks A good understanding of dimensional modelling techniques, including Kimball's Business Development Lifecycle Ability to design hybrid data solutions across on-prem and cloud data More ❯

an opening with one of our clients, please let me know if you are available for this role. Location: Dauphin County, PA (Hybrid) Duration: 6+ months REQUIREMENTS The Data Modeler/Data Architect is a senior level resource with specialized knowledge and experience in data analysis, data modeling and database design. The … data dictionaries, and metadata repositories. REQUIRED SKILLS: The Data Modeler/Architect can design, develop, and implement data models and data lake architecture to provide reliable and scalable applications and systems to meet the organization's objectives and requirements. The Data Modeler is familiar with a variety of database … dimensions, and star schema concepts and terminology Strong proficiency with SQL Server, T-SQL, SSIS, stored procedures, ELT processes, scripts, and complex queries Working knowledge of Azure Databricks, Delta Lake, Synapse and Python Experience with evaluating implemented data systems for variances, discrepancies, and efficiency Experience with Azure DevOps and Agile/Scrum development methods Auditing databases to More ❯

the new position The Wingbrace Development organization is charged with identifying, developing and applying new technologies that can address the Government's most challenging Software, Systems, Cloud and Data Engineering problems. This is an opportunity for experienced software and systems engineers who are highly motivated, innovative and self-directed. This position provides challenging opportunities to apply and expand … s cloud engineering, full stack (equally versed in front and back-end coding), systems architecture experience. Specific areas of interest include software and systems architecture capture, data lake/data warehouse implementation, data visualization, analysis of complex systems, and decision support. This position is located in Lincoln Massachusetts. This position will require working … interface management and architecture change management processes using best-of-breed tools like Rational DOORS and Siemens Teamcenter Developing a data analytics pipeline using data lake and data warehouse architectures and visualizations with Python Estimating, planning, scheduling, and executing data engineering activities Supporting proposal efforts to capture new business Organizing work More ❯

Senior Data Architect Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to Be Yourself At Work. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that we recruit and develop as diverse a range of talent … Focused on maintaining our nimble, agile and entrepreneurial culture. Your Capco Day/Key Responsibilities You will accompany and lead complex agile consulting projects supporting our clients with data architecture design and delivery. You will work with technology leaders across Financial Services to provide best practice guidance for data management and data architecture development … . Knowledge of the relevant procedures, architectures and technologies in one or more of the following topics: Contextual Datamodelling, Entity Relationship Modelling, Logical & Physical Datamodelling and Data Lake design. Experience designing and implementing cloud data migration and storage patterns on one or more of AWS, GCP and Microsoft Azure Experience implementing and integrating data More ❯

Job summary The role holder is responsible for the leading the design, development, and ongoing enhancement of organisations data infrastructure and pipelines to support advanced data collection, storage, processing, and analysis. Main duties of the job The role holder is accountable for a team of data engineers, fostering a culture of technical excellence and … continuous improvement. The role holder will work collaboratively with cross-functional teams, including analysts, software engineers, and key stakeholders, to ensure that data solutions are robust, scalable, and aligned with the strategic goals of delivering high-quality care for our patients. About us Since 2012, CHEC has been working with the NHS to increase patient choice and provide … applicants may be required to undertake an Enhanced Disclosure via the Disclosure and Barring Service (DBS). Job description Job responsibilities Lead the design and execution of scalable data storage solutions, including databases, data warehouses, and data lakes, ensuring efficient handling of large data volumes. Oversee development and optimisation of ETL pipelines More ❯

Senior Data Engineer - Azure, Data Factory, Datalakes, SQL - £65,000 - Remote Industry: Retail & eCommerce Role: Senior Data Engineer Location: Remote Salary: £65,000 Benefits The Company We're working with one of the UK's leading retail and e-commerce brands; a business that's experiencing rapid growth and investing heavily in data, analytics, and technology to stay ahead of the competition. With millions of customers, an ever-expanding online presence, and a dynamic product offering, data is at the heart of every decision they make. Their mission is to transform how data is captured, engineered, and consumed across the organisation. Enabling & empowering smarter insights and creating … driven recruitment consultancy supporting data and technology professionals connect with forward-thinking businesses who enhance our tomorrow. Senior Data Engineer - Azure, Data Factory, Datalakes, SQL - £65,000 - Remote More ❯

behind database performance, resilience, and compliance, while steering the evolution from traditional systems to modern cloud-based solutions. From enterprise-scale SQL Server estates to emerging data lake technologies, this role offers both breadth and depth, with real influence across business-critical systems. What you'll be doing Lead database strategy, ensuring high availability, scalability and cost … efficiency. Drive performance tuning, optimisation and proactive monitoring for reliable services. Oversee upgrades, migrations and integrations with modern platforms (Azure, Data Lake, Fabric). Manage BAU operations: patching, security updates, backups and incident resolution. Partner with teams and providers to ensure governance, GDPR, PCI-DSS compliance and operational excellence. Support new change deployments and contribute to the … replication and DR strategies. Experience with Azure services (Data Factory, Logic Apps, Data Sync) and exposure to data lakes (Azure Data Lake, Fabric, Delta Live Tables). Understanding of Windows Server, Active Directory and infrastructure dependencies. Excellent communication skills with the ability to engage stakeholders. Familiarity with DevOps (CI/CD More ❯

been turning down headhunters for years. Whatever your priorities - work/life balance, career progression, sustainability, volunteering - you'll find like-minded people driving change at Howden. Lead Data Business Partner We are looking for a talented Data Business Partner to help pro-actively drive data and AI strategy supporting both our DUAL MGA … operating efficiencies, capturing benefit and ROI. Scoping out landscape, baseline and country health-check comparisons within the region. Understanding what data is in the Data Lake and how this can be leveraged, including looking for common opportunities and supporting prioritisation of the data ingestion roadmap. Stakeholder management directly managing relationships with the commercial … understand the costs/benefits and managing business expectations on delivery. Enabling regional colleagues to complete reporting tasks with PowerBI using data from the Data Lake, understanding content and how to get value out of it. Being the point person for Data Quality and remediation, working with the Group Data Quality More ❯

Office West Crk - 12800 Tuckahoe Creek Parkway, Richmond, Virginia, 23238 CarMax, the way your career should be! Essential Responsibilities: Partner with stakeholders across various business units and other Data & Analytics leaders to influence strategic plans and roadmaps. Identify new opportunities for Data & Analytics solutions by cultivating relationships with leaders across the organization and foster those partnerships. … and efficiently leveraging team talent Guide teams to design and implement intelligent, predictable, reliable, scalable, cost-efficient, and easy-to-use platforms/solutions/services to serve Data & Analytics needs of the organization and solve for complex business problems Maintain FinOps focus for cloud costs and actively manage contracts and consulting expenditure. Continuously optimize the spend using … 8+ years of Data & Analytics experience in an enterprise-level environment in two or more of the following areas: Data Engineering (Enterprise Data Lake/Data Warehouse), Cloud Computing, Systems Engineering, Master Data Management (MDM), Machine Learning (ML) Engineering, Infrastructure & Operations, Site Reliability Engineering (SRE), Data Governance More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £65,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … Cloud data platform development and deployment. Expertise across data warehouse and ETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on Offer: Salary to £65,000 + benefits Hybrid working More ❯

Data Services Manager, Must live within 2 hours of London and be able to come in for ad-hoc meetings when required. Primarily home based with occasional office meetings. Role 90% management and 10% technical and you will manage a team of 6. Salary £ 80000 - 85000 + good benefits. Expanding financial services client are looking for a Data … years and is looking to further develop their management career. Guiding a team of 6 you will be responsible for supporting the day to day operations of the data function, with a focus on leading and mentoring data engineers to deliver high quality, scaleable data solutions. Working across the business with multiple stakeholders you … and then into a management Very strong technical skills that will include - SQL, SSIS, SSRS, SAS - Power BI, Power Platform - Azure Data Factory, Azure Data Lake, Databricks A good understanding of dimensional modelling techniques, including Kimball's Business Development Lifecycle Ability to design hybrid data solutions across on-prem and cloud data More ❯

The Data Engineer is responsible for the end-to-end design, build, and deployment of M1's centralized data platform within the Azure Government Community Cloud (GCCH) environment. This senior-level role requires deep technical expertise to architect, implement, and sustain secure, scalable, and compliant data infrastructure. In addition to technical delivery, the Data … engineering and predictive analytics initiatives. Primary responsibilities include but are not limited to the following: Architecture and Build Out Design, implement, and manage M1's centralized Data Lake/Data Intelligence Platform in Azure GCCH. Develop secure, scalable pipelines to ingest, transform, and integrate diverse data sources (operational, personnel, parts, aircraft, and program … data platforms end-to-end (architecture through production). Hands-on expertise with: o Azure Synapse Analytics, Data Factory, Databricks, Event Hubs, Data Lake Storage (Gen2). o Database technologies (SQL Server, PostgreSQL, Cosmos DB). o Programming languages (Python, PySpark, SQL). Strong experience in data security, access management, and More ❯

Enterprise Architect - AI/Data Department: Information Technology Location: Onsite -Washington, DC Role Type: 6-Month contract (with possibility for extension based on performance) About Our Client This organization is a global technology solutions provider with a strong history of delivering innovation and results across industries. They partner with major technology leaders as well as emerging players, employing … they pride themselves on fostering a culture of collaboration, growth, and customer success. Job Description You will use your deep knowledge of Enterprise Architecture principles, AI technologies, and data management practices to guide decision-making and ensure that the architecture supports business objectives and enhances operational capabilities. Duties and Responsibilities - Design and develop end-to-end AI and … and on-premises data architectures using platforms like Azure, AWS, or Google Cloud. - Work with big data technologies (e.g., Hadoop, Spark) and data lake architectures to ensure the organization's data can be ingested, processed, and analyzed at scale. - Manage the integration of AI models and algorithms into big data More ❯

Data Engineer - Azure/Microsoft Fabric City of London - Hybrid Working Circa £60k-70k + Bonus & Benefits Our client, a forward-thinking and globally connected staffing & consulting organization is seeking a skilled and driven Data Engineer to join their growing Data & Analytics team. Based in the City of London, this role presents a fantastic … a data engineering or similar technical role Hands-on experience with key Microsoft Azure services: Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Azure SQL Database Solid understanding of data modeling, ETL/ELT, and warehousing concepts Proficiency in SQL and one or more programming languages (e.g., Python, Scala … with software testing methodologies and development team collaboration Experience working with Power BI and DAX Strong documentation, communication, and stakeholder engagement skills Preferred Qualifications: Experience with Lakehouse architecture, Delta Lake, or Databricks Exposure to Agile/Scrum working practices Microsoft certifications (e.g., Azure Data Engineer Associate) Background in consulting or professional services Understanding of data More ❯