76 to 100 of 293 Data Lake Jobs

Enterprise Architect - AI/Data Department: Information Technology Location: Onsite -Washington, DC Role Type: 6-Month contract (with possibility for extension based on performance) About Our Client This organization is a global technology solutions provider with a strong history of delivering innovation and results across industries. They partner with major technology leaders as well as emerging players, employing … they pride themselves on fostering a culture of collaboration, growth, and customer success. Job Description You will use your deep knowledge of Enterprise Architecture principles, AI technologies, and data management practices to guide decision-making and ensure that the architecture supports business objectives and enhances operational capabilities. Duties and Responsibilities - Design and develop end-to-end AI and … and on-premises data architectures using platforms like Azure, AWS, or Google Cloud. - Work with big data technologies (e.g., Hadoop, Spark) and data lake architectures to ensure the organization's data can be ingested, processed, and analyzed at scale. - Manage the integration of AI models and algorithms into big data More ❯

Data Engineer - Azure/Microsoft Fabric City of London - Hybrid Working Circa £60k-70k + Bonus & Benefits Our client, a forward-thinking and globally connected staffing & consulting organization is seeking a skilled and driven Data Engineer to join their growing Data & Analytics team. Based in the City of London, this role presents a fantastic … a data engineering or similar technical role Hands-on experience with key Microsoft Azure services: Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Azure SQL Database Solid understanding of data modeling, ETL/ELT, and warehousing concepts Proficiency in SQL and one or more programming languages (e.g., Python, Scala … with software testing methodologies and development team collaboration Experience working with Power BI and DAX Strong documentation, communication, and stakeholder engagement skills Preferred Qualifications: Experience with Lakehouse architecture, Delta Lake, or Databricks Exposure to Agile/Scrum working practices Microsoft certifications (e.g., Azure Data Engineer Associate) Background in consulting or professional services Understanding of data More ❯

Senior Data Engineer, Databricks, £ 60000 - 65000 + benefits. Strong Performant SQL and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role. Knowledge of testing, the finance sector or energy sector is a distinct advantage. Expanding SaaS product company are looking … for a number of Senior Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing … technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Senior Data Engineer, Databricks (Mid Level roles also available), £ 50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Knowledge of the finance sector or energy sector is an advantage. Expanding SaaS product company are looking for a … number of Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean … the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning) and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

A client of Innova Solutions is immediately hiring a Data Architect. Position Type: Full Time, Direct Hire Duration: Direct Hire Location: Tampa, FL (Onsite) As a Data Architect, you will: • Defines and plans database architectures for enterprise systems. • Working with the Business to assess requirements, the incumbent will design and implement an Enterprise Data solution to drive data-driven decision making, optimize reporting accuracy and improve operational efficiency. • Serve as the subject matter expert on data management, emerging technologies, and market trends, advising leadership on best practices. • Communicate effectively with end-users, support staff, management, and other departments on all data-related initiatives. • Establish and maintain … delivery • Deep understanding of SQL, query optimization, and performance tuning • 7+ years of database design and Modeling • 5+ years of experience in Data Warehouse Data Lake • Knowledgeable in designing and constructing data architectures, operational data stores, data marts, and lakehouses with a good understanding of AI foundational requirements • Demonstrated More ❯

Data Architect £130,000 GBP Remote WORKING Type: Permanent Data Architect Up to £130,000 Bonus Location: Homeworker- UK Additional Locations: Belfast, Birmingham, London Type: Permanent A global leader in IT solutions in Consulting is seeking a Data Architect with experience across the UK Public sector to join their elite, fast growing Data practice & Intelligence practice. This is a key role in an award-winning Data & AI Team , using cutting-edge technology and industry -leading expertise to solve real-world problems. You'll drive driving SME data architecture strategies, in a client-facing leadership role with a focus on managing employee performance and team development. A successful … defining information handling models and capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem Enterprise Data Architecture experience. Why Choose This Data Architect Role? Competitive salary up More ❯

Data Architect £130,000 GBP Remote WORKING Type: Permanent Data Architect Up to £130,000 Bonus Location: Homeworker- UK Additional Locations: Belfast, Birmingham, London Type: Permanent A global leader in IT solutions in Consulting is seeking a Data Architect with experience across the UK Public sector to join their elite, fast growing Data practice & Intelligence practice. This is a key role in an award-winning Data & AI Team , using cutting-edge technology and industry -leading expertise to solve real-world problems. You'll drive driving SME data architecture strategies, in a client-facing leadership role with a focus on managing employee performance and team development. A successful … defining information handling models and capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem Enterprise Data Architecture experience. Why Choose This Data Architect Role? Competitive salary up More ❯

As a Senior Data Engineer specializing in Natural Gas and Power, you will support the design, development, and optimization of advanced data infrastructure and products that support critical trading, risk, and market analytics functions. You will collaborate closely with traders, quantitative analysts, risk managers, and IT stakeholders to ensure data systems are scalable, secure … ETL/ELT frameworks and orchestration tools (e.g., Airflow, Azure Data Factory, Dagster). Proficient in cloud platforms (preferably Azure) and services such as Data Lake, Synapse, Event Hubs, and Functions. Authoring reports and dashboards with either open source or commercial products (e.g. PowerBI, Plot.ly, matplotlib) Programming OOP DevOps Web technologies HTTP/S REST … with time-series databases (e.g., InfluxDB, kdb+, TimescaleDB) and real-time data processing. Familiarity with distributed computing and data warehousing technologies (e.g., Spark, Snowflake, Delta Lake). Strong understanding of data governance, master data management, and data quality frameworks. Solid grasp of web technologies and APIs (REST, JSON, XML More ❯

Enterprise Architect - AI/Data Washington, DC (5 days a week on-site) Public Trust You will use your deep knowledge of enterprise architecture principles, AI technologies, and data management practices to guide decision-making and ensure that the architecture supports business objectives and enhances operational capabilities. Key Responsibilities: • Design and develop end-to-end AI … and data architectures that support business goals, ensuring scalability, performance, security, and maintainability. • Create architectural blueprints and roadmaps that guide the integration of AI and data solutions across the organization. • Lead the development and implementation of data platforms and AI-driven systems that facilitate advanced analytics, machine learning, and automation. • Define AI strategy and … and on-premises data architectures using platforms like Azure, AWS, or Google Cloud. • Work with big data technologies (e.g., Hadoop, Spark) and data lake architectures to ensure the organization's data can be ingested, processed, and analyzed at scale. • Manage the integration of AI models and algorithms into big data More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

JOB TITLE: ENTERPRISE ARCHITECT AI/DATA JOB LOCATION: WASHINGTON, DC WAGE RANGE : 87-92/hr JOB NUMBER: 25-03420 REQUIRED EXPERIENCE: • Bachelor's or Master's degree in Computer Science, Information Systems, Data Science, Engineering, or a related field. • 7+ years of experience in enterprise architecture, with at least 3-5 years of focused … experience in AI and data-driven architecture design. • Extensive experience in enterprise architecture frameworks (e.g., TOGAF, Zachman). • Expertise in AI/ML technologies (e.g., TensorFlow, PyTorch, Scikit-learn, Keras) and understanding of deep learning and natural language processing (NLP). • Strong understanding of big data platforms such as Hadoop, Apache Spark, and data … and on-premises data architectures using platforms like Azure, AWS, or Google Cloud. • Work with big data technologies (e.g., Hadoop, Spark) and data lake architectures to ensure the organization's data can be ingested, processed, and analyzed at scale. • Manage the integration of AI models and algorithms into big data More ❯

compensation and benefits program, employees are also eligible for performance-based cash incentive awards. Salary Range $106,300.00 - $175,400.00 Target Openings 1 What Is the Opportunity? Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer, you will play a key … You will leverage your ability for the team members supporting Enterprise Underwriting, they will be helping to reinvent global underwriting analytics at Travelers. They will be curating the data to support the proverbial cockpit controls in an airplane that senior leaders will use to make underwriting decisions at Travelers. What Will You Do? Build and operationalize complex data … OpenShift/Open Cloud Foundry, MongoDB, Docker, BlackDuck, SonarQube Knowledge and experience with the some of the following concepts: Real-time & Batch Data Processing, Workload Orchestration, Cloud, Datalakes, Data Security, Networking, Serverless, Testing/Test Automation (Unit, Integration, Performance, etc.), WebServices, DevOps, Logging, Monitoring, and Alerting, Containerization, Encryption/Decryption, Data Masking, Cost & Performance More ❯

Data Engineer Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a … major transformation, integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting. With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential … PySpark Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse Strong command of SQL Excellent communication and collaboration skills What's in It for You: Up to £60,000 salary depending on experience More ❯

Data Engineer Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a … major transformation, integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting. With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential … PySpark Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse Strong command of SQL Excellent communication and collaboration skills What's in It for You: Up to £60,000 salary depending on experience More ❯

to Washington DC 5 days a week 2) You are willing to obtain public trust for DOJ which can take up to 3 months Enterprise Architect - AI/Data Washington, DC (5 days a week on-site) Public Trust You will use your deep knowledge of enterprise architecture principles, AI technologies, and data management practices to … guide decision-making and ensure that the architecture supports business objectives and enhances operational capabilities. Key Responsibilities: • Design and develop end-to-end AI and data architectures that support business goals, ensuring scalability, performance, security, and maintainability. • Create architectural blueprints and roadmaps that guide the integration of AI and data solutions across the organization. • Lead the … and on-premises data architectures using platforms like Azure, AWS, or Google Cloud. • Work with big data technologies (e.g., Hadoop, Spark) and data lake architectures to ensure the organization's data can be ingested, processed, and analyzed at scale. • Manage the integration of AI models and algorithms into big data More ❯

compensation and benefits program, employees are also eligible for performance-based cash incentive awards. Salary Range $123,000.00 - $203,000.00 Target Openings 1 What Is the Opportunity? Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer, you will play a key … role in growing and transforming our analytics landscape. In addition to your strong analytical mind, you will bring your inquisitive attitude and ability to translate stories found in data by leveraging a variety of data programming techniques. You will leverage your ability to design, build and deploy data solutions that capture, explore, transform, and … utilize data to support Artificial Intelligence, Machine Learning and business intelligence/insights. What Will You Do? Build and operationalize complex data solutions, correct problems, apply transformations, and recommending data cleansing/quality solutions. Design complex data solutions Perform analysis of complex sources to determine value and use and recommend data More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester(Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies)About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment.About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate … in an agile team.Experience working in a highly regulated industry and with highly sensitive data.Exposure to large data solutions like Snowflake, Trino, Synapse, Azure Data Lake, and Databricks.Experience in data science using R, Stata, or Python.Familiarity with Atlassian tools such as JIRA, Confluence, and BitBucket.Understanding of clinical trials, GCP, and GxP.What We Offer More ❯

Senior Data Engineer, Databricks (Mid Level roles also available), £ 50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Knowledge of the finance sector or energy sector is an advantage. Expanding SaaS product company are looking for a … number of Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean … the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning) and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Senior Databricks Data Engineer (Mid Level roles also available), £ 50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Expanding SaaS product company are looking for a number of Data Engineer as they continue to grow. … In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean and high performant code. Responsibilities include - Work with the Data … the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning) and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Job Description: Responsibilities: AWS Lake Formation Implementation: Configure and manage AWS Lake Formation to establish secure, scalable data lakes, ensuring robust data governance and access control. IAM Configuration: Implement and manage AWS IAM solutions, including role-based access control (RBAC) and least privilege access to protect critical systems and data. Access Control Automation: Develop … offboarding, and access reviews. Identity Governance: Implement identity governance practices to ensure regular review, validation, and auditing of user access permissions. Data Security and Compliance: Utilize AWS Lake Formation to enforce data governance policies and ensure compliance with export control regulations. Documentation: Create and maintain detailed documentation of configurations, processes, and security protocols for internal … use and audits. 5+ years of experience with AWS services, with at least 2 years of hands-on experience with Lake Formation. Strong command of IAM, KMS, S3 bucket policies, and VPC security controls. Deep understanding of Lake Formation resource links, cross-account permissions, and data mesh architecture principles. Experience with data cataloging, classification More ❯

Our market leading client have a current requirement for an experienced Senior Project Manager/Data Delivery Lead to manage and help shape a newly formed small data engineering, analysis and reporting team. This is a hands on role focused on delivery and will suit someone who enjoys being embedded with a team. The successful candidate … data engineering teams in large complex enterprises Must have previously worked on data platform, data analytic, data warehouse, data lake, data migration projects within a large organisation environment Adept using a range of project methodologies including Agile and ideally Scrum methodologies. Any prior Scrum Master exposure would More ❯