76 to 100 of 244 Permanent Data Lake Jobs

Data Architect £130,000 GBP Remote WORKING Type: Permanent Data Architect Up to £130,000 Bonus Location: Homeworker- UK Additional Locations: Belfast, Birmingham, London Type: Permanent A global leader in IT solutions in Consulting is seeking a Data Architect with experience across the UK Public sector to join their elite, fast growing Data practice & Intelligence practice. This is a key role in an award-winning Data & AI Team , using cutting-edge technology and industry -leading expertise to solve real-world problems. You'll drive driving SME data architecture strategies, in a client-facing leadership role with a focus on managing employee performance and team development. A successful … defining information handling models and capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem Enterprise Data Architecture experience. Why Choose This Data Architect Role? Competitive salary up More ❯

As a Senior Data Engineer specializing in Natural Gas and Power, you will support the design, development, and optimization of advanced data infrastructure and products that support critical trading, risk, and market analytics functions. You will collaborate closely with traders, quantitative analysts, risk managers, and IT stakeholders to ensure data systems are scalable, secure … ETL/ELT frameworks and orchestration tools (e.g., Airflow, Azure Data Factory, Dagster). Proficient in cloud platforms (preferably Azure) and services such as Data Lake, Synapse, Event Hubs, and Functions. Authoring reports and dashboards with either open source or commercial products (e.g. PowerBI, Plot.ly, matplotlib) Programming OOP DevOps Web technologies HTTP/S REST … with time-series databases (e.g., InfluxDB, kdb+, TimescaleDB) and real-time data processing. Familiarity with distributed computing and data warehousing technologies (e.g., Spark, Snowflake, Delta Lake). Strong understanding of data governance, master data management, and data quality frameworks. Solid grasp of web technologies and APIs (REST, JSON, XML More ❯

Enterprise Architect - AI/Data Washington, DC (5 days a week on-site) Public Trust You will use your deep knowledge of enterprise architecture principles, AI technologies, and data management practices to guide decision-making and ensure that the architecture supports business objectives and enhances operational capabilities. Key Responsibilities: • Design and develop end-to-end AI … and data architectures that support business goals, ensuring scalability, performance, security, and maintainability. • Create architectural blueprints and roadmaps that guide the integration of AI and data solutions across the organization. • Lead the development and implementation of data platforms and AI-driven systems that facilitate advanced analytics, machine learning, and automation. • Define AI strategy and … and on-premises data architectures using platforms like Azure, AWS, or Google Cloud. • Work with big data technologies (e.g., Hadoop, Spark) and data lake architectures to ensure the organization's data can be ingested, processed, and analyzed at scale. • Manage the integration of AI models and algorithms into big data More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

JOB TITLE: ENTERPRISE ARCHITECT AI/DATA JOB LOCATION: WASHINGTON, DC WAGE RANGE : 87-92/hr JOB NUMBER: 25-03420 REQUIRED EXPERIENCE: • Bachelor's or Master's degree in Computer Science, Information Systems, Data Science, Engineering, or a related field. • 7+ years of experience in enterprise architecture, with at least 3-5 years of focused … experience in AI and data-driven architecture design. • Extensive experience in enterprise architecture frameworks (e.g., TOGAF, Zachman). • Expertise in AI/ML technologies (e.g., TensorFlow, PyTorch, Scikit-learn, Keras) and understanding of deep learning and natural language processing (NLP). • Strong understanding of big data platforms such as Hadoop, Apache Spark, and data … and on-premises data architectures using platforms like Azure, AWS, or Google Cloud. • Work with big data technologies (e.g., Hadoop, Spark) and data lake architectures to ensure the organization's data can be ingested, processed, and analyzed at scale. • Manage the integration of AI models and algorithms into big data More ❯

compensation and benefits program, employees are also eligible for performance-based cash incentive awards. Salary Range $106,300.00 - $175,400.00 Target Openings 1 What Is the Opportunity? Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer, you will play a key … You will leverage your ability for the team members supporting Enterprise Underwriting, they will be helping to reinvent global underwriting analytics at Travelers. They will be curating the data to support the proverbial cockpit controls in an airplane that senior leaders will use to make underwriting decisions at Travelers. What Will You Do? Build and operationalize complex data … OpenShift/Open Cloud Foundry, MongoDB, Docker, BlackDuck, SonarQube Knowledge and experience with the some of the following concepts: Real-time & Batch Data Processing, Workload Orchestration, Cloud, Datalakes, Data Security, Networking, Serverless, Testing/Test Automation (Unit, Integration, Performance, etc.), WebServices, DevOps, Logging, Monitoring, and Alerting, Containerization, Encryption/Decryption, Data Masking, Cost & Performance More ❯

Data Engineer Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a … major transformation, integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting. With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential … PySpark Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse Strong command of SQL Excellent communication and collaboration skills What's in It for You: Up to £60,000 salary depending on experience More ❯

Data Engineer Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a … major transformation, integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting. With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential … PySpark Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse Strong command of SQL Excellent communication and collaboration skills What's in It for You: Up to £60,000 salary depending on experience More ❯

to Washington DC 5 days a week 2) You are willing to obtain public trust for DOJ which can take up to 3 months Enterprise Architect - AI/Data Washington, DC (5 days a week on-site) Public Trust You will use your deep knowledge of enterprise architecture principles, AI technologies, and data management practices to … guide decision-making and ensure that the architecture supports business objectives and enhances operational capabilities. Key Responsibilities: • Design and develop end-to-end AI and data architectures that support business goals, ensuring scalability, performance, security, and maintainability. • Create architectural blueprints and roadmaps that guide the integration of AI and data solutions across the organization. • Lead the … and on-premises data architectures using platforms like Azure, AWS, or Google Cloud. • Work with big data technologies (e.g., Hadoop, Spark) and data lake architectures to ensure the organization's data can be ingested, processed, and analyzed at scale. • Manage the integration of AI models and algorithms into big data More ❯

compensation and benefits program, employees are also eligible for performance-based cash incentive awards. Salary Range $123,000.00 - $203,000.00 Target Openings 1 What Is the Opportunity? Travelers Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer, you will play a key … role in growing and transforming our analytics landscape. In addition to your strong analytical mind, you will bring your inquisitive attitude and ability to translate stories found in data by leveraging a variety of data programming techniques. You will leverage your ability to design, build and deploy data solutions that capture, explore, transform, and … utilize data to support Artificial Intelligence, Machine Learning and business intelligence/insights. What Will You Do? Build and operationalize complex data solutions, correct problems, apply transformations, and recommending data cleansing/quality solutions. Design complex data solutions Perform analysis of complex sources to determine value and use and recommend data More ❯

Senior Data Engineer, Databricks (Mid Level roles also available), £ 50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Knowledge of the finance sector or energy sector is an advantage. Expanding SaaS product company are looking for a … number of Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean … the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning) and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Work with Progression, Inc. get your application bumped to the front of the line Data Engineer (Top Secret cleared) Washington, D.C MUST: Active Top Secret clearance is required Experienced Data Engineer with Palantir products, AWS, MS Google, Databricks IBM 7+ years of experience bringing databases, data integration, and data analytics/ML … Python, JavaScript, Java, Matlab, etc.) Expert knowledge in databases (SQL, NoSQL, Graph, etc.) and data architecture (Data Lake, Lakehouse) Experience with AWS solutions (Kubernetes, DataLakes, Open AI Services). Experience with PostgreSQL, ElasticSearch, MongoDB, and graph databases. Experience with GenAI enabled daily workflows (coding, testing, analytics). Experience with one or more SQL-on-Hadoop … and the full software lifecycle Experience with Agile development methodology (e.g., Scrum) Current Security+ certification (or must obtain within 30 days) Bachelor's degree in Computer Science/Data Science/Computer Engineering or relevant field, or 4+ years of experience with a PhD/MS. DUTIES: Lead the design, development, testing, and documentation of software code and More ❯

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, youll not only be part of a creative and open work culture focused on innovation and … it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. … workflows with Composer or Vertex Pipelines. Data Architecture & Modelling: Ability to translate diverse business requirements into scalable data models and architect a data lake/lakehouse environment on GCP. Engineering Best Practices: Proficiency with Git, CI/CD for data systems, and robust testing methodologies. Highly desirable skills include: Domain Experience More ❯

Data Engineer with 6+ years of experience in building data intensive applications, tackling challenging architectural and scalability problems with some exposure to gathering insights from data by leveraging various BI tools like Tableau, Power BI, MS SQL Server, and OBIEE (Oracle Business Intelligence Enterprise Edition). Demonstrate strong working knowledge with data migration and data warehouse and display excellent communication skills to be comfortable enough to interact with business areas to gather requirements and deliver BI solutions. This position is expected to be hybrid. NYC Salary Range - $105,000 - $140,000 annually; compensation is commensurate to geographic location. Regardless of seniority or role, uphold UNFCU's mission, core … complex code in stored procedures or PL SQL. Demonstrate strong exposure to relational databases technologies like Database, Data Warehouse, Data Lakes and Data Lake House. Troubleshoot to find root cause with data accuracy and/or performance related issues and find solutions to fix it by creating indexes, transaction isolation levels More ❯

it is deeply rooted throughout our work, to elevate and bring to life our differences throughout the platform world Overview We are seeking an experienced and highly skilled Data Engineering Technical Lead to drive the design, development, and optimization of our cloud-based data platforms and solutions. This role will be a blend of hands on … and strategy decisions. Initially there will be a focus on GCP but will also involve working extensively with Snowflake and Databricks, as well as other modern cloud and data engineering tools. As the technical leader for the data engineering function, you will define architectural standards, mentor engineers, and collaborate with cross-functional teams to ensure scalable … enterprise-grade data platforms on GCP, AWS, or Azure Deep expertise in data modeling, data warehousing, distributed systems, and modern data lake architectures Advanced proficiency in Python (including PySpark) and SQL, with experience building scalable data pipelines and analytics workflows Strong background in cloud-native data infrastructure More ❯

Eir Evo Talent are working with one of Europes leading Telco providers, who are looking to add further Data resources into the business. The Engineer joining the … business will play a pivotal part in designing, developing, and maintaining their Data Infrastructure, as well as playing a huge part in their Greenfield Data Lake programme of work. The Engineer will play a part in: Design, Maintain and Build the businesses Data Pipelines & Processes Speak with other members of the team to … translate Data requirements into Tech solutions. Design, build, and maintain the data warehouse, data lakehouse, and other data repositories. Implement Data best practices & Governance Skills: 2+ years of experience as a Data Engineer or similar role. Experience working with Python SQL Experience Working experience with Kubernetes Solid understanding More ❯

Sr. Delivery Consultant - Data Analytics, Professional Services Job ID: Amazon Web Services Colombia S.A.S. - E40 The Professional Services (ProServe) team is seeking a skilled Sr. Delivery Consultant - Data Analytics to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS solutions that … through their cloud journey, providing technical expertise and best practices throughout the project lifecycle. Possessing a deep understanding of AWS products and services, as a Sr. Delivery Consultant - Data Analytics you will be proficient in architecting complex, scalable, and secure solutions tailored to meet the specific needs of each customer. You'll work closely with stakeholders to gather … processing. Key job responsibilities As an experienced technology professional, you will be responsible for: - Help the customer to define and implement data architectures (Data Lake, Lake House, Data Mesh, etc). Engagements include short on-site projects proving the use of AWS Data services to support new distributed computing More ❯

West Country - Hybrid - 3 Days Work from home per week Shape a greenfield data platform from day one, setting the standards for architecture, engineering and governance that will guide a major financial services organisation for years to come. You’ll define how data is designed, delivered and used—while steering the migration to Databricks and mentoring … smarter decisions across the business. What you'll do This is a large-scale data transformation. You’ll own the migration of the existing data lake into Databricks while helping them develop new capabilities in data governance, data quality and data management. Right now, most delivery is handled by … technical lead with deep engineering knowledge and practical architecture skills. You'll take ownership of the platform migration and assurance, leading the migration of the existing data lake into Databricks. You'll assure engineering quality from third-party suppliers and contribute hands-on to coding, pipeline development and modelling of core data entities. You'll More ❯

West Country - Hybrid - 3 Days Work from home per week Shape a greenfield data platform from day one, setting the standards for architecture, engineering and governance that will guide a major financial services organisation for years to come. You’ll define how data is designed, delivered and used—while steering the migration to Databricks and mentoring … smarter decisions across the business. What you'll do This is a large-scale data transformation. You’ll own the migration of the existing data lake into Databricks while helping them develop new capabilities in data governance, data quality and data management. Right now, most delivery is handled by … technical lead with deep engineering knowledge and practical architecture skills. You'll take ownership of the platform migration and assurance, leading the migration of the existing data lake into Databricks. You'll assure engineering quality from third-party suppliers and contribute hands-on to coding, pipeline development and modelling of core data entities. You'll More ❯

Shape the Future of Data - Azure Data Architect - Hybrid - London SE1 Job Title: Data Architect - Azure Platform Specialist Location: Hybrid - 1-2 days per week in London (SE1). 3-4 days remote Salary: £90 - £115K OTE including bonus Start: ASAP The Client: A Microsoft-focused digital consultancy at the forefront of AI, Cloud … and Data transformation. As a Microsoft Fabric Featured Partner, they design and deliver cutting-edge data solutions to clients in sectors including finance, pharma, energy, insurance, and retail. The Candidate: Were looking for a confident and technically strong Azure Data Architect with experience shaping modern, scalable data platforms. The role would suit … more of the following platforms: Azure Synapse Analytics and Azure Databricks, and supporting data technologies like Power BI, Microsoft Purview, Azure SQL Database, Azure Data Lake, etc. Excellent stakeholder engagement and communication skills. Able to consult, advise, architect and estimate project work. Strong analysis, requirements gathering and data modelling. Solid data More ❯

Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Description: We are looking for a seasoned AWS Data Engineer to join our team and contribute to the development of scalable, secure, and high-performance data solutions. This role involves modernizing mainframe legacy systems, building robust … data pipelines, and enabling advanced analytics using AWS-native technologies. You’ll collaborate with cross-functional teams and play a key role in shaping our data strategy. Skills Must have : Proven experience in designing and maintaining scalable data lakes using AWS S3, with strong understanding of data lifecycle, access control, and performance … AWS CloudFormation and Terraform to automate and manage cloud resources. Experience developing ETL workflows using AWS Glue, querying data with Athena, and managing access and governance with Lake Formation. Strong command of AWS Lambda for serverless data processing and Boto3 for programmatic interaction with AWS services. Demonstrated experience working with GDPR-compliant architectures and handling More ❯