151 to 175 of 329 Data Lake Jobs

Data Scientist Hybrid – London (3 days a week) Up to £75,000 + Pension + Share Scheme About the Role We’re working with a professional services firm undergoing a major data transformation, now looking to bring on board their first in-house Data Scientist . Reporting directly into the CFO, you’ll take … the lead on developing and managing the firm’s data infrastructure, starting with the continued build-out and integration of their data lake. You’ll work on high-impact reporting and analytics projects, and long-term, deliver commercially focused data science solutions such as price optimisation and revenue forecasting. This is a hands-on … uncover opportunities to use data more effectively across the organisation. Key Responsibilities Build and manage data pipelines and infrastructure, including a developing data lake Support reporting projects and ongoing Power BI development Deliver commercial data science solutions (e.g., forecasting, optimisation) Integrate data from a variety of internal systems and More ❯

Data Scientist Hybrid – London (3 days a week) Up to £75,000 + Pension + Share Scheme About the Role We’re working with a professional services firm undergoing a major data transformation, now looking to bring on board their first in-house Data Scientist . Reporting directly into the CFO, you’ll take … the lead on developing and managing the firm’s data infrastructure, starting with the continued build-out and integration of their data lake. You’ll work on high-impact reporting and analytics projects, and long-term, deliver commercially focused data science solutions such as price optimisation and revenue forecasting. This is a hands-on … uncover opportunities to use data more effectively across the organisation. Key Responsibilities Build and manage data pipelines and infrastructure, including a developing data lake Support reporting projects and ongoing Power BI development Deliver commercial data science solutions (e.g., forecasting, optimisation) Integrate data from a variety of internal systems and More ❯

Location: Reston, VA Clearance Requirement: TS w/SCI Eligibility Job Description and Responsibilities: Come join the future of data-driven decision making! At Data Machines we leverage data analytics, DevSecOps, machine intelligence, and data science to engineer solutions for our Federal government, defense, and commercial sponsors to solve real-world, critical … mission problems. Data Machines is looking for a motivated and detail-oriented Junior Data Engineer to join our growing Data Engineering team. This is an exciting opportunity for someone early in their career to gain hands-on experience with modern data technologies, contribute to the development of data pipelines, and … Eagerness to learn and grow in a fast-paced environment Experience in Jupyter Notebooks, PostgreSQL. Experience with version control systems (e.g., Git) Desired Qualifications: Knowledge of data lake technologies and big data tools (e.g., Spark) Familiarity with containerization tools like Docker More ❯

TS/SCI with Favorable Polygraph is required for this position. We are seeking a motivated Data Scientist to join our team in the Northern Virginia area. The Data Scientist will collaborate with product design and engineering teams to implement data analytics solutions meeting the customer's needs. The Data Scientist will … have experience with extract, transform, and load. While implementing the ETL process, this Data Scientist should ask questions, connect the dots, and uncover opportunities pertaining to the data examined. A strong Data Scientist will create support data visualization to aid in decision making, AI capabilities, and evaluate large data sets … information regarding the role, responsibilities, and required skill sets are below. Roles & Responsibilities • Support the development of recommendations and aid in the decision-making process by using statistical data analysis, testing, and modeling of large data sets • Identify and document areas for improvement in workflows or systems • Research and document options for collecting or aggregating data More ❯

Location: London (2-3 days on site) Department: Data & Analytics About the Role We are looking for a skilled and strategic Data Architect to lead the design and implementation of scalable, secure, and high-performing data solutions across our cloud environment. In this role, you will play a critical part in shaping our enterprise … data architecture using Microsoft Azure, Microsoft Fabric, and related technologies. You will work across teams to integrate diverse data sources, optimize database performance, and ensure compliance with evolving data governance standards. Key Responsibilities Architect Scalable Data Solutions: Design and implement efficient data models and database architectures to support current and … future business needs. Develop Documentation & Metadata Standards: Maintain clear and up-to-date architectural documentation, including metadata definitions and data lineage diagrams. Establish Data Standards & Best Practices: Define and enforce data architecture principles, governance policies, and operational procedures to maintain consistency and compliance. Enhance Performance & Reliability: Continuously refine and optimize database environments for speed More ❯

Data Scientist Level: Senior Location: McLean, Virginia Clearance Required: TS/SCI Full Scope Polygraph Job Description The Sponsor seeks an experienced Data Engineer/Data Scientist with a strong foundation in PL/SQL, Java, AWS, BASH, Linux, and Oracle. The candidate will play a critical role in developing and optimizing data solutions that ensure the secure and efficient storage of information. The role involves designing and implementing migration strategies, ensuring integration with corporate data standards, and supporting various mission-critical applications. Key Responsibilities: • Develop data architecture solutions for cloud and physical systems, ensuring secure and efficient data storage. • Analyze system requirements and develop … in database technology, providing strategic recommendations to improve performance and scalability. • Conduct database performance evaluations, risk assessments, and financial feasibility studies. • Provide technical oversight for database upgrades, new data standards, and major design enhancements. • Serve as a lead technical resource for data model design, integration, and optimization. • Collaborate with other technical teams to ensure seamless integration More ❯

of educational apps for children ages 2 to 7. Our products are among the top 15 in the preschool apps category globally. We're looking for a skilled Data Engineer to design and maintain robust data infrastructure and pipelines, driving data accessibility and reliability across our platform. Working format: full-time, remote. Schedule: Monday … to Friday (the working day is 8+1 hours). Responsibilities: Design, develop, and maintain data pipelines using Apache Airflow . Create and support data storage systems (Data Lakes/Data Warehouses) based on AWS (S3, Redshift, Glue, Athena, etc.). Integrate data from various sources, including mobile apps , third-party … APIs , and internal services . Ensure data quality, consistency, and availability . Support analysts: build user-friendly data marts and contribute to schema and data model design. Set up pipeline monitoring , alerting , and logging . Participate in architectural decisions and technology selection . Optimize existing data storage systems and complex SQL queries More ❯

Milan, Edinburgh and Madrid. With our focus on growth in the UK and Europe, now is the perfect time to join us on this high-speed journey. Introducing Data Engineering at Trainline At the heart of our Data Team, Data Engineers play a pivotal role by creating pipelines and tables that power impactful dashboards … enable self-service via SQL, and support innovative machine learning models and real-time data products. As a Data Engineer, you will be involved in engineering pipelines that will drive key decisions and give data science powerful datasets to enable and drive new business insights. Data Engineers work alongside Machine learning engineers … warehouses in the cloud) Work with Infrastructure as code (Terraform) and containerising applications (Docker) Work with AWS, S3, SQS, Iceberg, Parquet, Glue and EMR for our Data Lake Experience developing CI/CD pipelines More information: Enjoy fantastic perks like private healthcare & dental insurance, a generous work from abroad policy, 2-for-1 share purchase plans, an More ❯

Intelligence Center, 11339 SSG Sims Street, El Paso, TX Work Type: Onsite - 5 days a week Remote Work: No Description Gridiron IT is looking to hire a Senior Data Scientist to support a federal program in El Paso, TX. We are seeking a highly skilled Senior Data Scientist with specialized expertise in Artificial Intelligence (AI) and … Machine Learning (ML) to support the analysis and interpretation of large-scale datasets. This role is vital for leveraging our law enforcement client's data holdings to develop innovative insights, predictive models, and business solutions. The ideal candidate will have experience working with unstructured data, statistical modeling, and advanced data analytics to drive decision … making and enhance operational effectiveness. Develop and support AI/ML models for data analysis, focusing on the accuracy, authenticity, expectancy, timeliness, relevancy, and viability of intelligence data. Conduct advanced data integration and statistical analysis to identify patterns, trends, and intelligence gaps. Innovate by deriving investigative, statistical, and predictive value from our clients extensive data More ❯

of millions of policies and raised over $200 million in funding. And we're only just getting started. About the Role We're looking for a Head of Data Engineering to lead and grow our high-impact team of four Data Engineers. You'll play a pivotal role in shaping the future of Zego's data infrastructure- ensuring it scales with our ambitions while remaining resilient, efficient, and safeguarding user data privacy. This is a hands-on leadership role that combines technical depth, strategic vision, and team enablement. You'll partner with cross-functional leaders in Engineering, Data Science, Analytics, and Product to drive our data strategy, evolve … feedback, and knowledge sharing. Pragmatic Problem-Solving: Comfortable balancing technical excellence with business priorities and constraints Nice to have Experience building Data Mesh or Data Lake architectures. Familiarity with Kubernetes, Docker, and real-time streaming (e.g. Kafka, Kinesis). Exposure to ML engineering pipelines or MLOps frameworks. What's it like to work at Zego More ❯

As a Data Engineer, you will design, build, and maintain data pipelines and solutions to support business needs. This role involves leveraging your technical expertise to enable data-driven decision-making. Client Details Data Engineer - Surrey - Hybrid Our client is a well-established organisation undergoing a significant digital and data transformation. With a focus on innovation and technology, they are investing in building modern, cloud-based data capabilities to drive smarter decision-making, improve customer experience, and support future growth. This is an exciting time to join a business that is placing data at the heart of its strategy and creating opportunities for impactful … work across the organisation Description Data Engineer - Surrey - Hybrid As the Data Engineer you will help design, build, and scale a modern Azure-based data platform. This is your chance to play a key role in shaping how data is used to drive smarter decisions and real business impact. Develop, maintain, and More ❯

region. Because we know that by continually driving up our standards today, well build a better tomorrow for our communities. We currently have an opportunity for an Azure Data Architect to join our team based in Redhill. Joining us on a Permanent Full time basis , you will receive a competitive salary of £70,000 plus excellent benefits. About … What Youll Be Doing Design and implement data solutions on Azure, using a range of services like Azure SQL Database, Data Factory, Data Lake Store, Data Lake Analytics, Stream Analytics, Azure Storage, Cosmos DB and more Making informed decisions on the strategic direction and roadmap for the use and implementation … similar role In-depth understanding of database structure principles Experience with Azure data technologies such as Azure SQL, Azure Data Factory, Azure Data Lake, Azure Cosmos DB, Power BI and SQL. BSc in Computer Science, IT or relevant field What's In It For You? We know that the support and commitment of More ❯

maintain interactive Power BI dashboards and reports Extract, transform, and load (ETL) data from Salesforce , Simpro , Unleashed and other systems into the Microsoft Fabric Data Lake (OneLake) Build and manage data pipelines into Fabric using tools like Dataflows , Data Factory , or Synapse Pipelines Ensure seamless integration between Fabric Data Lake and Power BI semantic models Develop and optimize data models for performance, scalability, and usability Collaborate with business users to gather requirements and deliver self-service reporting solutions Maintain data quality, governance, and consistency across the reporting stack Support and maintain existing Power BI solutions, while also implementing new ones based on … including OneLake, Lakehouse , and data pipeline tools Hands-on experience extracting data from systems like Salesforce , Simpro , and ERP platforms into a data lake environment Strong DAX, Power Query (M), and SQL skills Familiarity with data modeling, ETL frameworks , and structured/unstructured data handling Knowledge of Power BI More ❯

maintain interactive Power BI dashboards and reports Extract, transform, and load (ETL) data from Salesforce , Simpro , Unleashed and other systems into the Microsoft Fabric Data Lake (OneLake) Build and manage data pipelines into Fabric using tools like Dataflows , Data Factory , or Synapse Pipelines Ensure seamless integration between Fabric Data Lake and Power BI semantic models Develop and optimize data models for performance, scalability, and usability Collaborate with business users to gather requirements and deliver self-service reporting solutions Maintain data quality, governance, and consistency across the reporting stack Support and maintain existing Power BI solutions, while also implementing new ones based on … including OneLake, Lakehouse , and data pipeline tools Hands-on experience extracting data from systems like Salesforce , Simpro , and ERP platforms into a data lake environment Strong DAX, Power Query (M), and SQL skills Familiarity with data modeling, ETL frameworks , and structured/unstructured data handling Knowledge of Power BI More ❯

LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a commitment to excellence in delivering the services our customers expect from us. With extensive experience, deep knowledge and worldwide presence across financial markets, we enable businesses and economies around the world to fund … products and streamline the maintenance of existing products. Technical/job functional knowledge Proven technical architecture experience covering common design patterns and platforms such as UIs, micro-services, data lakes, APIs, RDBMS, and NoSQL databases Strong familiarity of formal design and SDLC methodologies, in particular Agile/SAFe Significant experience of designing solutions in distributed highly resilient environments … inclusive collaborative workplace is pivotal to our success and supports the potential and growth of all colleagues at LSEG. LSEG is a leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth. Our purpose is the foundation on which our culture is built. Our values More ❯

starter to serve as an ADVANA Developer supporting the Southern Command Operations, Planning, and Engagement Support (SCOPES) program. This position will reside in the Office of the Chief Data Officer as part of a project spanning various development, data science, and knowledge management functions. This position requires a strong background in software development, data engineering principles, and cloud technologies. The ADVANA Developer will contribute to building and enhancing capabilities that enable data-driven decision-making for SOUTHCOM. Responsibilities: • Design and Development: Participate in the full software development lifecycle, including requirements gathering, system design, development, testing, and deployment of applications and data pipelines within the ADVANA environment. • Data Engineering: Develop and maintain robust and scalable data pipelines to ingest, transform, cleanse, and integrate data from various DoD source systems into the ADVANA data lake. • Cloud Technologies: Utilize and contribute to the development within ADVANA's cloud based architecture, leveraging cloud-native services for data storage, processing, and analytics. More ❯

Data Engineer I, Business Data Technologies Business Data Technologies (BDT) makes it easier for teams across Amazon to produce, store, catalog, secure, move, and analyze data at massive scale. Our managed solutions combine standard AWS tooling, open-source products, and custom services to free teams from worrying about the complexities of operating … lets BDT customers move beyond the engineering and operational burden associated with managing and scaling platforms, and instead focus on scaling the value they can glean from their data, both for their customers and their teams. We own the one of the biggest (largest) data lakes for Amazon where 1000's of Amazon teams can search … share, and store EB (Exabytes) of data in a secure and seamless way; using our solutions, teams around the world can schedule/process millions of workloads on a daily basis. We provide enterprise solutions that focus on compliance, security, integrity, and cost efficiency of operating and managing EBs of Amazon data. Key job responsibilities CORE RESPONSIBILITIES: Be More ❯

Principal Data Engineer - Data Platforms/Data Lakes/Cloud/Python - 6-Month Contract - £625 p/d Inside IR35 - London A global digital media organisation are looking for a Principal Software Engineer to join their Data Foundation & Product Analytics team on an initial 12-month contract. This role sits at … the forefront of enterprise data strategy, engineering, and platform governance - and will be instrumental in shaping the next generation of data infrastructure … within the business. This is a hybrid role (London-based) with flexibility in a fast-paced, multi-cloud, multiplatform environment. You will partner with the Enterprise Data Lake and Governance teams, architecting robust data pipelines and platforms across cloud and on-prem ecosystems, whilst establishing and enforcing standards for data modelling, ensuring consistency More ❯

Azure Data Architect - London Atrium EMEA is looking for an accomplished Application Architect with Azure Cloud Data Migration experience, to design & architect the target state Azure data platform, including data lakes, warehouses & integration services. The Azure Data Architect will help replace existing SAP BW applications and will lead the technical … migration strategy for moving accounting data workloads from SAP BW to Azure, ensuring data integrity … minimal business disruption. This is a 12mth PAYE contract role and you will be required onsite 3 days a week. Essential: Application architecture Azure cloud Data migration (Datalakes, DWH, Data integration services) SAP BW Technical migration strategy experience Define data governance frameworks, security protocols & compliance standards for the new Azure environment Maintain regulatory requirements More ❯

Data/Data Specialisation). Extensive experience in Data Engineering, in both Cloud & On-Prem, Big Data and Data Lake environments. Expert knowledge in data technologies, data transformation tools, data governance techniques. Strong analytical and problem-solving abilities. Good understanding of Quality and … or Azure hands-on experience. ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones. Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. Certifications: AWS, Azure, or Cloudera certifications are a plus. To be considered for this role you MUST have in-depth experience … Engineer, Spark, Java, Python, PySpark, Scala, Big Data, AWS, Azure, Cloud, On-Prem, ETL, Azure Data Fabric, ADF, Hadoop , HDFS , Azure Data, Delta Lake, Data Lake Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this More ❯

Lead Data Solution Architect £80,000 to 110,000 GBP Bonus Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Role: Lead Data Solution Architect Work Type & Location: Hybrid (London-based with flexible remote-first setup) Role Type: Permanent Start Date: ASAP Salary: £80,000 - £110,000 DOE A global technology consultancy is expanding … its UK Data & Intelligence team and looking for a highly skilled Lead Data Solution Architect . You'll work at the forefront of cloud-native data architecture, shaping and delivering cutting-edge data solutions for high-profile clients across a range of industries. This is a hands-on leadership role that combines … Proven experience as a Lead Data Architect or Senior Data Solutions Architect Expertise in Kafka/Confluent , Databricks , Unity Catalog , and modern data lake/lakehouse architectures Strong grasp of cloud data platforms (AWS, Azure, GCP, Snowflake) Understanding of Data Mesh , Data Fabric , and data More ❯

Senior Test Automation Engineer - Data Salary: £53,460 - £69,500 Join Our Team as a Senior Data Test Automation Engineer at Hawk-Eye Innovations Are you passionate about cutting-edge technology, sports, and driving quality? At Hawk-Eye Innovations, we revolutionise sports through innovative solutions, from computer vision to video replay systems. Our technology shapes officiating … data insights, broadcasting, and entertainment across global sports. Join our agile, cross-functional teams to enhance testing practices across cloud-native microservices and data platforms. You'll develop scalable test automation frameworks with a focus on data validation using tools like Pandas, and lead strategies for testing data lakes. Collaborate closely with … strategies for AWS data lakes (e.g., S3, Glue, Athena) with a focus on schema evolution, data quality rules, and performance benchmarks, prioritizing data lake testing over traditional SQL approaches. Automate data tests within CI/CD workflows to enable continuous build, validation, and deployment. Create tools for synthetic data More ❯

Senior Test Automation Engineer - Data Salary: £53,460 - £69,500 Join Our Team as a Senior Data Test Automation Engineer at Hawk-Eye Innovations Are you passionate about cutting-edge technology, sports, and driving quality? At Hawk-Eye Innovations, we revolutionise sports through innovative solutions, from computer vision to video replay systems. Our technology shapes officiating … data insights, broadcasting, and entertainment across global sports. Join our agile, cross-functional teams to enhance testing practices across cloud-native microservices and data platforms. You'll develop scalable test automation frameworks with a focus on data validation using tools like Pandas, and lead strategies for testing data lakes. Collaborate closely with … strategies for AWS data lakes (e.g., S3, Glue, Athena) with a focus on schema evolution, data quality rules, and performance benchmarks, prioritizing data lake testing over traditional SQL approaches. Automate data tests within CI/CD workflows to enable continuous build, validation, and deployment. Create tools for synthetic data More ❯

Job Description: BLN24 is seeking a highly skilled Data Engineering Specialist with demonstrated experience in developing data models for implementation in a data lake architecture. The ideal candidate will have a proven track record of successfully handling projects of similar size and scope. Key Responsibilities: Design and develop data models for … implementation in a data lake architecture. Collaborate with cross-functional teams to understand data requirements and translate them into effective data models. Ensure data models are optimized for performance and scalability. Implement and maintain data pipelines to support data lake architecture. Monitor and troubleshoot data … guidance and support to team members and stakeholders. Qualifications: Bachelors of Science in relevant field of study Proven experience in developing data models for data lake architectures. Strong understanding of data modeling principles and best practices. Proficiency in data modeling tools and technologies. Excellent problem-solving and analytical skills. Strong communication More ❯

x Contract Data Engineers - Snowflake/AWS/Python/Airflow/Iceberg Location: London (Hybrid - 3 days per week onsite) Duration: 6 months Day Rate: £550 - £600 (Inside IR35) A highly reputable consultancy is seeking 2 x Contract Data Engineers to join their data team on a 6-month engagement. You will play … a key role in building and optimising data pipelines, supporting modern data platform architecture, and enabling advanced analytics and reporting capabilities. Key Skills & Experience: Strong experience with Snowflake data warehousing Solid AWS cloud … engineering experience Proficient in Python for data engineering workflows Skilled in building and maintaining Airflow DAGs Familiarity with Apache Iceberg for table format and data lake optimisation If this could be of interest, please get in touch with Alex Lang at iO Associates to apply and for more information. On this occasion, we can only More ❯