226 to 250 of 498 Data Lake Jobs

Software Engineer focused on AI Integration, you will be responsible for designing, developing, and implementing the agentic platform for our proprietary Data Lake tool, JCRSD. This role is primarily focused on Python-based components and requires strong container orchestration skills to ensure seamless deployment. This role … databases (e.g., Postgres, MySQL), distributed databases, or NoSQL databases. Prior experience or familiarity with Big Data Platforms or Data Lake architectures. DoD 8140/8570 IAT Level II compliance certifications may be required in this position as directed by the customer. We have many more ...

ready to shape the future of data engineering at JPMorganChase? Join a dynamic team where your unique skills will help build innovative solutions and contribute to a winning culture. You'll have opportunities for career growth, collaborate with talented professionals, and make a real impact on our business … engineering concepts and proficient applied experience Good working knowledge of cloud-based data services (especially Glue jobs and Federated Data Lake), unified analytics platforms, and Python Experience across the data lifecycle, including ingestion, transformation, storage, and access patterns Advanced proficiency in SQL, including ...

Make your mark for patients We are looking for a Clinical Data Layer Lead who is collaborative, strategic, and outcomes-focused to join our Biometrics & Data Science team, based in any of our Brussels (Belgium), Monheim (Germany), Slough (UK) or Raleigh (US) offices. About the role … will own the vision, strategy, governance, adoption, and continued development of our Clinical Data Layer. As its Functional System Owner, you are going to help clinical data move securely and efficiently from source systems into trusted data products. Your work will enable study delivery ...

Communicate complex technical and architecturalconcepts to business and senior stakeholders in a clear, simplified manner Review and approve test strategies, functional testcases, and data validation approaches. Ability … design data architectures supporting NLP andAI‐driven analytics, including ingestion, curation, and governance ofunstructured data within Data Lake, Data warehouse platforms. Experience translating business and compliancerequirements into NLP‐enabled analytical use cases, such as: Textclassification and categorization, Entity extraction, Risk indicatoridentification ...

unstructured data. Build batch and real-time processing solutions using BigQuery, Dataflow, Cloud Storage, Pub/Sub, and related GCP services. Develop data-processing components and integrations using Java or Python, SQL, REST APIs, Kafka, and containerized services on GKE. Implement reusable ingestion and transformation frameworks supporting full … incremental, and event-driven loads. Design data models and optimize BigQuery tables through partitioning, clustering, efficient SQL, and cost-aware processing patterns. Produce high-level and low-level technical designs, document assumptions, and contribute to architecture reviews. Implement data-quality checks, schema validation, reconciliation, audit logging ...

Enlighten, honored as a Top Workplace from USA Today, is a leader in big data solution development and deployment, with expertise in cloud-based services, software and systems engineering, cyber capabilities, and data science. Enlighten provides continued innovation and proactivity in meeting our customers' greatest challenges. … moving data at scale, especially using Amazon S3. Prior experience or familiarity with Big Data Platforms or Data Lake architectures. We have many more additional great benefits/perks that you can find on our website at . ...

Project description Build reusable platform capabilities and data products that let quantitative researchers discover, access, and consume data across a complex, disparate landscape, and then accelerate the good prototypes to production. Responsibilities Design, build, and enhance data pipelines and integration frameworks supporting AI, analytics … environments. Strong communication skills and ability to interact efficiently with various stakeholder groups including business users. Nice to have Experience with Databricks, Spark, Delta Lake, or similar modern data engineering platforms. Experience designing enterprise data lakes, lakehouses, or large-scale analytical platforms. Domain experience within ...

Senior Data Engineer (Medical Imaging) Contract: 12 Months (Initial) Location: London | Hybrid Working (2 Days Onsite) Senior Data Engineer | AI, Medical Imaging & Cloud Data Platforms We're seeking an experienced Senior Data Engineer to join a cutting-edge data … schema design and optimisation. Experience working with cloud-based object storage platforms such as Google Cloud Storage, Amazon S3, or Azure Data Lake Storage. Experience using orchestration frameworks and modern data engineering practices. CI/CD, Agile, and DevOps experience. Ability to work autonomously ...

Data Engineer Location: Belfast Hybrid (2 days per week in the office) Salary: £50,000- £60,000 Our client is an established financial services business operating within the venture capital and investment space. Working in an investment-led environment, they combine financial expertise with a focus on delivering … value for their clients. The Role Youll play a key role in building and maintaining scalable data pipelines and infrastructure that support reporting, analytics and business decision-making. Working closely with Power BI analysts, data scientists and business stakeholders, youll help ensure data ...

Description Data Modeller Investment Banking We are looking for an experienced Data Modeller with a strong Investment Banking background to support complex data initiatives across trading, risk, settlements, and regulatory reporting. This is a niche, hands-on modelling role (not architecture) for someone … work closely with business SMEs and technical teams to design robust logical and physical models. Key Responsibilities Develop logical and physical data models for data warehouses, data lakes, and data marts Work closely with business SMEs to translate requirements into scalable data ...

Senior Data Engineer (Python SQL AWS) London/WFH to 120kDo you have experience of building data pipelines within finance/Fintech environments? You could be progressing your career in a senior, hands-on Data Engineer role at a scaling Investment Research tech company … impactful role with great benefits and perks. As a Senior Data Engineer you will be at the intersection of data engineering, database management and platform delivery. You will help build and evolve a modern, scalable AWS cloud based data platform. Your focus will ...

handle over 6 million HTTP requests daily and process more than 1.5 million bets per hour at peak. Job Description Transform complex data landscapes into high-impact solutions as a Data Warehouse Developer, shaping the future of intelligent cloud platforms. The Data Engineering department … enterprise data catalogue solutions Relational set-based processing and advanced SQL query development Hands-on background with modern Data Lake and Data Warehouse architectures Dimensional modelling for enterprise data warehouses Decisive problem-solving capabilities when delivering against tight deadlines Additional Information ...

Description As a Data Architect you will help drive data and AI transformations for our clients by defining the data blueprint and architecture for our clients' most complex programmes. This role requires an understanding of both classic and latest generation platform capabilities. You will … some of the following technologies and capabilities to ensure scalable, high‐performance applications: Multi‐cloud, data warehousing and data lake platforms Data manipulation, integration and ingestion technologies Programming/scripting languages ML/AI frameworks Infrastructure & DevOps concepts and tooling Semantic models ...

people first. We reach higher. We do the right thing-today and for generations to come. Job Purpose and Impact The Data Security Architect will drive the enterprise data protection strategy and design scalable, secure architectures that safeguard critical business, operational, and manufacturing data across cloud, SaaS, and hybrid environments. In this role, you will apply deep expertise in data security, cloud architecture, and governance to design scalable, secure solutions that protect sensitive enterprise, operational, and manufacturing data. You will partner with cloud, data, application, and OT teams ...

Data Engineer Power BI, Azure Data Factory, Synapse Salary: £50,000£55,000 + excellent benefits Location: Birmingham or London (12 days per month in office) Employment: Full time A leading and growing UK financial services company is seeking a Data Engineer to build … pipelines. Working knowledge of Azure Synapse modelling and performance tuning. Good SQL skills for analytics and optimisation. Understanding of Azure Data Lake structures. Experience using Git and Azure DevOps in Agile teams. 24 years experience in a Data Engineering or BI Development role. Desirable Exposure ...

Principal GCP Data Engineer, you'll be a true subject matter expert in using the data processing and management capabilities of Google Cloud to develop data-driven solutions for our clients. You will typically lead a team or the solution delivery effort, demonstrating technical … software development lifecycle in line with modern best practices. As part of your responsibilities, you will be expected to: Develop robust data processing jobs using tools such as Google Cloud Dataflow, Dataproc and BigQuery Design and deliver automated data pipelines that use orchestration tools such ...

Data & Platform Analytics Lead London | Stockholm | Oslo | Copenhagen 80,000 – 90,000 GBP | 810k – 895k SEK 1,000,000 – 1,135,000 NOK | 730k-825k DKK About Puzzel We're the AI-native customer experience platform built in Norway, trusted across Europe, and growing fast. For 25 years … from one department to the next. You will be our data wrangler. You control what goes into our Snowflake data lake, make sure what the business needs is going in, and organise it so every department extracts it the same way, in the same language. ...

Description: Data Platform Engineer Primary locations: Staines (TW18 3DZ) or Salford (M50 3SP) Flexible/Hybrid working options Permanent | Full-time (37.5 hours) Salary: Neg. depending on experience + 10% bonus + excellent benefits We make health happen At Bupa, technology underpins everything we do. You'll join … Code (IaC) delivery within cloud environments. Hands‐on experience with key Azure data services (e.g., Data Factory, Data Lake, Power BI/Fabric). Experience working with Snowflake or other relational cloud data platforms. Experience building CI/CD pipelines using ...

optimize the branch, improve operational efficiency and maximize self-service availability for financial institutions and retailers across the globe. Title: SW Engineer III - Data Analytics & Insights Location: Dundee (Hybrid) Grade: 11 Salary: £48,000 p/a (DOE) Key Areas of Responsibility Design, develop, and maintain enterprise reporting … using Project Management tools such as Jira and Confluence. Preferred Qualifications Experience with Azure Data Factory, Synapse Analytics, Data Lake, or related cloud data technologies. Experience creating executive dashboards and operational reporting solutions. Knowledge of machine learning, anomaly detection, predictive analytics, or statistical ...

Description Purpose of the role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities Build … maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Development ...

optimize the branch, improve operational efficiency and maximize self-service availability for financial institutions and retailers across the globe. Title: SW Engineer III - Data Analytics & Insights Location: Dundee (Hybrid) Grade: 11 Salary: £48,000 p/a (DOE) Job description Design, develop, and maintain enterprise reporting and analytics … using Project Management tools such as Jira and Confluence Preferred Qualifications Experience with Azure Data Factory, Synapse Analytics, Data Lake, or related cloud data technologies. Experience creating executive dashboards and operational reporting solutions. Knowledge of machine learning, anomaly detection, predictive analytics, or statistical ...

planning, and environment governance. Enterprise Integration Design and oversee integrations between Planisware and enterprise systems such as: SAP Jira Active Directory/SSO Data warehouses Reporting platforms Planning and portfolio management systems Define API, file-based, and event-driven integration patterns. Partner with integration and data … organizations. Experience implementing enterprise PPM solutions at global scale. Familiarity with: SAP Jira Azure Power BI ServiceNow Enterprise Data Lake architectures Experience establishing or operating a Portfolio Management Center of Excellence. Planisware Developer certification is preferred. Education High School Diploma required. Bachelor's degree preferred. ...

Description Purpose of the role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities Build … maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Development ...

Macquarie Group is seeking a Data Platform Engineer to design, build and optimize … petabyte-scale data platform powered by modern cloud technologies in a hybrid work model. You will manage a Data Lake, ensure secure, scalable environments, and drive performance with AWS tools such as S3, EKS, Glue, Airflow, Trino and Parquet. The role emphasizes delivering high-performance ...

England, in partnership with Inspire People, is recruiting experienced Lead Solution Architects to design and deliver complex, cloud-based solutions across its regulatory data services. Hybrid working from London or Leeds, salary up to £90,360 plus an 8% cash benefits allowance, 10-25% discretionary annual bonus … formats and reporting standards such as XBRL, XML and JSON. * Experience with Azure data services, including Azure Data Lake Storage, Databricks or Azure Data Factory. * Understanding of data governance, quality, security and data lifecycle management. * Experience supporting ...