401 to 425 of 594 Data Lake Jobs

Attachments Person Specification.pdf Job Description.pdf Full Time, Fixed Term - 18 months A great opportunity has arisen to join Bristol City Council's Data and Insight Team at an exciting time as we develop our Azure Fabric Data and Analytics Platform. You will join a team providing … corporate wide data and analytics to achieve the strategic objective of becoming increasingly data driven to facilitate better decision making. We require an enthusiastic, self-motivated and experienced Data Engineer that will be responsible for the loading and transformation of data from ...

visa sponsorship. Right-to-work in the UK is preferred. Foreigners may still enquire with the employer. Capgemini is seeking a Spark AWS Data Engineer in Glasgow, Scotland, offering a salary of £47,037.09. This full-time Tech role is ideal for UK-based applicants with existing right … eligibility. The position offers hybrid working, blending office and remote work for flexibility. Job Description This role involves designing, building, and maintaining scalable data pipelines, data lakes, and data warehouse solutions specifically on AWS. You will be at the forefront of developing high-performance ...

## Sr. Software Engineer - Data Query Platform - (London, Hybrid)Applylocations: United Kingdom - Londontime type: Full timeposted on: Posted Todayjob requisition id: R26425As a global leader in cybersecurity, CrowdStrike protects the people, processes and technologies that drive modern organizations. Since 2011, our mission hasn’t changed — we’re here … starts with you.**About the Role:** The data engineering team is on a mission to create a hyper scale data lake, which helps find bad actors and stop breaches. The team builds and operates systems to centralize all of the data the falcon ...

make a meaningful impact on millions of customers worldwide. As a Software Engineer at JPMorgan Chase in the Corporate Sector's agile data engineering team, you will promote the development of a trusted Global Know Your Customer (KYC) and Risk Assessment Data Platform. You will work … MemCached, observability tools (Dynatrace, Splunk, Grafana), and orchestration frameworks (Airflow, Temporal) Advanced working knowledge of relational and NoSQL databases, vector stores, data lake architectures, and data governance Practical cloud-native experience (AWS, Azure, or GCP) Ability to present and communicate effectively with senior leaders ...

seeking a Lead Data Engineer to drive enterprise-scale data solutions across cloud platforms. You will lead the data engineering team, shape architectural decisions, and deliver high-quality data products that enable automated decision making. You will work closely with architects … consultants in a hybrid environment, leveraging Azure Databricks, Microsoft Fabric, and SQL/Python to build scalable data pipelines and governance controls. #J-18808-Ljbffr ...

Inside IR35 Location: Birmingham Working Pattern: Hybrid - 3 days per week onsite at Birmingham office We are looking for an experienced Senior Data Engineer to join a major enterprise technology programme within the financial services sector. You will be responsible for designing, building and optimising large-scale data … optimise data-processing solutions within AWS environments. Develop performant solutions using Java or Scala alongside advanced SQL. Support modern data lake and lakehouse architectures. Work alongside AI/ML teams to provide data platforms supporting Generative AI, machine learning and advanced analytics ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

trading workflows across the business. The firm operates in a sophisticated investment environment with large and diverse datasets. Задачи Develop and maintain data pipelines supporting investment research and business-critical processes; Automate the onboarding and processing of new datasets to improve efficiency and scalability; Contribute to the design … collaborative software development practices; Strong communication skills and the ability to understand end-user requirements; Nice to have: exposure to databases, data lake technologies, or financial datasets. Условия Competitive base salary, annual bonus and benefits package; Specific compensation and benefits details are available on request. #J ...

Data Architect Up to £80k West Midlands - Hybrid - twice per week in the office Benefits: Bonus Scheme Hybrid Working Life Assurance Cycle to Work Scheme 25 days holiday, increasing with length of service Employee Assistance Program I am working with a client in the West Midlands … looking for an Enterprise level Data Architect with Databricks experience to join the team. Databricks is an absolute necessity for this role. The architecture has been outsourced up to this point, and is being brought back in house, so you should be experienced enough to take over responsibility ...

specific business challenges. Implement and maintain scalable and efficient AI systems, ensuring they meet business requirements and performance benchmarks. Collaborate with business analysts, data scientists, and IT teams to integrate AI solutions into existing systems and workflows, enhancing their capabilities and impact. Stay abreast of advancements … efforts. Conduct data analysis and feature engineering to prepare data for use in AI models, utilizing Azure Data Lake and other data storage solutions. Develop robust testing and validation processes to ensure the accuracy and reliability of AI models and solutions. ...

across the company or shared with the broader software community. Involving identifying common challenges and developing solutions that can be widely adopted. Being Data-Driven: Use data analytics to make informed decision-making processes. This involves gathering and analysing data to understand trends, measure …/CD The Atlassian Suite (JIRA, Confluence, Bitbucket, Bamboo) Azure Services Machine learning algorithms Big Data (Hadoop, Azure Data Lake, S3, Apache Spark) Additional programming languages – Python, Scala, Typescript, CSS 3/SASS (or other pre-processors) Other Information The successful candidate will be rewarded ...

Principal Software Engineer at JPMorgan Chase within the Corporate Sector, you provide expertise and engineering excellence as an integral part of an agile data engineering team. To enhance, build, and deliver a trusted market leading Global Know Your Customer (KYC) and Risk Assessment Data Platform … MemCached, observability tools (Dynatrace, Splunk, Grafana), and orchestration frameworks (Airflow, Temporal) Advanced working knowledge of relational and NoSQL databases, vector stores, data lake architectures, and data governance Practical cloud-native experience (AWS, Azure, or GCP) Ability to present and effectively communicate with senior leaders ...

Your role will be to extend and maintain the data backbone of the UK Digital Twin Centre's projects and programmes. You'll transform complex, real-world data from sensors, devices and industrial systems into reliable, scalable data platforms that enable impactful digital twin … solutions. Working across a range of digital twin initiatives, you'll help shape data architectures, pipelines and services from initial concept through to delivery. WHAT YOU’LL DO (Duties) Design, build, and maintain ETL pipelines that bring data from sensors, devices and other sources into digital ...

Essential Employment in Lincoln is seeking a Data Architect to design and manage the organisation's data architecture. The role focuses on building scalable data models, data warehouses, data lakes, and integration solutions to align with business goals. Responsibilities include … leading data projects, establishing governance and security standards, and guiding data engineers and BI teams. The position is a full-time, temporary role based in Lincoln. #J-18808-Ljbffr ...

Photon Group in London, UK is seeking an experienced Data Engineer to contribute to a major ledger migration and data cleanup initiative within a financial services environment. The role requires hands-on data extraction, transformation, and rigorous reconciliation to ensure data integrity. … team emphasizes data validation, regression testing, and migration readiness in a dynamic setting. UK right-to-work is preferred, with a competitive salary of £48,478.22. #J-18808-Ljbffr ...

North St, Horsham RH12 1RD Role Summary The Alation Technical Consultant is responsible for the implementation, configuration, and ongoing support of the Alation Data Intelligence Platform. The role focuses on onboarding data sources, enabling metadata management and governance capabilities, and ensuring the platform operates effectively … support data discovery, cataloging, and stewardship initiatives. Key Responsibilities Platform Setup & Deployment Install, deploy, and upgrade Alation platform components across cloud and/or on-premises environments. Configure integrations with enterprise infrastructure, authentication services, and security frameworks. Configuration & Administration Configure Alation platform settings, user roles, permissions, workflows, stewardship ...

North St, Horsham RH12 1RD Role Summary The Alation Technical Consultant is responsible for the implementation, configuration, and ongoing support of the Alation Data Intelligence Platform. The role focuses on onboarding data sources, enabling metadata management and governance capabilities, and ensuring the platform operates effectively … support data discovery, cataloging, and stewardship initiatives. Key Responsibilities Platform Setup & Deployment Install, deploy, and upgrade Alation platform components across cloud and/or on-premises environments. Configure integrations with enterprise infrastructure, authentication services, and security frameworks. Configuration & Administration Configure Alation platform settings, user roles, permissions, workflows, stewardship ...

Senior Data Engineer is the backbone of the companys core data infrastructure that powers all analytics products running on our SaaS platform. Leverage AWS expertise to manage a wide array of cloud compute services like AWS Lambda as well as managing database solutions like AWS DynamoDB … compute results quickly. Extensive Datadog and AWS Cloudwatch monitoring to ensure that all aspects of infrastructure stays running as expected and niche data governance methods are applied to ensure that data outcomes remain consistent. Perform data modelling and database structuring. Create highly scalable ...

## Principal Data Scientist (NLP + Applied AI)Apply: Remote: Remote, GBR: Full time: Posted Today: R2601250**Job Description:** We believe in bold ideas, diverse perspectives, and the drive to transform knowledge into impact. Here, your curiosity fuels progress, your voice shapes innovation, and your ambition helps redefine … Nice to have*** Experience working with scientific or scholarly text.* Familiarity with AWS (S3, Batch, Lambda, SageMaker) and Parquet or Iceberg data lake patterns.* Experience running LLMs under real cost and latency budgets in production.* Some exposure to agentic AI applications: tool use, multi-step reasoning, guardrails ...

must do next."You will play a key role in the analytical narrative for our customer acquisition efforts, leveraging our unified data lake to understand complex digital behaviors. You aren't just an expert in SQL; you are a consultant who uses data to influence … identify the true drivers of customer acquisition, marketing effectiveness and long-term customer valueRoadmap Input: Proactively identify and size opportunities within the data to inform the Marketing and Product roadmaps, ensuring we focus on the most commercially material opportunities. Experimental Excellence: Lead the design and evaluation of complex ...

Keka Technologies Private Limited is seeking an experienced Data Engineer to architect scalable data solutions and data pipelines is the focus. This role emphasizes data integrity, security, and performance across the data lifecycle. Location: Remote. The ideal candidate has 7+ … years in data engineering, strong SQL and Python/Java skills, and experience with data lakes, ETL, and Power BI to deliver insightful visualizations for stakeholders. #J-18808-Ljbffr ...

analytics platforms across on-premises and AWS environmentsDesigning and implementing new platform features that enhance usability, scalability and the developer experienceCollaborating with research, data and engineering teams to accelerate time-to-insight through modern analytics solutionsDriving improvements in automation, observability and resilience across analytics servicesEvaluating and adopting emerging … approach to diagnosing and resolving issuesHighly desirable skillsExperience with streaming frameworks such as Flink, Kafka Streams and Kafka ConnectKnowledge of modern data lake technologies including Delta Lake, Iceberg and Glue Data CatalogExposure to DataOps practices and collaboration with Data Engineering teamsFamiliarity with ...

Barclays is seeking a Data Engineer within our Markets Post trade technology division in London to deliver a set of enterprise data strategy outcomes across the end-to-end lifecycle. You will build and maintain data pipelines, data warehouses and data lakes to ensure data is durable, complete and secure, while collaborating with data scientists to deploy machine learning models and influence data-driven decisions. #J-18808-Ljbffr ...