126 to 150 of 157 Data Lake Jobs

such as Puppet, Chef, or SaltPreferred: Bachelor's Degree in Computer Science, Information Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory … Apache Hive/Spark/Airflow Experience with IaC deployment of AKS/EKS/GKE architecture Experience with enterprise Data Lake environments using technologies such as DataBricks or SnowflakeCompetencies: Expert analytical/quantitative, problem-solving, and deductive reasoning skills, experience performing advanced troubleshooting and root cause ...

Provision automation using CI/CD (DevOps Pipelines) and IaC (Terraform) tooling Serve as a technical escalation point Work with our development and data teams to integrate products into a DevOps-managed environment Develop and maintain scripts to automate tool/service deployments to our Hybrid Cloud environment …/Airflow Supervisory experience Experience with IaC deployment of AKS/EKS/GKE architecture is highly desired Experience with enterprise Data Lake environments using technologies such as DataBricks or SnowflakeCompetencies: Expert analytical/quantitative, problem-solving, and deductive reasoning skills, with experience performing advanced troubleshooting ...

bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties … will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing ...

with an aspiration to invest £1 billion in research over the next ten years.We have an exciting new opportunity for a Head of Data Platforms to join us and play an instrumental role in leading the vision, evolution, and operational excellence of our enterprise data platform. … Ensuring this platform is robust, trusted, cost-effective, and continually advancing to support BHF’s strategic ambitions, you’ll lead our Data Platform Squad and will strengthen the product-based operating model, and ensure dependable, future-proof data foundations. Key responsibilities for this role include: Bridging ...

with likeminded people on an innovative project. You’ll join a team of 4 to contribute to the build of a greenfield market data platform that will enhance how this systematic fund will trade and analyse global markets. You'll integrate various data sources, including financial … Building a new API for the market data platform. Writing a data dictionary for the platform. Adopting S3 for a datalake solution. If you're developer with a passion for building and supporting market data platforms, apply or reach out via email: megan@saragossa.io ...

Data Team Lead - Azure - Fabric - Databricks - £70k Lead. Inspire. Deliver. Transform data at scale. This is an exciting opportunity for someone who loves combining leadership, technical delivery, and real impact. If you're passionate about developing people, delivering modern data solutions, and working with … cutting-edge Microsoft technologies, this one is absolutely worth a look. As a Data Team Lead, you'll take ownership of a team of Technical Consultants, supporting their growth while still staying close to the hands-on work. You'll guide solution design, ensure best practice delivery ...

/ML, and automation frameworks Proven experience in Designing and implementing AI-based test automation frameworks. NLP, LLMs (e.g., GPT-4, BERT), and data annotation techniques. Tools such as TensorFlow, PyTorch, Hugging Face, or equivalent. Strong programming background: Python, Java, or Scala. Experience with test automation tools like … analysis Knowledge of CI/CD pipelines, DevOps, and tools like Jenkins, GitHub Actions, Azure DevOps, etc. Experience working with structured/unstructured data, data lakes, and data pipelines. Demonstrated success in delivering greenfield AI/ML initiatives from concept to scale. ...

with the organisations goals and best practices. Key Responsibilities: Design and implement enterprise-grade data architectures using Azure Fabric Architect and optimise datalakes for analytics, reporting, and advanced workloads Lead data governance, cataloguing, and compliance initiatives using Microsoft Purview Own and oversee data platform … Data Architect in Azure environments Strong hands-on knowledge of Azure Fabric and modern data architectures Experience designing and implementing datalakes (e.g. medallion architectures) Practical experience with Microsoft Purview for data governance and lineage Track record of delivering successful data platform implementations ...

solutions provider in Dublin is seeking a senior Data Platform Engineer to design and build a cutting-edge data lake/lakehouse. This hands-on role requires extensive experience in data platform engineering, high-throughput pipelines, and open-source technologies like Apache ...

Data Engineer- Highly competitive salary About the Role: Were partnering with a leading technology consultancy that helps organisations harness the power of data to modernise platforms and drive business outcomes. As a Data Engineer, youll be at the forefront of designing and delivering cloud … Google Cloud, turning complex datasets into actionable insights. In this role, youll work on diverse projects, from batch and streaming pipelines to data warehouses, data lakes, and AI-powered analytics platforms. This is a hands-on role where your expertise will guide delivery, shape best practices ...

Data Solution Architect - SC Cleared - mostly remote - £477 per day Role Responsible for designing Data Related Solutions quickly and securely, whilst ensuring alignments to Digital Blueprint Principles, Standards and Patterns. 1) Design and represent architecture solutions Lead, deliver and support the technical and architecture design … capability in, the Architecture Contribute to building an inclusive digital culture. Support development of the Architecture Practice. Coach and mentor other architects. 5.) Data Integration: - Knowledge of integrating data from disparate sources (ERP systems, CRM systems, IoT devices, etc.), Real Time data pipelines ...

performant Leverages contemporary advanced analytics capabilities and visualisations Provides simple and efficient BI self-service reporting Supports a single analytical view of our data and information Uses agreed and defined metrics Is built in line with our information management strategy and guiding principles Delivers business value through action … Ensures “explainability” fit for audit in a regulatory controlled environment Working as part of the Reporting & Analytics team in close collaboration with the Data Engineering team and business areas to take responsibility and accountability for collaborative design and build of end-user visualisations, reports, and ad-hoc analysis ...

Lambda, SNS, SQS, Step Functions, EventBridge, API Gateway, Load Balancers, and Aurora DB Implement IAM, KMS, and security best practices Build and manage data pipelines and integrations with Databricks Implement application logging, monitoring, and alerting using tools such asSplunk, Dynatrace, and CloudWatch Collaborate with cross-functional teams including … large-scale data processing Hands-on experience with logging, monitoring, and observability tools (Splunk, Dynatrace, etc.) Strong understanding of data lake concepts Nice to Have Experience working with Snowflake ...

Senior Data Engineer - Azure Cloud Migration & Systems Integration I am recruiting for a rapidly growing, multi-site healthcare organisation in the middle of a major digital transformation. As their Data & Business Intelligence function continues to expand, they require a Senior/Lead Data Engineer … Azure migration and enterprise integration strategy. You'll be joining at a pivotal time as the business migrates to Azure, modernises its data platform, and connects a complex ecosystem of finance, HR, and core operational systems. The role comes with strong visibility across the business and regular interaction ...

numi is proud to partner with a growing global technology consultancy seeking multiple Mid/Senior/Principal Data Engineers to join their team in London on a hybrid basis. An idea of some of the hires we are making: 8 AWS Data Engineers 1 Cloud … Engineer AWS 2 Data Engineers with Oracle 5 Snowflake Engineers with AWS 2 Data Engineers with Azure This consultancy empowers some of the world's biggest businesses by delivering advanced data, AI, cloud, and digital solutions. They are committed to providing a platform ...

Lead Database Administrator Location: Hybrid Salary: Up to £60,000 per annum Be the data powerhouse behind the Buzz Bingo experience! At Buzz, everything we do starts with people, our customers and you. If you’re passionate about tech, love bringing new ideas to life, and enjoy leading … into a club to every click they make online. As our Lead Database Administrator, you’ll play a central role in shaping the data foundations that power unforgettable player experiences across the UK. What you’ll be doing You’ll lead the way on all things data ...

ITIL 4 UK Public Sector deals Familiarity with: AI(Ops), Intelligent Automation, Lean and Analytics Experience with tooling for Discovery, Monitoring and Patching Data lakes Modern Catalog Management ServiceNow, SMAX or Remedy is a plus UK Security Clearance: At least ...

secure designs and governance within ZLAP IT's evolving architecture, ensuring that new and existing technologies adhere to Zurich's Information Security and Data Assurance Policies. They will be accountable for the secure delivery of IT projects, working closely with both ZLAP IT and wider ZLAP teams … . API and integration technologies (Mulesoft, web services). Backend policy administration and servicing platforms (Salesforce, Life400, VPMS, BRC, automated underwriting, data lake, fund administration, document management system). Collaborate with ongoing modernization projects (e.g., Calcs platform, Group Risk policy admin, document storage and rendering, payroll enhancements ...

Hands-on experience with CI/CD pipelines , GitHub , GitHub Actions , and Docker Experience working with Delta Tables or similar modern data lake table formats Experience integrating with cloud and on-prem systems, including Dash Enterprise Comfortable delivering into fast-paced, production-grade environments Knowledge of Kubernetes ...

earliest possible date, a full-time and permanent Software Developer (m/f/d) for scientific applications with a focus on Big Data to strengthen our development team at KWS Saat SE & Co. KGaA in Einbeck, Lower Saxony. The role involves replacing an existing application … C# (.NET Core) and Python Practical experience with distributed systems, ideally in an AWS cloud environment or with Docker and Kubernetes Practical experience with DataLake technologies, such as Databricks or AWS Athena and Apache Spark Practical experience in professional software development (e.g., dependency injection, mocking, TDD, CI/CD pipelines ...

enterprise contexts Proven track record defining roadmaps, SLAs, deployment strategies, and enterprise-ready processes Strong technical understanding of microservices architectures, Kubernetes, databases, data lakes, BI/reporting, and APIs Experience working with high-throughput, low-latency systems (e.g., payments or other critical transaction-heavy industries) Skilled at bridging ...

Type: Permanent/Fixed Term Job Summary: We are seeking a highly experienced Communications Architect with deep expertise across Intelligent Automation Platforms, Data & AI solutions, and Telecom OSS architecture & design. The ideal candidate will have over 15 years of relevant industry experience, driving strategic architecture, designing scalable communication … systems Review and refine OSS HLDs/LLDs, ensuring best practices and architectural consistency. Collaborate with cross-functional teams including Network Engineering, Operations, Data Engineering, Automation COE, and Enterprise Architecture. Engage with business stakeholders to convert operational pain points into architecture-led solutions. Required Skills & Experience Technical Expertise ...

setup through production rollout Serve as the Starburst subject matter expert , providing guidance and technical leadership Design and implement scalable query architecture across data lakes, warehouses, and enterprise data sources. Defining, creating, and delivering Data Products. Deploy and configure Starburst Enterprise or Starburst Galaxy … including Trino cluster setup and tuning Integrate multiple data sources ie Snowflake, databases, etc Implement security, authentication, and authorization aligned with enterprise standards Optimize query performance, concurrency, and resource utilization Establish monitoring, alerting, and operational best practices Collaborate with cloud and platform teams to ensure high availability, scalability ...

Description: Bachelors degree in Computer Science Engineering or related field or equivalent experience Build and optimize data pipelines and ETL processes Develop and maintain data lakes and warehouses (Azure, AWS, GCP, or Snowflake) Integrate structured and unstructured data from multiple sources Support AI/… model training, deployment, and monitoring Ensure data quality, integrity, and governance standards Collaborate with data scientists on feature engineering and model readiness We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit ...

Implementation & Rollout HubSpot rollout across five business areas Replacement of two existing CRMs Integration with Microsoft Dynamics 365 for sales teams Two-way data integration across platforms E-Commerce Replatform Delivery of a new e-commerce platform within critical compliance timelines Oversight of Magento (or alternative platform) replatforming … party systems Key Responsibilities Lead end-to-end delivery of multiple concurrent digital and IT projects Manage cross-platform integrations across CRM, web, data, billing and e-commerce systems Own project governance including planning, RAID logs, change control, reporting and benefits tracking Coordinate stakeholders across IT, Marketing, Sales ...