1,201 to 1,225 of 1,511 Databricks Jobs

Korn Ferry is seeking a Data/AI Engineer (Databricks) to drive production-ready data and AI solutions across ~1,000 sites. The role focuses on Databricks engineering, LLM pipelines, and agent development, delivering hands-on delivery rather than advisory work. The contract is initially 6 months with remote working. ...

solution architects while contributing hands‐on to the design and delivery of end‐to‐end data platform solutions across Pandora’s Azure Synapse and Databricks environments. This is a dual role combining architectural leadership with people management. You will lead a small, experienced team of solution and data architects, setting … engineering teams. Architecture Accountabilities Setting architectural direction across the data platform, ensuring consistency and coherence of solution designs across both Azure Synapse and Databricks environments. Reviewing and providing feedback on technical designs from solution architects and lead engineers, ensuring adherence to data platform standards and best practices. Ensuring solutions balance ...

offre Objectif de la mission Recherche d'un ingénieur en ingénierie des données senior avec une solide expérience sur les plateformes Azure (Databricks, ADF, Synapse), Python, SQL et Power BI. Missions principales Gestion de données dans le cadre de projets d'ingénierie des données Développement et maintenance de solutions basées … Azure (Databricks, ADF, Synapse) Intégration et gestion de données avec Python, SQL et Power BI Profil recherché Expérience solide en ingénierie des données et/ou développement sur Azure #J-18808-Ljbffr ...

Seeking a Databricks Architect for an onsite contract role in Tarrytown, NY to lead enterprise-scale data platform modernization and migration initiatives on AWS. The ideal candidate will architect scalable Databricks Lakehouse solutions using Delta Lake, Unity Catalog, DLT, Workflows, Auto Loader, PySpark, and Structured Streaming. The role involves migrating ...

reliable production environments. This is a hands-on engineering role focused on ML pipelines, productionisation, deployment and ongoing model lifecycle management within a modern Databricks environment. Key Responsibilities of the ML Engineer: Build and automate end-to-end ML pipelines covering feature engineering, model training, scoring and deployment Productionise models … developed by Data Scientists, transforming notebooks and prototypes into modular, tested and production-ready code Develop scalable ML solutions using Python, PySpark, Databricks and MLflow Deploy machine learning models into batch and real-time environments through APIs, scheduled workflows and production pipelines Manage model versioning, promotion and rollback throughout ...

Computerworld Personnel Ltd is recruiting an Enterprise Data Architect with Databricks experience for a hybrid role in the West Midlands. The role focuses on bringing the data architecture back in-house, delivering Databricks-based data lakes, governance, and a data roadmap. You will be an individual contributor driving future cloud ...

Enterprise Data organisation, this role leads the engineering of cloud-native data services for the firm’s strategic platform, driving the migration to Databricks and delivering scalable Spark/Scala solutions on AWS.The overall objective of this role is to lead applications systems analysis and programming activities. Proven leadership … processing, advances matching engines, AI/GenAI services and large-scale data platforms. This role will drive transformation of enterprise data capabilities using Databricks, scala/spark and cloud native architectures, ensuring platform is stable, scalable, resilient, secure and AI enabled.* As platform landscape evolved towards cloud-native, AI enabled ...

technical challenges, contribute to engineering standards and help drive best practices across the team. You'll build scalable data pipelines and frameworks using Azure, Databricks and PySpark, working across the full engineering lifecycle from design through to production. You'll also support other engineers through code reviews, knowledge sharing … deliver reliable data solutions that create real business value. Skills & Experience Strong experience building cloud-native data platforms, ideally on Azure Commercial experience with Databricks, PySpark and Python Strong SQL and data engineering expertise Experience designing and delivering scalable ETL and data pipeline solutions #J-18808-Ljbffr ...

support OT data pipelines integrating SCADA, ACM, Kepware, 4.MQTT/Sparkplug B, HiveMQ, and edge technologies 5.Integrate operational data with enterprise platforms such as Databricks 6.Troubleshoot and optimize polling engines, communication channels, edge devices, and data flows 7.Develop data solutions for reporting, analytics, machine learning, and business decision-making 8.Collaborate … experience with ClearSCADA, AutoSol, Kepware, and OPC 2.Strong knowledge of SCADA and industrial communication protocols, including OPC, Modbus, DNP3, and MQTT 3.Experience with Databricks, SQL, Python, Power BI, and cloud-based data architectures 4.Strong SQL experience 5.Knowledge of network operations and telecommunications 6.Understanding of flow computer protocols 7.Experience ...

technical challenges, contribute to engineering standards and help drive best practices across the team. You'll build scalable data pipelines and frameworks using Azure, Databricks and PySpark, working across the full engineering lifecycle from design through to production. You'll also support other engineers through code reviews, knowledge sharing … deliver reliable data solutions that create real business value. Skills & Experience Strong experience building cloud-native data platforms, ideally on Azure Commercial experience with Databricks, PySpark and Python Strong SQL and data engineering expertise Experience designing and delivering scalable ETL and data pipeline solutions If you're looking ...

consulting team. TheLeadPlatform Engineer contributes to CF’s commercial activities in a focused way: providing technicalexpertiseto support partnership opportunities with platform vendors such as Databricks and with data and researchorganisationsandcontributing technical input to proposals where platform architecture or infrastructure design is relevant. Responsibilities Platform architecture and design Produce detailed technical … designs for CF’s cloud infrastructure (OCI, Databricks) and NHS data pipelines, working within the strategic architecture set by the Director Define integration patterns, data flowdesignsandcomponentspecifications that the data engineering team implements Make implementation-level technology decisions (tooling, frameworks, configuration approaches) within the Director’s strategic technology selections Design scalable ...

control the creation of data domains that align with the banks underlying capabilities Data Engineering & Platforms Design data product schemas across Snowflake and Databricks, including Delta Lake structures and access patterns Define and enforce architectural guardrails for data product design, including performance, scalability, security, and cost efficiency Set design standards …/pipelines for compliance Embed data contract standards and data quality frameworks across pipeline outputs Agentic AI & AI-Assisted Development Leverage Snowflake Cortex/Databricks Genie (or similar) to help engineering teams deliver natural language query and LLM-augmented data products Utilize GitHub Copilot (or similar) to accelerate modelling, documentation ...

using Apache Flink, Apache Kafka, Spark Structured Streaming, or similar technologies Knowledge of modern data lakehouse architectures and ecosystem such as Kafka, Flink, Spark, Databricks, Snowflake, DBT, Airflow, Debezium, Delta/Iceberg, and comfort with Python/Java and SQL Experience with networking and security concepts within AWS, including VPCs … SaaS or FinTech company Technologies we use: AWS Services: MSK, EC2, VPC, IAM, S3, SQS, Managed Flink, EKS Data Lakehouse: Kafka, Flink, Spark, Databricks, DBT, Debezium #J-18808-Ljbffr ...

time Sector and subsector: IT | Test & QA Salary: Competitive salary You will own the quality assurance of Sagacity's client data platform deployments — the Databricks Lakehouse pipelines, gold-layer views, and analytics datasets that drive marketing, billing, credit and debt outcomes for our clients across financial services, retail, energy, telecoms … volume checks, data quality rules, and migration parity — using SPHERE's YAML-driven test framework Investigate test failures systematically: trace root causes through the Databricks Lakehouse stack (bronze → silver → gold), distinguish pipeline bugs from data issues, and produce clear, evidenced findings for the development team Manage QA work items ...

standards, risk & control libraries, evaluation checklists). Configure/enable client tools (e.g., Microsoft Purview for governance/lineage/labels; Azure ML/Databricks/Fabric for MLOps, model registry, monitoring; Power BI governance). Contribute to assurance reviews and quality gates; maintain well-structured evidence for audits … risk management, ISO/IEC 27001, UK GDPR/DPA 2018). Hands-on exposure to one or more platforms: Microsoft Purview, Azure ML, Databricks/MLflow, Azure Fabric, Power BI governance; plus experience with data catalogues (e.g., Collibra, Alation) is a bonus. Exposure to MLOps processes (model registry, approval ...

Lead Data Engineer 5+ Years Experience Scalable Batch & Streaming Pipelines Cloud Architecture (AWS, Databricks, Kubernetes) This Jobot Job is hosted by: Jim Quirk Are you a fit? Easy Apply now by clicking the "Quick Apply" button and sending us your resume. Salary: $180,000 - $250,000 per year … pipelines to collect and transform our rapidly growing Big Data set within our hybrid cloud architecture utilizing Kubernetes/EKS, Kafka/MSK, and Databricks/Spark. Mentor junior engineers in software and data engineering best practices. Produce clean, well-tested, and documented code with a clear design to support ...

builds and governs the data foundation that powers the business. You'll work within our stack — Python ingestion pipelines, Airflow orchestration, and Snowflake/Databricks — helping move data reliably and securely from source to decision-ready output.You'll implement features and fixes against a given design, handle known classes … root-causing pipeline issues independently before escalating Experience with workflow orchestration tools (Airflow or similar) and a cloud data warehouse/lakehouse (Snowflake, Databricks, or similar) Solid understanding of data pipeline concepts: idempotency, schema evolution, backfills, and data quality/testing Experience giving substantive code review feedback, not just style ...

several of the areas below and working knowledge across the rest. AI platform & cloud architecture Architect AI andDataPlatforms using a mix of technologies including Databricks, Snowflake,Claude Enterpriseand the native services of Azure,AWSand GCP-selecting the right tool for the workload rather than defaulting to a single vendor. Design … role — including accountability for end-to-end solution design,resourcingand commercial outcomes. Proven ability to architect enterprise AI platforms across a mix of technologies (Databricks, Snowflake, Azure, AWS, GCP) withstrong designcapability across cloud,dataand AI domains. Working understanding of how AI integrates with major operational systems such as SAP,Salesforceand ...

Sigma dashboards to provide Brand Operations with self-serve, ongoing visibility into productivity, profitability, and pricing trends Write and maintain SQL (Spark SQL/Databricks) queries to support both recurring and ad hoc analytics requests within tight reporting cycles Support new item planning by sizing SKU proliferation risk, flagging margin … years of experience in retail/CPG analytics, business intelligence, or brand/marketing analytics Advanced SQL skills (Spark SQL or Databricks experience strongly preferred) with hands-on experience building in a modern BI platform (Sigma, Tableau, or Power BI) Advanced proficiency in Microsoft Excel, including Power Pivot and complex ...

Umsetzung von Data Use Cases – von der Ideenfindung und Anforderungsaufnahme über Entwicklung und Testing bis hin zur Bereitstellung auf unserer Datenplattform (Databricks, Azure). Enge Zusammenarbeit mit den Entwicklungsteams für Data Products, um Datenqualität, Konsistenz und Verfügbarkeit vorgelagerter Datenprodukte sicherzustellen, z. B. Asset Master Data (AMD), Near Real Time SCADA … datengetriebenen, Analytics-, Consulting- oder Change-Management-Umfeldern. Fundiertes Verständnis von Data Analytics, Business Intelligence, KPI-Frameworks, operativem Reporting, Datenvisualisierung sowie modernen Cloud-Datenplattformen, einschließlich Databricks, Azure, Power BI, Snowflake und Python. Fähigkeit, komplexe geschäftliche Anforderungen in klare Produktanforderungen, User Stories und datengetriebene Initiativen zu übersetzen sowie Erkenntnisse in konkrete Handlungsempfehlungen ...

Umsetzung von Data Use Cases – von der Ideenfindung und Anforderungsaufnahme über Entwicklung und Testing bis hin zur Bereitstellung auf unserer Datenplattform (Databricks, Azure). Enge Zusammenarbeit mit den Entwicklungsteams für Data Products, um Datenqualität, Konsistenz und Verfügbarkeit vorgelagerter Datenprodukte sicherzustellen, z. B. Asset Master Data (AMD), Near Real Time SCADA … datengetriebenen, Analytics-, Consulting- oder Change-Management-Umfeldern. Fundiertes Verständnis von Data Analytics, Business Intelligence, KPI-Frameworks, operativem Reporting, Datenvisualisierung sowie modernen Cloud-Datenplattformen, einschließlich Databricks, Azure, Power BI, Snowflake und Python. Fähigkeit, komplexe geschäftliche Anforderungen in klare Produktanforderungen, User Stories und datengetriebene Initiativen zu übersetzen sowie Erkenntnisse in konkrete Handlungsempfehlungen ...

coverage expands naturally with each deployment increment rather Role Overview you will own the quality assurance of Sagacity’s client data platform deployments — the Databricks Lakehouse pipelines, gold-layer views, and analytics datasets that drive marketing, billing, credit and debt outcomes for our clients across financial services, retail, energy, telecoms … Technical Strong SQL skills — comfortable writing and reading complex analytical queries (window functions, CTEs, aggregations) to interrogate data andverify correctness Hands-on experience with Databricks — running queries, navigatingUnity Catalog, reading Spark job outputs and understanding what they Working knowledge of PySpark or Spark SQL — enough to read pipelinecode, understand transformations ...

Specialists is seeking a Senior Data Engineer for a hybrid, banking-sector contract role in London. You will build scalable data pipelines using Python, Databricks and Spark, and own critical data platforms end-to-end. The role demands strong SQL, Databricks expertise and experience delivering enterprise-grade data solutions ...

Evidensia UK is seeking a Data Engineer to advance our Databricks-based data platform and deliver scalable data pipelines across Azure SQL Server. You will work closely with SMEs and the Data Architect to shape our data management strategy and meet business needs. Ideal candidates bring deep experience with Databricks ...

Marks Sattin (UK) Ltd partners with an international digital infrastructure organisation to hire an Azure Databricks Data Engineer on a 6-month contract in London, with hybrid onsite/remote working. The role focuses on designing and delivering Databricks-based data solutions to support reporting, analytics, and future AI initiatives. ...