1,101 to 1,125 of 1,511 Databricks Jobs

pipelines by integrating SCADA, ACM, Kepware, MQTT/Sparkplug B, HiveMQ, and edge technologies to deliver reliable operational data to enterprise platforms such as Databricks Optimizes OT data quality and availability through troubleshooting, monitoring, and performance tuning of polling engines, communication channels, edge devices, and data flows Develops and maintains … SCADA and industrial communication protocols, including OPC, Modbus, DNP3, MQTT, and related OT systems Experience with enterprise data platforms and analytics tools, including Databricks, SQL, Python, Power BI, and cloud-based data architectures Ability to diagnose and resolve complex OT data issues, including data quality problems, communication failures, and system ...

datasets into clear insights that help business stakeholders make better decisions. Working hands‐on with SQL, Python and cloud data platforms such as Databricks, AWS and Snowflake, you will build the analysis, reporting and audience segments that power international marketing campaigns and track performance against growth goals. You will work … Data Analysis Write efficient SQL and Python to extract, clean, transform and analyse large fan and marketing datasets. Work within cloud data platforms (Databricks, Snowflake, AWS) to build and maintain analytical datasets and workflows. Take a business question, develop an analysis plan, and deliver an answer that addresses it. Summarise ...

+ package Active SC or DV Clearance required 2-stage virtual interview process Experience required in Python, SQL, Spark, Databricks and Customer Consultancy We're working with a fast-growing, high-performing technical consultancy seeking an experienced Data Engineer to join a team specialising in data, AI and software solutions … Experience designing and building data-intensive applications and pipelines Strong programming skills in Python and SQL or similar Experience with technologies such as Spark, Databricks, AWS, Azure, GCP and/or Airflow Strong focus on data quality, testing and reliability Solid software engineering fundamentals and high engineering standards Strong communication ...

from diverse data sources and formats Hands‐on experience with Apache Airflow, dbt, and Python Strong database skills with Postgres SQL, DynamoDB, Snowflake, and Databricks Experience collaborating with Agile teams, product owners, and cross‐functional stakeholders, with strong communication skills for both technical and non‐technical audiences Awareness … support highly scalable data engineering solutions that power Moody’s next‐generation digital content platform. Design, develop, and maintain scalable data pipelines using DataBricks, Snowflake, Apache Airflow, dbt (SQL), and Python within AWS Support platform optimization, infrastructure improvements, process control enhancements, and system upgrades Collaborate with Moody’s technical teams ...

deliver reusable technical assets — reference architectures, POV frameworks, or architectural playbooks — at scale.Fluency across the modern data and AI stack: cloud data platforms (Snowflake, Databricks, BigQuery), agentic frameworks, RAG, vector databases, LLM orchestration, data governance, and enterprise integration patterns.Experience with prompt engineering, agent lifecycle management, and hands-on prototype development.Hands … trade-offs of building with hyperscalers vs. Salesforce. Deep familiarity with Informatica (IDMC) for enterprise data integration and MDM, alongside Snowflake, Databricks, BigQuery, and Redshift.AI & Agentic Architecture Foundational ML concepts, data preparation, Python, applied AI, Generative AI, prompt engineering, retrieval-augmented generation (RAG), vector stores, and agentic architectures. Hands ...

products (reporting, AI/ML) and operations. Co-author data governance practices with the Data Governance Lead: metadata, data quality, lineage, privacy, compliance within Databricks Unity Catalog. Review solution designs for architectural alignment and risk reduction, eliminating duplication and maximising reusability at cost-efficient scale. Evaluate emerging technologies and reduce … medallion, big data). Demonstrable experience in running long-term data migration projects between bespoke systems desirable. Experience with cloud data platforms - Azure (desirable) & Databricks (essential). Advanced data modelling expertise, using industry reference models where appropriate. Proven stakeholder engagement and communication skills. Experience operating in the insurance industry ...

source-of-truth decisions independently. Strong hands-on data skills: fluent SQL, solid data modelling, and a modern data stack. We are building on Databricks, so experience there or with an equivalent lakehouse or warehouse, plus a transformation framework such as dbt and strong Python, is what we are looking … built, not familiarity with the buzzwords. A proven track record in integrating multiple operational and commercial or SaaS systems. For us, that landscape includes Databricks, HubSpot, product analytics via Pendo, fleet and robot telemetry via Grafana, deployment tooling and contractual data. The communication and facilitation skills to align non-technical ...

source-of-truth decisions independently. Strong hands-on data skills: fluent SQL, solid data modelling, and a modern data stack. We are building on Databricks, so experience there or with an equivalent lakehouse or warehouse, plus a transformation framework such as dbt and strong Python, is what we are looking … built, not familiarity with the buzzwords. A proven track record in integrating multiple operational and commercial or SaaS systems. For us, that landscape includes Databricks, HubSpot, product analytics via Pendo, fleet and robot telemetry via Grafana, deployment tooling and contractual data. The communication and facilitation skills to align non-technical ...

Architecture Microservices Architecture Event-Driven Architecture API & Integration Architecture Cloud-Agnostic Architecture Domain-Driven Design Strangler Pattern Migration DevSecOps CI/CD & IaC Observability DataBricks Data Governance & Lineage Cloud Portability Kubernetes Kafka .NET MSSQL/PostgreSQL Nice to Have Financial Services/Banking Domain experience Key Competencies Proven enterprise architecture … requirements including high availability, disaster recovery, failover, observability, monitoring, logging, tracing, SLOs, incident handling, and support transition. Good appreciation of enterprise data platforms like Databricks , governed reporting, data lineage, data quality, auditability, regulatory evidence, and interaction between operational systems and analytical data platforms. Excellent stakeholder management, architecture governance, decision facilitation ...

Develop and maintain custom APIs (REST, GraphQL, webhooks) and integration pipelines connecting AFO/Agentforce to Salesforce Data Cloud (Data 360), cloud warehouses (Snowflake, Databricks), and core ERPs (SAP, Oracle, NetSuite) via MuleSoft or custom middleware. AI‐Assisted Engineering: Leverage modern AI tools (Cursor, Claude, Vibes) embedded directly into your … Execution. Experience within the Salesforce Ecosystem (Agentforce Specialist, Data Cloud, Apex, Flow, or Headless architectures). Hands‐on experience with cloud data platforms (Snowflake, Databricks, BigQuery). Proven ability to create reusable accelerators, reference architectures, connectors, and implementation playbooks from customer deployments. Unleash Your Potential When you join Salesforce ...

sources, building the robust datasets that fuel all decision-making. Build the Data Pipeline: Design and optimize data pipelines using Delta Live Tables on Databricks , ensuring efficient, reliable, and scalable data movement to balance computational power with analytical agility. Be the Bridge: Partner directly with business teams across the company … Experience with Tableau Prep is a welcome addition to your toolkit. A minimum of 2 years hands-on with the power of AWS and Databricks -the cloud-scale engines for our data. At least 3 years of proven fluency in the languages of data manipulation: Spark SQL, SQL, and Python. ...

DATA, Inc. is seeking an experienced Data Engineer to design and deliver Databricks-based data pipelines for complex client projects. You will engage with clients, collaborate with architects and engineers, and drive best practices across the data lifecycle. The role requires 5–8 years in data engineering, strong SQL/… Python, and hands-on experience with Databricks on cloud platforms such as AWS, Azure, or GCP. #J-18808-Ljbffr ...

Data Architect/Lead Data Engineer to shape data architecture while delivering hands-on engineering. You will work across cloud data platforms including Databricks, building data pipelines, governance and analytics capabilities. The role blends architectural leadership with practical delivery across data products and platforms. Ideal candidates will have extensive Databricks ...

Scott Logic is seeking senior/lead Data Engineers for client-facing roles. You will help build data platforms and pipelines, transforming data for analytics and ML workloads. Some on-site work in the London ...

We are currently looking for a Machine Learning Engineer to join our client’s data team. This is a hands‐on role where you’ll design and build robust data pipelines, transform ML prototypes into ...

IntelStack is hiring a Senior Data Engineer to build and scale an Azure Databricks platform powering national-economic analysis. You will own end-to-end pipelines from ingestion to production-ready datasets, working with economists and data scientists. Based in London with a hybrid model (3 days on site ...

EPAM Systems in London seeks a Senior Data Engineer - Tech Lead to shape cloud-native data platforms using Azure Databricks, PySpark and Lakehouse principles. You will lead architecture, drive modernization, and mentor engineers while delivering scalable pipelines for high-volume workloads. You will collaborate with stakeholders to translate business needs ...

leading data consultancy in the UK is seeking a skilled data engineer to enhance data processing frameworks and support Azure Databricks solutions. The ideal candidate will have extensive experience with PySpark, AWS, and strong programming skills in Python and SQL. Responsibilities include collaborating with architecture teams and delivering high-quality ...

maintain our data ecosystem. You will lead a small team, mentor junior engineers, and collaborate with stakeholders to deliver scalable data pipelines on Databricks using PySpark and Spark SQL. The role involves guiding data strategy, migrating legacy processes, and delivering enterprise data solutions in a cloud-native environment, with hybrid ...

data platform to enable analytics, reporting, and AI initiatives across Pricing, Underwriting and Claims. You will design and build scalable data pipelines on Azure Databricks and Delta Lake, with governance, security, and real-time processing at scale. The role sits in the Enterprise Data Team and requires strong ...

service Employee Assistance Program I am working with a client in the West Midlands who are looking for an Enterprise level Data Architect with Databricks experience to join the team. Databricks is an absolute necessity for this role. The architecture has been outsourced up to this point, and is being … individual contributor within the team. Upcoming projects include migration of customer data to newer, cloud based servers. Skills and Experience: Enterprise level Data Architecture Databricks Modelling Technical authority/Leadership Experience with Canonical Model design patterns Cleansing and ETL Creation and design of data systems including best practice standards principles ...

hiring a Databricks Champion Architect to define and govern our modern lakehouse architecture. You’ll blend solution design, hands‐on technical leadership, and platform enablement; setting patterns, accelerating delivery teams, and ensuring production‐ready engineering on a contract basis. What you’ll do Own end‐to‐end Databricks architecture across … playbooks, templates, ADRs, coaching . Support pre‐sales and roadmap —HLDs, estimation, risks, proposals. What you’ll bring Minimum 2+ years recent hands‐on Databricks experience using modern features. Clear evidence of architecture ownership . Must Have Two active Databricks certifications (e.g. Data Engineer, ML, GenAI Engineer). Unity Catalog ...

currently seeking an MLOps AI Lead & Databricks Platform Specialist to join a global end client, taking ownership of the Databricks platform and supporting the delivery of robust, scalable MLOps capabilities. We are ideally looking for someone on a permanent basis , although contract-to-permanent could also be considered. Location: Hybrid … years’ experience Proven experience managing data/analytics platforms and/or MLOps capabilities in a complex enterprise environment. Hands-on experience operating Databricks (workspace administration, cluster policies, jobs, Delta Lake, Unity Catalog, access controls, and production support) Experience implementing MLOps practices across the model lifecycle (CI/CD, versioning ...

Global is seeking an MLOps AI Lead & Databricks Platform Specialist to own the Databricks Lakehouse Platform and drive robust MLOps capabilities across the enterprise. The role involves platform service management, security governance, and collaborating with Data Engineering and Data Science teams to operationalize ML models through CI/CD, testing ...

measurable business outcomes for our clients. This is a hands‐on engineering role focused on developing production‐ready agentic solutions using Microsoft AI technologies, Databricks AI capabilities and modern software engineering practices. The successful candidate will combine strong technical skills with expertise in AI agents, orchestration frameworks, enterprise integrations … measurable business value. Build solutions using Microsoft AI technologies including Copilot Studio, Azure AI Foundry, Azure OpenAI and Microsoft Fabric. Develop intelligent agents using Databricks AI capabilities including Mosaic AI and modern agent development frameworks. Design and implement agent workflows, orchestration patterns and autonomous business processes. Build agents that integrate ...