126 to 150 of 1,474 Permanent Databricks Jobs

data pipelines. Strong understanding of data modeling. Familiarity with data governance, lineage, and quality frameworks. Fluency with AI tools and ADLC Working knowledge of Databricks Experience with Apache Spark Preferred: Hands-on experience with AWS data services (e.g., S3, Glue, Lambda, MSK). Proficient in CI/CD pipelines, automated ...

experience in one or more of the following areas:Programming & Analytics – Python, SQL, R, Spark, machine learning and advanced analyticsCloud & Data Platforms – Microsoft Fabric, Databricks, Snowflake, Azure, AWS and GCPAI Technologies – GenAI frameworks, Agentic AI, vector databases, semantic search, knowledge retrieval and LLM application developmentData & Visualisation – Power BI, Tableau, Looker ...

Lead Foster City, CA 94404 (onsite) Salary - Market- Based on experience. Full-Time/Direct-Hire Hiring Data Engineering Lead with strong expertise in Databricks on AWS, MDM, and enterprise data integration. Lead the design and delivery of modern data platforms that enable trusted, governed, and scalable data consumption across … digital transformation programs. Skills/Experience 10+ years of experience in Data Engineering, Data Integration, or Data Platform delivery; hands-on experience with Databricks on AWS; Apache Spark, PySpark, Delta Lake, and Lakehouse architecture Experience designing and implementing enterprise-scale data pipelines; Strong understanding of AWS services such ...

Databricks, we are obsessed with enabling data teams to solve the world's toughest problems, from security threat detection to cancer drug development. We do this by building and running the world's best data and AI infrastructure platform, so our customers can focus on the high value challenges that … above. The Delta DML team owns the core write-path operations for Delta Lake, the open-source storage layer behind the Databricks Lakehouse. Our mission is to deliver industry-leading performance and a seamless user experience at massive scale, with most data written in Databricks flowing through our platform. ...

more broadly. Reporting to: Senior Manager - AI FDE, EMEA The impact you will have: Develop cutting-edge GenAI solutions, incorporating the latest techniques from Databricks AI research to solve customer problems Own production rollouts of consumer and internally facing GenAI applications Serve as a trusted technical advisor to customers across … concepts to non-technical and technical audiences alike Passion for collaboration, life-long learning, and driving business value through AI [Preferred] Experience using the Databricks Intelligence Platform and Apache SparkTM to process large-scale distributed datasets Willing to travel once every 4-8 weeks to see customers (as needed) About ...

/data pipelines Knowledge of data modelling and database design Strong analytical and problem-solving skills Nice to have: Azure (Data Factory, Synapse, Databricks or similar) Power BI Git or Azure DevOps Experience working with cloud-based data platforms Exposure to retail, eCommerce or customer data This ...

IAM. Advanced SQL development skills. Strong experience designing and developing ETL/ELT pipelines. Experience working with large-scale and distributed data-processing environments. Databricks and/or Snowflake. #J-18808-Ljbffr ...

businesses Experience with experimentation and optimisation frameworks Python/R or exposure to advanced analytics Experience with modern data platforms (such as Azure, Databricks, Snowflake, BigQuery) Additional Information Salary£65,000 - £75,000 (based on experience) + benefits package Location: Hybrid working with onsite travel tothe office in Basingstoke. Candidates ...

expectations on Data Engineering and AI. Exposure to data platforms, programming languages and AI tools, such as Alteryx, Knime, Power BI, Microsoft Fabric, Tableau,Databricks, Snowflake, Microsoft Purview, Collibra, Informatica,Claude, Chat GPT,Microsoft Copilot,Python and SQL among others, to deliver practical and impactful analytics assurances and solutions. Experience ...

Python). Demonstrated experience engineering within a data warehouse or dimensional data modeling. Demonstrated understanding of cloud-based tools, including Power BI, Data Factory, Databricks, Snowflake, (link removed), Excel, and database management. Demonstrated understanding of the software development lifecycle. Experience may be gained in any work or educational program. ...

that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. We are building a governed, interoperable data estate that enables self-service … defined support responsibilities. Ensure solutions are secure, scalable, maintainable, and aligned with organisational standards and governance requirements. Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines ...

robust data products. Implement data quality checks and monitoring processes. Participate in technical reviews and contribute to continuous improvement. Technical Stack Core: SQL Server Databricks (introductory) Git REST APIs Microsoft Fabric Terraform basics What You’ll Bring: Professional experience in data engineering or related technical roles. Solid understanding ...

technologies to evolve Movar's data platform. Provide technical guidance to junior engineers and contribute to team capability building. Technical Stack Core: SQL Server Databricks Infrastructure as Code (Terraform, Bicep) REST APIs GitHub Actions Microsoft Fabric DataOps practices What You'll Bring Solid understanding of data architecture, APIs, and modern ...

solving skills Excellent verbal and written communication skills Experience working within Agile software development environments Desired Skills: Healthcare or health insurance experience Hands-on Databricks experience including notebooks, workflows, and cluster management Implementing enterprise data pipelines Experience with AWS services including S3, Lambda, Glue, EC2, and related cloud technologies Experience ...

skills Excellent verbal and written communication skills Experience working within Agile software development environments Desired Skills: Healthcare or health insurance industry experience Hands-on Databricks experience including notebooks, workflows, and cluster management Experience with AWS services including S3, Lambda, Glue, EC2, and related cloud technologies Experience scheduling and automating data ...

engineering community at Moneybox, sharing expertise and helping raise standards across our technology estate Our Data Technology Stack Cloud: Microsoft Azure Data platforms: Azure Databricks, SQL Server, Cosmos DB and Blob Storage Data processing: Python, Spark and SQL Messaging: Azure Service Bus and Event Hubs DevOps and infrastructure: Azure DevOps ...

infrastructure and workflows Skills and experience you need as the Senior Data Engineer: Passion for building scalable, resilient cloud data platforms Strong experience with Databricks or Snowflake on AWS Proven Python skills, including Spark and Airflow expertise Advanced SQL skills and end-to-end data modelling experience Experience building batch ...

Engineer within complex technical environments. Strong knowledge of data management principles, including data modelling, integration, quality, and governance. Strong commercial experience with Snowflake and Databricks essential. Experience assessing existing data management systems and recommending improvements. Experience with modern data architectures, including cloud-based and distributed systems. Strong proficiency ...

engagements by providing technical specifications and solution architecture for data flows. Technical proficiency in tools such as SQL, Python, ETL platforms, API gateways, Snowflake, Databricks, and metadata management platforms. To be successful in this role, were seeking the following: Bachelors degree or the equivalent Advanced/graduate degree preferred Severeal ...

large language model serving, agentic patterns (tool/function calling, Model Context Protocol), or platforms such as Bedrock or Azure OpenAI Experience with Databricks, MongoDB, or large‐scale extract, transform, and load/data integration workflows Knowledge of data governance, lineage, and entitlements concepts in an enterprise environment ABOUT ...

Information Architecture; Data Modelling; Data Governance; Metadata Management; Master Data Management; Data Quality; Reference Data. Cloud Platforms: Microsoft Azure; AWS; GCP. Modern Data Platforms: Databricks; Microsoft Fabric; PostgreSQL. Data Integration: Azure Data Factory; API-led Integration; Kafka; ETL/ELT; Streaming and Event-Driven Architectures. Architecture & Modelling: TOGAF; DAMA; ArchiMate ...

helpful to have experience/expertise/knowledge in the following: Python AWS Kubernetes Spark & distributed computing dbt Terraform Data Warehousing (we use Databricks but experience with other platforms is fine) MLOps implementation (desirable but not required) Airflow (or other orchestration tooling) Governance Things to note Just ...

guide how one could deploy infrastructure into different environments. Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop. Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes) Ability to create data pipelines ...

Awareness of modern lakehouse concepts and integration with layered data platforms, including Delta Lake and raw/curated data layers. Exposure to Spark/Databricks and PySpark or Spark SQL for collaborating with data engineering teams and troubleshooting end-to-end data flows. Experience with automated unit/integration testing ...

Awareness of modern lakehouse concepts and integration with layered data platforms, including Delta Lake and raw/curated data layers. Exposure to Spark/Databricks and PySpark or Spark SQL for collaborating with data engineering teams and troubleshooting end-to-end data flows. Experience with automated unit/integration testing ...