51 to 75 of 1,448 Databricks Jobs

disaster recovery. Strong knowledge of Azure and/or Google Cloud Platform services across data, storage, networking, security and monitoring. Experience with BigQuery, Databricks, Synapse, Redshift or similar platforms is highly desirable. Expertise in scalable enterprise ELT/ETL, data integration, real-time and batch processing, event-driven systems, APIs ...

cloud platforms. We specialise on using the latest frameworks, reference architectures and technologies using AWS, Azure and GCP along with various data platforms like Databricks and Snowflake**Please Note:**Security Clearance: **To be successfully appointed to this role, must be eligible to obtain Security Check (SC)clearance.** To obtain ...

Data Mining, Business Intelligence, Big Data, Data Governance, Data quality, Data Cleansing Experience with Microsoft Azure a plus: Azure SQL Database, Analysis Services, Databricks, Data Lake, Logic Apps and Data Factory Understanding of Big Data technologies (Hadoop, Spark) Able to create rich visualisations that appropriately represent the underlying datasets. Review ...

your field Free account, about 30 seconds. We match PhD, postdoc and research jobs to what you study. About the role P-975 At Databricks, we are passionate about helping data teams solve the world's toughest problems — from making the next mode of transportation a reality to accelerating … only getting started. As a software engineer, you will work with our engineering team to build infrastructure and products for the Databricks platform. We're hiring across all of our teams, including backend, full stack, infrastructure, databases, systems, tools, cloud, and customer-facing products. You will join a cohort ...

Role Summary We are looking for a Senior Databricks Data Engineer with proven hands-on Databricks experience to build, develop and manage STACK's enterprise data platform. This is a production-focused engineering role requiring practical expertise in Databricks, PySpark, Python, SQL and Delta Lake. The role will design reliable … help improve the reliability and performance of the platform. Key Responsibilities: Design, develop, deploy and maintain production-grade ETL/ELT pipelines using Databricks, PySpark, Python and SQL, integrating APIs, databases, SaaS applications, files and spreadsheets. Develop and optimize scalable Delta Lake data models and lakehouse architecture for reporting, analytics ...

pipelines Knowledge of data modelling, data warehousing and data integration Experience with cloud platforms such as Azure or AWS Exposure to technologies such as Databricks, Snowflake or Microsoft Fabric Familiarity with data orchestration tools such as Azure Data Factory or Airflow Understanding of data quality, governance and performance optimisation Strong ...

solutions and engaging with client stakeholders. Good understanding of modern data architecture, data modelling and ETL/ELT processes. Experience with Microsoft Fabric, Azure Databricks, Data Factory, Synapse, Power BI or similar. Strong SQL skills and experience building and optimising modern data platforms. Ability to work independently on technical deliverables ...

mentoring experience Technologies & Experience Desired: Git and JIRA software and backlog management tools Power BI, Tableau, Qlik or Looker Matillion, Talend, Pentaho, SSIS Databricks, DBT, Fivetran Snowflake, Microsoft SQL Server, Oracle DB or Redshift Building CI/CD pipelines and IaC Analytical skills including the ability to apply a range ...

workflow orchestration tools (e.g., Apache Airflow, Dagster). Hands-on expertise with cloud data warehouses (e.g., Snowflake, BigQuery, Redshift) and data lake architectures (e.g., Databricks, Delta Lake, Apache Iceberg). Advanced SQL skills and proficiency in Python. Strong background in modern software development practices (testing, code review, CI/ ...

data mining, business intelligence, big data, data governance, data quality, and data cleansing. Experience with Microsoft Azure (a plus): Azure SQL Database, Analysis Services, Databricks, Data Lake, Logic Apps and Data Factory. Understanding of big data technologies (Hadoop, Spark). Able to create rich visualisations that appropriately represent the underlying ...

Monitoring and logging. Release and configuration management. Production support and incident troubleshooting. Python or another scripting language. AWS certification. Terraform. Apache Airflow/MWAA. Databricks or Spark. Kafka/Kinesis. dbt. Experience working in Agile/Scrum environments. Experience 4+ years of experience in Data Engineering, DevOps, DataOps ...

users. Desirable Skills and Experience Experience with Microsoft Purview, data classification, lineage and governance policies. Familiarity with Azure Data Factory, Azure Synapse Analytics, Azure Databricks or other data integration and analytics services. Experience with automation and scripting, Fabric Admin APIs, Azure DevOps, Git or CI/CD processes. Knowledge ...

solutions and operations, enabling ethical, scalable, and domain-driven AI adoption. We partner with industry leaders including Oracle, Salesforce, Microsoft, AWS, Snowflake, and Databricks, delivering outcomes across sectors such as Healthcare, Financial Services, Retail, Manufacturing, Higher Education, and the Public Sector.Guided by our core values of Trust, Value, and Velocity ...

solutions and operations, enabling ethical, scalable, and domain-driven AI adoption. We partner with industry leaders including Oracle, Salesforce, Microsoft, AWS, Snowflake, and Databricks, delivering outcomes across sectors such as Healthcare, Financial Services, Retail, Manufacturing, Higher Education, and the Public Sector.Guided by our core values of Trust, Value, and Velocity ...

data modelling techniques. Experience implementing and supporting CI/CD practices, version control frameworks and collaborative development methodologies, including Git. Proven experience working with Databricks, including data ingestion, transformation and optimisation of large-scale data processing workloads. Understanding of data governance, metadata management and data quality frameworks, including experience with ...

series analysis, forecasting, and data visualization. Experience developing web-based, cloud, and containerized applications using technologies such as Flask, FastAPI, React, Azure, PySpark, or Databricks, with knowledge of DevOps and CI/CD practices. Experience with industrial IoT data, predictive analytics, and/or business-intelligence tools such as Power ...

data domains. SAP, S/4HANA, Fiori or enterprise finance platforms. Data products supporting AI, machine learning or generative AI use cases. Experience with Databricks, Microsoft Fabric, Snowflake or comparable cloud data platforms. Experience operating within Agile product teams. Why join us? At bp, we support our people to grow ...

Technology, and champion data, AI and modern ways of working. Must haves Significant experience building and running a modern data platform on Microsoft Fabric, Databricks, Snowflake or similar, using a medallion architecture, including managing ingestion performance and forecasting platform costs. Strong Python/PySpark and SQL, with a track record ...

building semantic models and reports using tools such as PowerBI. Deep knowledge of at least one cloud data technology (for example Microsoft Fabric, Databricks, Snowflake or a cloud warehouse). A solid grasp of data modelling, ETL/ELT and data governance, including medallion or Lakehouse-style architectures. It would ...

internship, graduate project, bootcamp or personal portfolio involving data, analytics, software development or testing. Exposure to technologies such as Microsoft Fabric, Azure, AWS, GCP, Databricks, Snowflake, Power BI, Tableau, Qlik, Jira, Azure DevOps, version control, CI/CD, containers or Infrastructure as Code would also be beneficial. Skills and behaviours ...

Infrastructure-as-Code (Terraform preferred). Experience with containerisation (Docker) and orchestration platforms (Kubernetes/EKS). Certifications & Tools Exposure to enterprise data platforms (Databricks, Snowflake, BigQuery, or similar). Cloud certifications (AWS, Azure, GCP) are beneficial but not required. Other Requirements Minimum 3 years' experience working on data engineering ...

GitLab Knowledge of: Knowledge of DevOps, automation and modern engineering practices Platform engineering Site Reliability Engineering principles Data & Analytics Experience with technologies such as: Databricks Microsoft Fabric Azure Data Factory Synapse Analytics Snowflake BigQuery Redshift Kafka Apache Spark Knowledge of: Data modelling Data governance Data integration Data migration Data warehousing ...

Data Mining, Business Intelligence, Big Data, Data Governance, Data quality, Data Cleansing Experience with Microsoft Azure a plus: Azure SQL Database, Analysis Services, Databricks, Data Lake, Logic Apps and Data Factory Understanding of Big Data technologies (Hadoop, Spark) Able to create rich visualisations that appropriately represent the underlying datasets. Review ...

frameworks, metadata-driven orchestration, data quality validation, and automated CI/CD pipelines. Responsibilities Designed and implemented scalable data pipelines using Azure Data Factory, Databricks, Delta Lake, Python, and SQL.Architected Lakehouse solutions supporting enterprise analytics, AI/ML, and Generative AI workloads.Developed structured and unstructured data pipelines for RAG, vector ...

modelling and ETL/ELT concepts Experience implementing data validation and testing processes Strong communication and stakeholder engagement skills Desirable Skills Azure Data Factory Databricks Synapse Analytics Microsoft Fabric Azure SQL Data Lake technologies Experience within regulated sectors Cloud-based data platform experience ...