51 to 75 of 978 Permanent Databricks Jobs

MLOps, will be advantageousWhile we advocate using the right tech for the right task, we often leverage: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such as AWS, GCP, and AzureExperience with Generative AI (GenAI ...

APIs and cloud-based data platforms. Not afraid to get hands-on when needed.* Experience working with modern data stacks such as Snowflake, BigQuery, Databricks, Azure.* Experience with visualisation tools such as Power BI, Tableau, Looker Studio or similar.* Ability to translate business requirements into practical data and reporting solutions. ...

prototyping (Streamlit, Flask, Django, Figma). Experience working with geospatial data. Experience delivering within the UK public sector, Defence or National Security. Exposure to Databricks and/or Snowflake. A relevant degree (Computer Science, Data Science, AI/ML or related) or equivalent practical experience. Security Clearance Requirements The successful ...

Technical SkillsData Platforms: Experience in building & scaling data lakes, data warehouses, and associated data systems.Databases: SQL, PostgreSQL; MongoDB and cloud-based platforms (e.g. Snowflake, Databricks, Redshift).Semantic Layer: Design and implementation for governed reusable data views.Data Governance Tools: Collibra, Alation, Talend or equivalent.Expertise in ETL tools and processes (e.g., Apache ...

data architectures (lakehouse, warehouse, data mesh, data fabric).Hands-on experience with one or more cloud data ecosystems:Azure (Data Factory, Synapse, Fabric, ADLS, Databricks)AWS (Glue, Redshift, EMR)GCP (BigQuery, Dataflow)Databricks (Spark/PySpark)Snowflake (SQL, Snowpark, performance tuning)Desirable ExperienceStrong SQL and/or Python capability ...

DescriptionRole –Senior Databricks ArchitectTechnology – Databricks (Spark, PySpark/SQL) and data lake architecturesLocation – London, UKCompensation – Competitive (including bonus)Job DescriptionWe are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data mesh architecture. The role focuses on integrating legacy systems … with cloud-native platforms to support analytics, reporting, and domain-owned data products.Primary Skills• Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures.• Hands-on experience with streaming technologies, especially Kafka/Confluent Kafka.• Experience integrating legacy data sources such as DB2 (mainframe) and SQL Server.• Working ...

Senior Databricks Architect Technology: Databricks (Spark, PySpark/SQL) and data lake architectures. Location: London, UK. Compensation: Competitive (including bonus). Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data mesh architecture. The role focuses … integrating legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such as DB2 (mainframe ...

Platform Development, or Software Engineering. Strong experience designing enterprise-scale cloud data platforms using Azure, AWS, or Google Cloud. Expertise with technologies such as Databricks, Azure Data Factory, Microsoft Fabric, Snowflake, Airflow, Spark, SQL, and Python. Proven experience building scalable ETL/ELT pipelines and modern data architectures. Between ...

data engineering solutions. We're looking for someone with at least three years' experience in Data Engineering and hands-on experience with Microsoft Fabric, Databricks, Snowflake or similar cloud platforms. You'll have strong Python/PySpark skills, experience integrating with APIs, and a background in Agile development. ...

data engineering solutions. We're looking for someone with at least three years' experience in Data Engineering and hands-on experience with Microsoft Fabric, Databricks, Snowflake or similar cloud platforms. You'll have strong Python/PySpark skills, experience integrating with APIs, and a background in Agile development. ...

/data pipelines Knowledge of data modelling and database design Strong analytical and problem-solving skills Nice to have: Azure (Data Factory, Synapse, Databricks or similar) Power BI Git or Azure DevOps Experience working with cloud-based data platforms Exposure to retail, eCommerce or customer data This ...

demonstrated experience with data profiling, sourcing, and cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching, Good knowledge of Databricks, Snowflake, Azure/AxoWS/Oracle cloud, R, Python. #J-18808-Ljbffr ...

Extensive experience in Enterprise Data Architecture or a similar strategic data leadership role. Strong background designing enterprise-scale cloud data platforms. Experience with Azure, Databricks and modern data architecture principles. Strong understanding of data modelling, governance and data quality frameworks. Experience delivering large-scale data transformation initiatives. Knowledge of technologies ...

Data Engineer or within a similar role. Strong experience with Python or PySpark . Experience with cloud data platforms such as Microsoft Fabric, Databricks or Snowflake . Knowledge of SQL and data transformation techniques. Experience building and maintaining data pipelines. Previous experience working within the construction industry . Excellent analytical ...

various database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and openness to tech stacks such as SSIS, Airflow, Spark, Databricks, Fabric. Cloud Capability: Experience with at least one major cloud provider (AWS, Azure, or Google Cloud) and curiosity to learn others. Bridging Data & AI: Understanding ...

implementing complex data-matching, reconciliation, and entity-resolution solutions across multiple data sources Distributed computing for data intensive work such as Spark and Databricks Cloud platforms including AWS, Azure and GCP Orchestration tools like Airflow Modern DevOps practices including version control, CI/CD, and infrastructure as code using Terraform ...

management...Good knowledge of CI/CD pipelines and Gitflows best practicesGood knowledge of Power BI/MDX/DAXGood knowledge in Python, PysparkExperience with Databricks and/or Palantir Foundry is a strong plusKnowledge of REST API development is a plusBehavioral & Management Skills :Strong analytical thinking, rigorous mindset solution-oriented ...

Technical Skills Expertise in data modeling tools and techniques (e.g., ER/Studio, Erwin). Strong SQL and database proficiency (SQL Server, Oracle, Snowflake, Databricks). Experience with data integration (ETL/ELT, APIs). Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka ...

environments.Bonus Points ForExpertise in data modelling, schema design, and working with structured and semi-structured datasets.Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation.Knowledge of automating cloud-based ingestion and transformation frameworks.Experience delivering data engineering solutions within highly regulated industries such as financial services.Passion ...

proactive, self-directed mindset with strong problem-solving skillsDesirable:Experience within the airline or travel industryExposure to AI/ML solutions and productionisationExperience with Databricks, Snowflake or modern lakehouse platformsInfrastructure-as-code and serverless pipeline experienceData lake migration and solution architecture experienceWHAT YOU’LL GET IN RETURNUp to 20% maximum ...

Enterprise Business Intelligence platform e.g. PowerBI, Qlik Sense, Tableau or similar. - Hands-on familiarity with scalable cloud-based data science platforms such as AWS, Databricks and Microsoft Azure. - Basic understanding of data ingestion APIs, data flows, analytics tech stack and data platform architecture. - Nice to have: programming skills in Python ...

Enterprise Business Intelligence platform e.g. PowerBI, Qlik Sense, Tableau or similar. • Hands-on familiarity with scalable cloud-based data science platforms such as AWS, Databricks and Microsoft Azure.• Basic understanding of data ingestion APIs, data flows, analytics tech stack and data platform architecture.• Nice to have: programming skills in Python ...

Enterprise Business Intelligence platform e.g. PowerBI, Qlik Sense, Tableau or similar. • Hands-on familiarity with scalable cloud-based data science platforms such as AWS, Databricks and Microsoft Azure.• Basic understanding of data ingestion APIs, data flows, analytics tech stack and data platform architecture.• Nice to have: programming skills in Python ...

financial reporting.Technical Skills:Expertise in data modeling tools and techniques (e.g., ER/Studio, Erwin).Strong SQL and database proficiency (SQL Server, Oracle, Snowflake, Databricks).Experience with data integration (ETL/ELT, APIs).Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) a plus.Domain Knowledge ...

matters as much as the building). Experience with Retrieval-Augmented Generation, and with vector or graph databases. Familiarity with a modern data stack: Databricks, dbt, DLT, Unity Catalog or similar. This is a direction of travel for us, not a settled decision, so exposure is welcome but not required. ...