51 to 75 of 1,066 Databricks Jobs

skillsExperience building and maintaining ETL/ELT pipelinesCommercial experience working with Azure or AWS cloud platformsExperience with modern data platforms such as Databricks, Snowflake or RedshiftExperience using orchestration tools such as Airflow, Azure Data Factory or PrefectStrong understanding of data warehousing and data modelling principlesExcellent problem-solving skills with ...

delivery. Experience in a startup or small‐team environment , comfortable wearing multiple hats. Nice‐to‐Have Experience with Power BI , Delta Lake , Synapse , or Databricks . Knowledge of Python or TypeScript for data or automation scripts. Familiarity with CI/CD pipelines , IaC (Terraform, Bicep), and observability stacks. Strong grasp ...

evolution, DevOps maturity, and capability expansion Core Technical Requirements Azure Data Platform Architecture Microsoft Azure data stack expertise: ADF, Delta Lake, ADLS Gen2, Synapse, Databricks (with flexibility to integrate non-Microsoft solutions) Experience with PostgreSQL and SQL Server, including data replication/integration patterns for migration Dimensional and relational data ...

libraries (e.g., pandas, numpy, matplotlib)Exposure to DevOps, DataOps, and MLOps concepts and best practicesExperience with core technologies such as Python, PySpark, SQL, Airflow, Databricks, Kedro, Dask/RAPIDS, Docker, Kubernetes, and cloud services (AWS/GCP/Azure)Experience with Generative AI (GenAI) or agentic systems is a strong ...

MLOps, will be advantageousWhile we advocate using the right tech for the right task, we often leverage: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such as AWS, GCP, and AzureExperience with Generative AI (GenAI ...

APIs and cloud-based data platforms. Not afraid to get hands-on when needed.* Experience working with modern data stacks such as Snowflake, BigQuery, Databricks, Azure.* Experience with visualisation tools such as Power BI, Tableau, Looker Studio or similar.* Ability to translate business requirements into practical data and reporting solutions. ...

prototyping (Streamlit, Flask, Django, Figma). Experience working with geospatial data. Experience delivering within the UK public sector, Defence or National Security. Exposure to Databricks and/or Snowflake. A relevant degree (Computer Science, Data Science, AI/ML or related) or equivalent practical experience. Security Clearance Requirements The successful ...

Technical SkillsData Platforms: Experience in building & scaling data lakes, data warehouses, and associated data systems.Databases: SQL, PostgreSQL; MongoDB and cloud-based platforms (e.g. Snowflake, Databricks, Redshift).Semantic Layer: Design and implementation for governed reusable data views.Data Governance Tools: Collibra, Alation, Talend or equivalent.Expertise in ETL tools and processes (e.g., Apache ...

data architectures (lakehouse, warehouse, data mesh, data fabric).Hands-on experience with one or more cloud data ecosystems:Azure (Data Factory, Synapse, Fabric, ADLS, Databricks)AWS (Glue, Redshift, EMR)GCP (BigQuery, Dataflow)Databricks (Spark/PySpark)Snowflake (SQL, Snowpark, performance tuning)Desirable ExperienceStrong SQL and/or Python capability ...

DescriptionRole –Senior Databricks ArchitectTechnology – Databricks (Spark, PySpark/SQL) and data lake architecturesLocation – London, UKCompensation – Competitive (including bonus)Job DescriptionWe are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data mesh architecture. The role focuses on integrating legacy systems … with cloud-native platforms to support analytics, reporting, and domain-owned data products.Primary Skills• Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures.• Hands-on experience with streaming technologies, especially Kafka/Confluent Kafka.• Experience integrating legacy data sources such as DB2 (mainframe) and SQL Server.• Working ...

Senior Databricks Architect Technology: Databricks (Spark, PySpark/SQL) and data lake architectures. Location: London, UK. Compensation: Competitive (including bonus). Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern data mesh architecture. The role focuses … integrating legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such as DB2 (mainframe ...

Platform Development, or Software Engineering. Strong experience designing enterprise-scale cloud data platforms using Azure, AWS, or Google Cloud. Expertise with technologies such as Databricks, Azure Data Factory, Microsoft Fabric, Snowflake, Airflow, Spark, SQL, and Python. Proven experience building scalable ETL/ELT pipelines and modern data architectures. Between ...

data engineering solutions. We're looking for someone with at least three years' experience in Data Engineering and hands-on experience with Microsoft Fabric, Databricks, Snowflake or similar cloud platforms. You'll have strong Python/PySpark skills, experience integrating with APIs, and a background in Agile development. ...

data engineering solutions. We're looking for someone with at least three years' experience in Data Engineering and hands-on experience with Microsoft Fabric, Databricks, Snowflake or similar cloud platforms. You'll have strong Python/PySpark skills, experience integrating with APIs, and a background in Agile development. ...

/data pipelines Knowledge of data modelling and database design Strong analytical and problem-solving skills Nice to have: Azure (Data Factory, Synapse, Databricks or similar) Power BI Git or Azure DevOps Experience working with cloud-based data platforms Exposure to retail, eCommerce or customer data This ...

demonstrated experience with data profiling, sourcing, and cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching, Good knowledge of Databricks, Snowflake, Azure/AxoWS/Oracle cloud, R, Python. #J-18808-Ljbffr ...

Extensive experience in Enterprise Data Architecture or a similar strategic data leadership role. Strong background designing enterprise-scale cloud data platforms. Experience with Azure, Databricks and modern data architecture principles. Strong understanding of data modelling, governance and data quality frameworks. Experience delivering large-scale data transformation initiatives. Knowledge of technologies ...

Data Engineer or within a similar role. Strong experience with Python or PySpark . Experience with cloud data platforms such as Microsoft Fabric, Databricks or Snowflake . Knowledge of SQL and data transformation techniques. Experience building and maintaining data pipelines. Previous experience working within the construction industry . Excellent analytical ...

PySpark Proven experience designing and developing Fabric data platforms, pipelines and Lakehouse solutions Experience building scalable data solutions within Azure, including Data Factory, Databricks and Data Lake Strong data engineering and cloud architecture expertise, with experience mentoring and upskilling technical teams What's on Offer Day Rate: £500.00 (Inside IR35 ...

solutions. Data Integration: Build and manage data ingestion, transformation, and integration processes. Infrastructure Management: Create and maintain data models, tables, and supporting infrastructure within Databricks and associated data lake/lakehouse environments. Business Logic Development: Implement business logic, calculations, and data processing solutions using Python. Collaboration: Work closely with business ...

various database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and openness to tech stacks such as SSIS, Airflow, Spark, Databricks, Fabric. Cloud Capability: Experience with at least one major cloud provider (AWS, Azure, or Google Cloud) and curiosity to learn others. Bridging Data & AI: Understanding ...

implementing complex data-matching, reconciliation, and entity-resolution solutions across multiple data sources Distributed computing for data intensive work such as Spark and Databricks Cloud platforms including AWS, Azure and GCP Orchestration tools like Airflow Modern DevOps practices including version control, CI/CD, and infrastructure as code using Terraform ...

like) and your tech journey would have started out around there. Strong experience designing and delivering enterprise data lake environments, ideally using AWS, Databricks or similar modern cloud platforms. Azure and GCP backgrounds are acceptable too. Proven background in data engineering, data architecture, integration or large-scale data transformation programmes. ...

management...Good knowledge of CI/CD pipelines and Gitflows best practicesGood knowledge of Power BI/MDX/DAXGood knowledge in Python, PysparkExperience with Databricks and/or Palantir Foundry is a strong plusKnowledge of REST API development is a plusBehavioral & Management Skills :Strong analytical thinking, rigorous mindset solution-oriented ...

Technical Skills Expertise in data modeling tools and techniques (e.g., ER/Studio, Erwin). Strong SQL and database proficiency (SQL Server, Oracle, Snowflake, Databricks). Experience with data integration (ETL/ELT, APIs). Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka ...