501 to 525 of 1,495 Databricks Jobs

requirements. Technical Expertise Strong experience in designing large-scale data and analytics platforms Expertise in cloud architectures (preferably Azure, incl. Azure Data Factory, Synapse, Databricks, Fabric, etc.) Experience with big data technologies (Spark, Hadoop, distributed systems) Proficiency in data modelling, especially time-series and simulation datasets Knowledge of APIs, microservices ...

strategies, or job efficiency, and treat compute as a resource to manage, not ignore Platform fluency: worked across orchestration (Airflow, Dagster), warehouses (Snowflake, BigQuery, Databricks), ingestion (Fivetran, Airbyte, custom), and transformation (dbt, Spark) AI Native: experienced in agentic coding workflows (context, harness, loop, and graph engineering), and able to embed ...

market impact modelling, signal generation, back-testing, and trading performance analytics. Strong understanding of cloud-native data platforms and hybrid architectures, including Azure, AWS, Databricks, Snowflake, and modern real-time analytics platforms. Experience working directly with traders, execution teams, quantitative analysts, market risk teams, engineering teams, and market data vendors. ...

following areas: Platform engineering: building reusable software foundations, internal developer platforms, and infrastructure that other teams build on Data Engineering: including platforms like Databricks for data processing and analytics Delivering production agentic systems, including RAG pipelines, vector search, and agentic frameworks such as LangChain, LlamaIndex, CrewAI, AutoGen, and n8n DevSecOps ...

infrastructure (Kafka or similar), and can talk about what broke as readily as what worked. Strong SQL, Python and warehouse fundamentals , with Snowflake or Databricks experience including query performance tuning and cost optimisation. Track record of engineering standards in dbt — testing, CI/CD, documentation and PR review workflows that ...

GIS Recruiter Ltd is seeking an experienced Data Engineer to support a data migration and integration programme within a developing Azure environment. The role focuses on designing and building robust data pipelines, migrating data from ...

Microsoft Azure ecosystem. You will develop scalable data pipelines, transform complex datasets, and help organisations unlock the value of their data through Microsoft Fabric, Databricks and Azure services. Working within a collaborative engineering team, you will contribute to cloud‐native data solutions, ensuring performance, scalability and best practices across enterprise … data platforms. Responsibilities Design, develop and maintain scalable data pipelines using Microsoft Fabric, Azure Databricks and Azure Synapse. Develop ETL/ELT solutions using PySpark and SQL. Build and optimise data integration solutions using Azure Data Factory and Microsoft Fabric. Design scalable lakehouse and data warehouse solutions. Optimise data performance ...

join our Data & Business Intelligence team and help develop, maintain and optimise our cloud-based data platform. Working within a modern Azure and Databricks environment, you'll design and maintain scalable data pipelines, transform and model data, and ensure our data architecture provides a reliable foundation for business intelligence, reporting … understand data requirements and deliver effective solutions. Ensure data quality, accuracy and consistency through validation and monitoring processes. Design and maintain data models within Databricks and Azure SQL environments. Transform and prepare data for reporting, analytics and business intelligence. Support Power BI reporting and dashboard solutions alongside the BI team. ...

Canopius is looking for a Data Architect in Greater London to drive the end-to-end design of their enterprise data architecture. You will work closely with cross-departmental teams to ensure effective data management ...

data, analytics, and AI platforms that support Research business capabilities globally. From Belfast, this role will help build the strategic Research data platform leveraging Databricks, enabling reusable data products, modern analytics, and future AI solutions across the organization. Role Description We are seeking a Senior Data Engineer to help build … will serve as a strategic data and AI enabler for the Research business. Design, develop, and maintain scalable data pipelines using Python, SQL, Spark, Databricks, Azure, and related cloud data technologies. Create curated, reusable, and governed data products that can be consumed by Research applications, dashboards, reporting tools ...

engineering solutions, ensuring alignment with business priorities and best practice Implementing robust ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines and Azure Databricks (PySpark/Spark SQL) to support batch and streaming data processing Designing and delivering real-time and batch data ingestion solutions using Azure Event Hubs … Kafka, Databricks Structured Streaming and Azure Stream Analytics Developing and maintaining modern data platforms, including Delta Lake/Lakehouse architectures on ADLS Gen2, curated datasets, dimensional models and Azure Synapse Dedicated SQL Pools Analysing current business practices, processes and procedures, identifying opportunities to leverage Microsoft Azure Data & Analytics Services ...

hands-on design experience with cloud-based services for modern analytics on the Microsoft Cloud (e.g. e.g. Azure Data Lake, Azure Data Factory, Azure Databricks & Unity Catalog, MS Purview, PowerBI, Ms Fabric) Deep expertise in data architecture, including data modelling (conceptual and logical), Master and Reference Data Management, data quality … role design, systems integration, and evaluation of architectures. Broader expertise of technologies and applications relevant to the Bank’s enterprise applications (e.g. Cloud, Azure, Databricks), and enterprise data and analytics ecosystems, including medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise ...

hands-on design experience with cloud-based services for modern analytics on the Microsoft Cloud (e.g. e.g. Azure Data Lake, Azure Data Factory, Azure Databricks & Unity Catalog, MS Purview, PowerBI, Ms Fabric) Deep expertise in data architecture, including data modelling (conceptual and logical), Master and Reference Data Management, data quality … role design, systems integration, and evaluation of architectures. Broader expertise of technologies and applications relevant to the Bank’s enterprise applications (e.g. Cloud, Azure, Databricks), and enterprise data and analytics ecosystems, including medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise ...

We work with some of the UK’s biggest companies and government departments to provide a pragmatic approach to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to ...

We work with some of the UK’s biggest companies and government departments to provide a pragmatic approach to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to ...

Our Data Engineering roles require the eligibility for SC clearance, please check the GOV.UK website for the requirements before you apply. We work with some of the UK's biggest companies and government departments to ...

We work with some of the UK’s biggest companies and government departments to provide a pragmatic approach to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to ...

We work with some of the UK’s biggest companies and government departments to provide a pragmatic approach to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to ...

Title: Business Intelligence Developer Location: Doncaster (Hybrid 1-2 days a week) Salary: Up to £50k DOE Contract: 6-month FTC Industry: Construction The Opportunity I'm currently working with a leading construction organisation that ...

quality, or analytics transformation programs Strong technical skills in data profiling, analysis, and data management using modern tools and environments (Python, R, SQL, Spark, DataBricks, cloud platforms) Understanding of data lineage concepts and experience with lineage analysis, metadata management, and data cataloguing Excellent communication skills with the ability to convey ...

forefront of data analytics and AI. This role offers the chance to take a key role in the design and delivery of advanced Databricks solutions within the Azure ecosystem. Responsibilities Design, build, and optimise end-to-end data pipelines using Azure Databricks, including Delta Live Tables. Collaborate with stakeholders … define technical requirements and propose Databricks-based solutions. Drive best practices for data engineering. Help clients realise the potential of data science, machine learning, and scaled data processing within Azure/Databricks ecosystem. Mentor junior engineers and support their personal development. Take ownership for the delivery of core solution components. ...

Senior Data Engineer (Azure | Databricks | Fabric | PySpark | SQL) Permanent | Hybrid | UK Public Sector Project Overview We are seeking a hands-on Senior Data Engineer to join a growing Data & Analytics practice. This role focuses on designing, building, optimising, and maintaining enterprise-level data solutions. You will work across the full … data lifecycle, delivering scalable, high-performance solutions using Azure and tools such as Databricks and Fabric. Who We’re Looking For A strong Data Engineer with deep technical expertise in Azure, Databricks and Fabric, who enjoys working in a collaborative, client-facing environment and thrives at designing and delivering enterprise ...

About Unifeye Unifeye is a delivery-led, Databricks first consultancy helping organisations unlock the full value of their data and AI. We're a lean, high growth team based in London, working at the intersection of data, technology and business strategy. We partner with enterprise organisations across industries to solve … looking for experienced Data Engineers to join our growing delivery team and help design, build and deliver modern data platforms on the Databricks Lakehouse Platform. You'll work across multiple enterprise engagements, helping customers build scalable, secure and governed data solutions while collaborating closely with architects, AI specialists and client ...

join the Group Data & AI Office. The role focuses on hands-on data engineering, designing and building scalable data pipelines and data products using Databricks, PySpark and Python. You will collaborate with engineering teams, contribute to governance and standards, and mentor colleagues while delivering high-quality data solutions across ...

PySpark to build data products, collaborate across Product, Analytics, Security and Software, and help optimize ETL pipelines in a Lakehouse architecture using Databricks and Delta Lake. #J-18808-Ljbffr ...