1 to 25 of 102 Databricks Jobs in the South East

Databricks Architect (Contract) - Greenfield Data Platform Location: Hybrid working (London) Duration: 12-month initial contract Are you a visionary Databricks Architect with a passion for building cutting-edge data platforms from the ground up? Do you thrive on shaping strategy and driving technical excellence in a greenfield environment? Our client is embarking on a pivotal journey to establish a brand … future data-driven initiatives, from advanced analytics to AI/ML. We are looking for a hands-on architect who can translate business needs into robust, scalable, and secure Databricks solutions. The Role: As our Databricks Architect, you will be instrumental in defining and delivering our new data strategy and architecture. This is a greenfield project, meaning you'll have … the exciting challenge of building the entire Databricks Lakehouse Platform from scratch. You will provide critical technical leadership, guidance, and hands-on expertise to ensure the successful establishment of a scalable, high-performance, and future-proof data environment. Phase 1: Strategic Vision & Blueprint Data Strategy & Roadmap: Collaborate with business stakeholders and leadership to define the overarching data vision, strategy, and More ❯

Job Summary: We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing … Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark … or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure Databricks Implementation: Work extensively with Azure Databricks Unity Catalog, including Delta Lake, Spark SQL, and other relevant services. Implement best practices for Databricks development and deployment. Optimise Databricks workloads for performance and More ❯

and collaborate with others passionate about solving business problems. Key responsibilities: Data Platform Design and Architecture Design, develop, and maintain a high-performing, secure, and scalable data platform, leveraging Databricks Corporate Lakehouse and Medallion Architectures. Utilise our metadata-driven data platform framework combined with advanced cluster management techniques to create and optimise scalable, robust, and efficient data solutions. Implement comprehensive … multiple organisational SQL databases and SaaS applications using end-to-end dependency-based data pipelines, to establish an enterprise source of truth. Create ETL and ELT processes using Azure Databricks, ensuring audit-ready financial data pipelines and secure data exchange with Databricks Delta Sharing and SQL Warehouse endpoints. Governance and Compliance Ensure compliance with information security standards in our highly … regulated financial landscape by implementing Databricks Unity Catalog for governance, data quality monitoring, and ADLS Gen2 encryption for audit compliance. Development and Process Improvement Evaluate requirements, create technical design documentation, and work within Agile methodologies to deploy and optimise data workflows, adhering to data platform policies and standards. Collaboration and Knowledge Sharing Collaborate with stakeholders to develop data solutions, maintain More ❯

data-heavy systems, ideally in a startup or fast-moving environment. Technical Stack : Languages/Tools: Python (REST API integrations), DBT, Airbyte, GitHub Actions Modern Data Warehousing: Snowflake, Redshift, Databricks, or BigQuery. Cloud & Infra: AWS (ECS, S3, Step Functions), Docker (Kubernetes or Fargate a bonus) Data Modelling : Strong grasp of transforming structured/unstructured data into usable models (facts, dimensions More ❯

CloudXcel is a technology-driven company dedicated to providing innovative cloud solutions to businesses worldwide. Our mission is to empower organizations to harness the full potential of their data in the cloud, unlocking insights and driving transformation. With a commitment More ❯

performance data pipelines (ETL/ELT) to ingest, transform, and deliver data from diverse sources. Required Skills & Experience: Deep expertise in building and deploying data solutions using platforms like Databricks (Azure/AWS) , Microsoft Fabric , Azure Data Factory , and Azure Synapse . Solid experience with the Microsoft data stack —including SSIS , SSAS , and SSRS . A strong foundation in data More ❯

analytics user experience, unlocking growth and operational excellence. What are we looking for? Hands-on experience designing scalable, greenfield data platforms in cloud environments using Azure D&A stack, Databricks, and Azure Open AI. Proficiency in coding (Python, PL/SQL, Shell Script), relational and non-relational databases, ETL tools (e.g., Informatica), and scalable data platforms. Knowledge of Azure Data More ❯

excellence and continuous learning. What you'll bring to the team: Proven experience as a Principal Data Engineer or Data Architect in a hands-on role; Deep expertise in Databricks and experience with cloud data platforms such as Snowflake, AWS or Azure; Strong proficiency in data modeling, data warehousing, and ETL/ELT architecture at scale; Advanced programming skills in More ❯

Senior Databricks Data Engineer | Energy Trading - Contract My client is an Energy Trading Client based in the UK who are looking to appoint a Senior Databricks Data Engineer to help modernise their data infrastructure and deliver end-to-end solutions that drive business value. This is a high-impact role working across data strategy, architecture, and engineering to deliver cloud … AWS, Azure or SAP ETL/ELT Development Data Modeling Data Integration & Ingestion Data Manipulation & Processing Version Control & DevOps: Skilled in GitHub, GitHub Actions, Azure DevOps Azure Data Factory, Databricks, SQL DB, Synapse, Stream Analytics Glue, Airflow, Kinesis, Redshift SonarQube, PyTest If you're ready to take on a new challenge and shape data engineering in a trading-first environment More ❯

meetings, driving improvements in current processes and practices. What do I need? Education & Certifications: Degree in a relevant field (e.g., Computer Science, Data Science) and industry credentials (e.g., Microsoft, Databricks). Technical Skills: Proficient with Azure, Databricks, PowerBI, AWS, Google Cloud, and data management services. Operational Experience: Skilled in engineering, agile, and devops environments; familiar with Git, Jira, and GDPR More ❯

and business discussions. Desirable Qualifications and Experience Degree (BSc, MSc, or PhD) in Computer Science, Mathematics, or a related field. Familiarity with alternative cloud and data platforms such as Databricks, Snowflake, Azure, or AWS. Knowledge of DevOps/DataOps methodologies and experience with CI/CD pipelines. Understanding of monitoring, logging, and troubleshooting in cloud-based environments. Google Cloud Professional More ❯

with structured and unstructured data sources. Knowledge of cloud computing platforms (AWS, Azure) and data security measures, including compliance with data governance standards and big data technologies. Experience with Databricks and Mosaic AI is plus. By enabling flexibility in how we work and prioritizing employee wellness, we empower our team to do and be their best. RLDatix is an equal More ❯

Security and Compliance teams to ensure adherence to data privacy regulations (e.g., GDPR) and internal governance standards. Lead evaluation and integration of data tools, platforms, and technologies (e.g., Snowflake, Databricks, Azure Synapse, Kafka, dbt, Power BI). Oversee data integration strategy across the enterprise-including ETL/ELT pipelines, APIs, and event-driven data streaming. Contribute to the development of More ❯

Agile methodologies, Infrastructure-as-Code (IaC) and delivering data platform projects in iterative cycles. Non-Microsoft Data Tools – Exposure to or hands-on experience with tools such as Snowflake, Databricks or AWS Redshift Cross-Platform Reporting Tools – Knowledge of BI tools beyond Power BI, such as Tableau or Qlik, for comparative understanding or hybrid deployments. KEY COMPETENCIES REQUIRED FOR ROLE More ❯

Looking For: Strong skills in SQL and Power BI. Python is beneficial Solid experience with data modelling and ETL pipelines Knowledge of cloud environments – Azure Experience with Snowflake and Databricks Familiarity with data governance in decentralised environments Excellent communication and stakeholder engagement skills A proactive, problem-solving approach Interested? Apply with your latest CV to find out more. More ❯

Data Engineer (Databricks & Azure) - Clean Energy Location: South East England (Hybrid - 1 day onsite per week) Salary: £60k - £70k + benefits package 18 months. That’s all the time it took for the client’s Databricks platform to evolve into a key driver of innovative green technologies. Now, they’re looking for someone to take it even further. Imagine joining … the Role? You’ll join a highly skilled data team, part of a broader department focused on modelling and digitalisation. This team develops and maintains a cutting-edge Azure Databricks Data Lakehouse platform to support all core business functions. Your primary goal will be building and maintaining robust, secure data pipelines and models that deliver trusted datasets to internal and … external stakeholders, enabling data-driven decisions across the organisation. As a Data Engineer, you will maintain, monitor, and enhance the Databricks platform that powers the client’s data services. You’ll work on building robust pipelines using Azure Data Lake and Python while collaborating closely with data scientists, simulation engineers, and the wider business. Reporting to the Head of Data More ❯

a skilled and motivated Lead Data Engineer with Insurance experience to play a key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . … a Lead Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built to scale, incorporating the latest advancements in data intelligence while supporting strategic business objectives. Key Responsibilities Build & Develop – Design and maintain a robust Databricks … solutions. Futureproofing – Drive the evolution of the data platform, ensuring adaptability for new data sources, analytical models, and emerging technologies. What You’ll Bring ✅ Extensive hands-on experience with Databricks , and Microsoft Azure data tools (must-have: Azure Data Factory, Azure Synapse, or Azure SQL). ✅ Dimensional modelling expertise for analytics use cases. ✅ Strong ETL/ELT development skills. ✅ Python More ❯

Exposure across all the SDLC process, including testing and deployment. Expertise in Microsoft Azure is mandatory including components like Azure Data Factory, Azure Data Lake Storage, Azure SQL, Azure DataBricks, HD Insights, ML Service etc. Good knowledge of Python and Spark are required. Experience in ETL & ELT Good understanding of one scripting language Good understanding of how to enable analytics … a diverse and challenging set of customers to success. Good understanding of the CPG (Consumer Packaged Goods) domain is preferred. Skills: Data Ops, ML Ops, Deep expertise in Azure Databricks , ETL frameworks. Expertise in Microsoft Azure is mandatory including components like Azure Data Factory, Azure Data Lake Storage, Azure SQL, Azure DataBricks, HD Insights, ML Service etc. Fractal provides equal More ❯

hybrid role based in the London area. As Data Analyst , you will be responsible for delivering data-driven insights across a wide range of datasets. Using tools such as Databricks, Tableau, Looker Studio, Amplitude, and DBT, you will extract, transform, and analyse data to support key business functions. You will collaborate closely with stakeholders to understand their data needs, generate … with forecasting, target setting, and promotional analysis. Data Governance & Optimisation Conduct QA checks for data accuracy. Improve data architecture and integrate new data sources. Apply advanced analytics using SQL, Databricks, and other tools. What are we looking for? 2+ years’ experience in a similar role. Strong analytical mindset with a passion for uncovering insights. Skilled in SQL and data visualisation More ❯

and version management of large numbers of data science models (Azure DevOps). You'll support the implementation of Machine Learning Ops on cloud (Azure & Azure ML. Experience with Databricks is advantageous.) You'll protect against model degradation and operational performance issues through the development and continual automated monitoring of model execution and model quality. You'll manage automatic model … and integration Basic understanding of networking concepts within Azure Familiarity with Docker and Kubernetes is advantageous Experience within financial/insurance services industry is advantageous Experience with AzureML and Databricks is advantageous Skills & Qualifications Strong understanding of Microsoft Azure, (Azure ML, Azure Stream Analytics, Cognitive services, Event Hubs, Synapse, and Data Factory) Fluency in common data science coding capabilities such More ❯

supporting automated workflows in Alteryx Designer. Experience deploying workflows to the Production Gallery. Knowledge of database fundamentals, data design, SQL, and data warehouse concepts is beneficial. Exposure to PowerBI, Databricks, Azure, and Profisee is advantageous. Knowledge of Json, Python, XML, and R is a plus. Experience with non-relational and unstructured data is beneficial. Familiarity with Azure DevOps or GitHub More ❯

and supporting automated workflows in Alteryx Designer. Experience deploying workflows to the Production Gallery. Knowledge of database fundamentals, including data design, SQL, and data warehouse concepts. Exposure to PowerBI, Databricks, Microsoft Azure, and Profisee is advantageous. Knowledge of Json, Python, XML, and R is beneficial. Experience with non-relational and unstructured data is a plus. Familiarity with Azure DevOps/ More ❯

and AI-102 - DESIRABLE Years of Experience 5+ years working with production data workloads in Azure - ESSENTIAL Other Requirements Proficiency in Azure data services (Azure Data Factory, Azure Databricks, Azure Synapse Analytics, etc.) - ESSENTIAL Experience with AI development using Azure Machine Learning - ESSENTIAL Strong programming skills in languages such as Python, SQL, or C# - ESSENTIAL CORE COMEPTENCIES & SKILLS: Expertise in More ❯

and AI-102 - DESIRABLE Years of Experience 5+ years working with production data workloads in Azure - ESSENTIAL Other Requirements Proficiency in Azure data services (Azure Data Factory, Azure Databricks, Azure Synapse Analytics, etc.) - ESSENTIAL Experience with AI development using Azure Machine Learning - ESSENTIAL Strong programming skills in languages such as Python, SQL, or C# - ESSENTIAL CORE COMEPTENCIES & SKILLS: Expertise in More ❯

and AI-102 - DESIRABLE Years of Experience 5+ years working with production data workloads in Azure - ESSENTIAL Other Requirements Proficiency in Azure data services (Azure Data Factory, Azure Databricks, Azure Synapse Analytics, etc.) - ESSENTIAL Experience with AI development using Azure Machine Learning - ESSENTIAL Strong programming skills in languages such as Python, SQL, or C# - ESSENTIAL CORE COMEPTENCIES & SKILLS: Expertise in More ❯