776 to 800 of 1,595 Databricks Jobs in England

deploying and managing machine learning models in production environments , knowledge of advanced techniques such as gradient boosting and large-scale text embedding models , and familiarity with tools such as Databricks, Git, CI/CD pipelines, and software testing methodologies are also preferred qualifications. If you are ready to join a dynamic and innovative team, apply now and take the next … KEYWORDS: Python/Data pipelines/Data enrichment/PySpark/Pandas/Machine learning/AI/ML/Model deployment/Data cleaning/Data ingestion/Databricks/Git/CI/CD pipelines/API development/Gradient boosting/Text embedding models/Production ML/Software engineering/Data processing/Analytical models/…/Python/Data pipelines/Data enrichment/PySpark/Pandas/Machine learning/AI/ML/Model deployment/Data cleaning/Data ingestion/Databricks/Git/CI/CD pipelines/API development/Gradient boosting/Text embedding models/Production ML/Software engineering/Data processing/Analytical models/ More ❯

effective data management and analytics across the organisation. The ideal candidate will have strong expertise in data architecture, data modelling, and data governance, with hands-on experience in Azure Databricks and Unity Catalog for metadata management and scalable data & analytics. Key responsibilities Define and enforce enterprise data architecture principles, policies, and standards in collaboration with the Head of Data. Develop … and maintain current (as-is) and future (to-be) data architecture blueprints, ensuring alignment with business needs. Design and document conceptual, logical, and physical data models, optimizing for Azure Databricks Lakehouse implementation and Unity Catalog integration. Implement and manage data cataloguing and metadata governance using Unity Catalog to contextualise data and ensure data discoverability, lineage, and compliance. Support Head of … Data to define data access, security, and sharing policies for the enterprise and work with the engineering team to implement policies within Azure Databricks environments. Work closely with business stakeholders, IT, and external partners to capture data requirements and translate them into scalable architectural solutions. Ensure data architecture supports regulatory compliance, security, and data quality requirements. Support Head of Data More ❯

Senior Data Architect - Azure/Databricks/Python Location: London (2 days per week in-office) Salary: £100,000 Type: Permanent Join a global leader in legal market intelligence as they embark on a major data transformation journey. Our client is internationally recognised for their deep-dive publications, trusted globally in the same way the Michelin Guide is for restaurants. … team to define the platform's technical direction Deliver architectural outputs and solutions aligned with governance, compliance, and performance best practices Work with both structured and unstructured datasets, leveraging Databricks and Azure Data Factory Provide thought leadership across data strategy, tooling, and modelling Tech Environment Azure Cloud Services (Data Factory, Databricks, Azure SQL, CosmosDB, Synapse) SQL Server (on-prem and More ❯

including testing and delivery in an agile environment. Excellent knowledge of SQL. Experience of data warehousing and data lake solutions. Good knowledge of ETL processes and tools. Knowledge of databricks an advantage. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In this lead role you will use your technical … including testing and delivery in an agile environment. Excellent knowledge of SQL. Experience of data warehousing and data lake solutions. Good knowledge of ETL processes and tools. Knowledge of databricks an advantage. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In this lead role you will use your technical … If you have the required skills and experience please send your CV for a full brief. Desired Skills and Experience Lead Data Engineer Hands-on ETL SQL Data Warehousing Databricks Seniority level Seniority level Mid-Senior level Employment type Employment type Full-time Job function Job function Information Technology Industries Utilities Referrals increase your chances of interviewing at FDO CONSULTING More ❯

Senior Data Architect – Azure/Databricks/Python Location: London (2 days per week in-office) Salary: Up to £100,000 Join a global leader in legal market intelligence as they embark on a major data transformation journey. Our client is internationally recognised for their deep-dive publications, trusted globally in the same way the Michelin Guide is for restaurants. … team to define the platform’s technical direction Deliver architectural outputs and solutions aligned with governance, compliance, and performance best practices Work with both structured and unstructured datasets, leveraging Databricks and Azure Data Factory Provide thought leadership across data strategy, tooling, and modelling Tech Environment Azure Cloud Services (Data Factory, Databricks, Azure SQL, CosmosDB, Synapse) SQL Server (on-prem and More ❯

Senior Data Architect – Azure/Databricks/Python Location: London (2 days per week in-office) Salary: Up to £100,000 Join a global leader in legal market intelligence as they embark on a major data transformation journey. Our client is internationally recognised for their deep-dive publications, trusted globally in the same way the Michelin Guide is for restaurants. … team to define the platform’s technical direction Deliver architectural outputs and solutions aligned with governance, compliance, and performance best practices Work with both structured and unstructured datasets, leveraging Databricks and Azure Data Factory Provide thought leadership across data strategy, tooling, and modelling Tech Environment Azure Cloud Services (Data Factory, Databricks, Azure SQL, CosmosDB, Synapse) SQL Server (on-prem and More ❯

currently 2 engineers + external partners) across complex data and cloud engineering projects Designing and delivering distributed solutions on an AWS-centric stack, with open-source flexibility Working with Databricks, Apache Iceberg, and Kubernetes in a cloud-agnostic environment Guiding architecture and implementation of large-scale data pipelines for structured and unstructured data Steering direction on software stack, best practices … deployments (especially AWS), and orchestration technologies Proven delivery of big data solutions-not necessarily at FAANG scale, but managing high-volume, complex data (structured/unstructured) Experience working with Databricks, Apache Iceberg, or similar modern data platforms Experience of building software environments from the ground up, setting best practice and standards Experience leading and mentoring teams Worked in a startup … that is adaptable Tech Stack Snapshot Languages: Python and data engineering background. Opportunity to shape wider tech stack moving forward. Cloud: AWS preferred, cloud-agnostic approach encouraged Data: SQL, Databricks, Iceberg, Kubernetes, large-scale data pipelines CI/CD & Ops: Open source tools, modern DevOps principles Why Join Us? Impactful Work - Help solve security problems that truly matter Ownership & Autonomy More ❯

Design, build, and maintain scalable data pipelines using PySpark 3/4 and Python 3. * Contribute to the creation of a unified data lake following medallion architecture principles. * Leverage Databricks and Delta Lake (Parquet format) for efficient, reliable data processing. * Apply BDD testing practices using Python Behave and ensure code quality with Python Coverage. * Collaborate with cross-functional teams and … workflows using YAML, Git, and Azure DevOps. Required Skills & Experience: * Proven expertise in PySpark 3/4 and Python 3 for large-scale data engineering. * Hands-on experience with Databricks, Delta Lake, and medallion architecture. * Familiarity with Python Behave for Behaviour Driven Development. * Strong understanding of YAML, code quality tools (e.g. Python Coverage), and CI/CD pipelines. * Knowledge of More ❯

Design, build, and maintain scalable data pipelines using PySpark 3/4 and Python 3. * Contribute to the creation of a unified data lake following medallion architecture principles. * Leverage Databricks and Delta Lake (Parquet format) for efficient, reliable data processing. * Apply BDD testing practices using Python Behave and ensure code quality with Python Coverage. * Collaborate with cross-functional teams and … workflows using YAML, Git, and Azure DevOps. Required Skills & Experience: * Proven expertise in PySpark 3/4 and Python 3 for large-scale data engineering. * Hands-on experience with Databricks, Delta Lake, and medallion architecture. * Familiarity with Python Behave for Behaviour Driven Development. * Strong understanding of YAML, code quality tools (e.g. Python Coverage), and CI/CD pipelines. * Knowledge of More ❯

and delivery of a secure, scalable data platform using Azure services. * Collaborate with internal teams and external partners to meet critical delivery milestones. * Build robust data pipelines using ADF, Databricks, and Synapse. * Work in an agile delivery environment with regular integration and testing. * Attend one in-person workshop per month in London. Required Skills & Experience: * Strong hands-on experience with … Azure Data Factory , Databricks , and Synapse . * Proven track record of delivering secure, performant data engineering solutions. * Ability to work independently and collaboratively in a remote-first setup. * Active SC and NPPV3 clearance . * Excellent problem-solving and stakeholder communication skills. Contract Details: * Start Date: Within 2 weeks * Rate: up to £475/day * IR35: Outside IR35 * Location: Remote-first More ❯

at Howden. Job Title: Data Architect Location: London/Hybrid Job Type: Full-time Job Summary Are you passionate about designing scalable, high-performance data architectures on Azure and Databricks ? Do you thrive on solving complex data challenges, integrating modern data platforms, and defining best practices for enterprise data management? We are looking for a Data Architect to lead the … you enjoy working with big data technologies, governance frameworks, and modern analytics platforms , this role is for you! Key Responsibilities Design and architect scalable, secure, and cost-effective Azure Databricks solutions for business and analytical workloads. Translate business requirements into high-level and low-level solution designs , ensuring alignment with best practices. Define and implement enterprise data governance, security, and … and-spoke data architectures , optimising for performance, scalability, and security. Collaborate with business stakeholders, data engineers, and analytics teams to ensure solutions are fit for purpose. Implement and optimise Databricks Delta Lake, Medallion Architecture, and Lakehouse patterns for structured and semi-structured data. Ensure best practices in Azure networking, security, and federated data access . Key Skills & Experience 5+ years More ❯

experience across coding/configuration/automation/monitoring/security is necessary. Significant AWS or Azure hands-on experience. ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones. Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. Certifications: AWS, Azure, or Cloudera certifications are a plus. The role comes with an extensive benefits … sponsorship for this role. KEYWORDS Lead Data Engineer, Senior Lead Data Engineer, Spark, Java, Python, PySpark, Scala, Big Data, AWS, Azure, On-Prem, Cloud, ETL, Azure Data Fabric, ADF, Databricks, Azure Data, Delta Lake, Data Lake. Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this More ❯

both remotely and onsite. The contract has potential for extension or transition onto other exciting projects. Key Responsibilities:* Design, build, and maintain scalable data pipelines using Azure Data Factory, Databricks, and Azure Synapse.* Collaborate with cross-functional teams to ensure data quality and integration.* Support data ingestion, transformation, and storage in cloud environments.* Troubleshoot and optimise data workflows for performance … Maintain compliance with security protocols and clearance requirements. Essential Skills & Experience:* Must hold NPPV3 + SC clearance (this is a mandatory requirement).* Proven expertise in Azure Data Factory, Databricks, and Azure Synapse Analytics.* Strong experience in building and managing cloud-based data solutions.* Solid understanding of data modeling, ETL/ELT processes, and data warehousing.* Excellent communication skills and More ❯

across the organisation by lifting data literacy and nurturing a self-serve culture Guide your team through a data transformation journey, creating a reliable single source of truth using DataBricks Develop and scale meaningful data models, including AI/ML opportunities, that unlock tangible value for our customers and business Champion and manage impactful, reliable data products that support commercial … conversations Experience creating and delivering data roadmaps with strong prioritisation and impact focus A passion for sustainable, well managed data products that make a difference Hands on knowledge of DataBricks and experience with data transformation programmes A genuine interest in leading and developing people, building happy and high performing teams A belief in strong data foundations and pragmatic delivery over … lead, space to innovate, and a team who values support, balance and shared success. Technologies EON Next loves: Languages: Python, SQL & Spark (PySpark, SparkSQL) Tools: Git (GitHub/GitLab) DataBricks, AWS services (inc. Athena/Glue, S3, SageMaker, Lambda, Transcribe, EC2) & Tableau Datastores: Postgres, DataBricks, Parquet/Delta Here's what else you need to know: Role may close earlier More ❯

across the organisation by lifting data literacy and nurturing a self-serve culture Guide your team through a data transformation journey, creating a reliable single source of truth using DataBricks Develop and scale meaningful data models, including AI/ML opportunities, that unlock tangible value for our customers and business Champion and manage impactful, reliable data products that support commercial … conversations Experience creating and delivering data roadmaps with strong prioritisation and impact focus A passion for sustainable, well managed data products that make a difference Hands on knowledge of DataBricks and experience with data transformation programmes A genuine interest in leading and developing people, building happy and high performing teams A belief in strong data foundations and pragmatic delivery over … lead, space to innovate, and a team who values support, balance and shared success. Technologies EON Next loves: Languages: Python, SQL & Spark (PySpark, SparkSQL) Tools: Git (GitHub/GitLab) DataBricks, AWS services (inc. Athena/Glue, S3, SageMaker, Lambda, Transcribe, EC2) & Tableau Datastores: Postgres, DataBricks, Parquet/Delta Here's what else you need to know: Role may close earlier More ❯

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed to 100% renewable energy and sustainability, focusing on delivering exceptional customer experiences. It is initially a 3-month … week being based in their Nottingham office, this is negotiable. It is a full-time role, 37 hours per week. Accountabilities: * Develop and maintain scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change. * Build and manage an enterprise data model within Databricks. * Integrate new data sources into the platform using batch and streaming processes, adhering … and Skills: * Extensive experience of Python preferred, including advanced concepts like decorators, protocols, functools, context managers, and comprehensions. * Strong understanding of SQL, database design, and data architecture. * Experience with Databricks and/or Spark. * Knowledgeable in data governance, data cataloguing, data quality principles, and related tools. * Skilled in data extraction, joining, and aggregation tasks, especially with big data and real More ❯

Glue, Lake Formation, and Athena Develop scalable and secure ETL/ELT pipelines using Python, PySpark, and SQL Drive decisions on data modeling, lakehouse architecture, and integration strategies with Databricks and Snowflake Collaborate cross-functionally to embed data governance, quality, and lineage into platform design Lead technical evaluations of new tools and approaches to evolve the platform's capabilities Serve … governance, quality frameworks, and security best practices A builder's mindset, comfortable leading architectural decisions and also delivering code in production Bonus Points For: Experience with modern platforms like Databricks, Snowflake, or other lakehouse solutions Familiarity with analytics, ML workflows, or financial market data Why Join Us? This is your chance to shape a foundational data platform from day one. More ❯

you will do it We appreciate technologies are always evolving, but we would like to hear from you if you have proven hands-on knowledge of the following technologies: Databricks Dedicated SQL Pools Synapse Analytics Data Factory To set yourself up for success you should have in-depth knowledge of the languages Apache Spark, SQL, Python, along with solid development … practices. Additionally, you will be required to have in-depth knowledge of supporting Azure platforms such as Data Lake, Key Vault, DevOps, within Databricks your experiences should include Delta, Unity Catalog, in-depth Cluster knowledge along with performance tuning and debugging. Why choose Arreoblue? As a Microsoft, Databricks, and Datometry partner, we have a vast array of training, knowledge, and More ❯

technologies are always evolving, but we would like to hear from you if you have solid working, architectural, and platform knowledge of 2 or more of the following technologies: Databricks Dedicated SQL Pools Synapse Analytics Data Factory To set yourself up for success, you should have in-depth knowledge of the languages Apache Spark, SQL, and Python, along with solid … development practices. Additionally, you will be required to have in-depth knowledge of supporting Azure platforms such as Data Lake, Key Vault, and DevOps. Within Databricks, your experiences should include Delta, Unity Catalog, in-depth cluster knowledge, along with performance tuning and debugging. Why choose Arreoblue? As a Microsoft, Databricks, and Datometry partner, we have a vast array of training More ❯

Services team. Reporting to our Head of Data Platform and Services, you'll not only maintain and optimize our data infrastructure but also spearhead its evolution. Built predominantly on Databricks, and utilizing technologies like Pyspark and Delta Lake, our infrastructure is designed for scalability, robustness, and efficiency. You'll take charge of developing sophisticated data integrations with various advertising platforms … with data-driven insights and informed decision-making What you’ll be doing for us Leadership in Design and Development : Lead in the architecture, development, and upkeep of our Databricks-based infrastructure, harnessing Pyspark and Delta Lake. CI/CD Pipeline Mastery : Create and manage CI/CD pipelines, ensuring automated deployments and system health monitoring. Advanced Data Integration : Develop … governance standards. Data-Driven Culture Champion : Advocate for the strategic use of data across the organization. Expertise in Apache Spark Advanced proficiency in Python and Pyspark Extensive experience with Databricks Advanced SQL knowledge Strong experience in building and managing CI/CD pipelines. Experience in implementing data integrations with multiple advertising and analytics platforms. Solid understanding of data governance and More ❯

lifecycle - from data transformation and SQL-based data modelling to semantic modelling - to enable the development of robust business intelligence solutions. Leveraging tools such as Azure Data Factory and Databricks, you'll design and manage data pipelines that deliver high-quality, analysis-ready datasets, and then go onto develop interactive and insightful reports in Power BI to support data-driven … technologies! Requirements: Strong SQL and data modelling expertise Experience with semantic modelling Proven Power BI development skills Experience working in an Azure environment Bonus: Familiarity with Azure Data Factory & Databricks Benefits: Salary up to around £55,000 depending on experience 25 days annual leave plus a day off for your birthday Contributory pension scheme - matched up to 5% Please Note More ❯

lifecycle - from data transformation and SQL-based data modelling to semantic modelling - to enable the development of robust business intelligence solutions. Leveraging tools such as Azure Data Factory and Databricks, you'll design and manage data pipelines that deliver high-quality, analysis-ready datasets, and then go onto develop interactive and insightful reports in Power BI to support data-driven … technologies! Requirements: Strong SQL and data modelling expertise Experience with semantic modelling Proven Power BI development skills Experience working in an Azure environment Bonus: Familiarity with Azure Data Factory & Databricks Benefits: Salary up to around £55,000 depending on experience 25 days annual leave plus a day off for your birthday Contributory pension scheme - matched up to 5% Please Note More ❯

lifecycle - from data transformation and SQL-based data modelling to semantic modelling - to enable the development of robust business intelligence solutions. Leveraging tools such as Azure Data Factory and Databricks, you'll design and manage data pipelines that deliver high-quality, analysis-ready datasets, and then go onto develop interactive and insightful reports in Power BI to support data-driven … technologies! Requirements: Strong SQL and data modelling expertise Experience with semantic modelling Proven Power BI development skills Experience working in an Azure environment Bonus: Familiarity with Azure Data Factory & Databricks Benefits: Salary up to around £55,000 depending on experience 25 days annual leave plus a day off for your birthday Contributory pension scheme - matched up to 5% Please Note More ❯

lifecycle - from data transformation and SQL-based data modelling to semantic modelling - to enable the development of robust business intelligence solutions. Leveraging tools such as Azure Data Factory and Databricks, you'll design and manage data pipelines that deliver high-quality, analysis-ready datasets, and then go onto develop interactive and insightful reports in Power BI to support data-driven … technologies! Requirements: Strong SQL and data modelling expertise Experience with semantic modelling Proven Power BI development skills Experience working in an Azure environment Bonus: Familiarity with Azure Data Factory & Databricks Benefits: Salary up to around £55,000 depending on experience 25 days annual leave plus a day off for your birthday Contributory pension scheme - matched up to 5% Please Note More ❯

lifecycle - from data transformation and SQL-based data modelling to semantic modelling - to enable the development of robust business intelligence solutions. Leveraging tools such as Azure Data Factory and Databricks, you'll design and manage data pipelines that deliver high-quality, analysis-ready datasets, and then go onto develop interactive and insightful reports in Power BI to support data-driven … Strong SQL and data modelling expertise Experience with semantic modelling Proven Power BI development skills including DAX Experience working in an Azure environment Bonus: Familiarity with Azure Data Factory & Databricks Benefits: Salary up to around £55,000 depending on experience 25 days annual leave plus a day off for your birthday Contributory pension scheme - matched up to 5% Please Note More ❯