24 of 24 Permanent Databricks Jobs in Wales

rule yourself out if you do not have these. They are a bonus, not a checklist. Experience with Delta Lake, Iceberg, Spark or Databricks, Palantir Experience optimising LLM serving with tools such as vLLM, TGI or TensorRT LLM Search and ranking experience. For example Elasticsearch or rerankers Background in time ...

rule yourself out if you do not have these. They are a bonus, not a checklist. Experience with Delta Lake, Iceberg, Spark or Databricks, Palantir Experience optimising LLM serving with tools such as vLLM, TGI or TensorRT LLM Search and ranking experience. For example Elasticsearch or rerankers Background in time ...

best practices for data governance and security. Required Skills & Experience 5–10 years in data engineering roles, ideally within consultancy environments. Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice ...

best practices for data governance and security. Required Skills & Experience 5–10 years in data engineering roles, ideally within consultancy environments. Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice ...

data engineering, data integration and data modelling Expertise with cloud platforms (e.g. AWS, Azure, GCP) Expertise with modern cloud data platforms (e.g. Microsoft Fabric, Databricks) Expertise with multiple data analytics tools (e.g. Power BI) Deep understanding of data wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency … Experience defining and enforcing data engineering standards, patterns, and reusable frameworks Professional certifications in relevant technologies (e.g. Microsoft Azure Data Engineer, AWS Data Analytics, Databricks Certified Professional Data Engineer) Skills Data Development Process Design, build and test data products that are complex or large scale Build and lead teams ...

have delivered ML techniques to existing pricing models. Financial Services or Insurance experience would be preferable but not limited to. Full Tech Stack - Databricks, PySpark, Microsoft Azure, Azure ML, Azure Stream Analytics, Cognitive Services, Event Hubs, Synapse, Data Factory. This is a fantastic role for an experienced Machine Learning Engineer ...

cloud infrastructure underpinning data systems through a DevOps approach Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop Good understanding of the possible architectures involved in modern data system design (e.g. Data Warehouse, Data Lakes and Data Meshes) and the different ...

Urgent Opportunity- Databricks Data Architect - Contract/Permanent Opportunity- Remote - 12 months + extension- Full-time- United Kingdom Our international IT Consulting client is looking for Databricks Data Architect as below. Urgent opportunity with Competitive Rates & Immediate Interviews! Job Title: Databricks Data Architect Engagement: Full time Location: United Kingdom Languages … years of hands-on experience in enterprise data modelling using tools such as ERwin, ER/Studio, or Power Designer Proven experience with Databricks, PySpark, Python, SQL, and modern data platform architectures including data lakes and data warehouses Knowledge of batch and streaming ingestion, CI/CD tools (Azure DevOps ...

Urgent Opportunity- Databricks Data Architect - Contract/Permanent Opportunity- Remote - 12 months + extension- Full-time- United Kingdom Our international IT Consulting client is looking for Databricks Data Architect as below. Urgent opportunity with Competitive Rates & Immediate Interviews! Job Title: Databricks Data Architect Engagement: Full time Location: United Kingdom Languages … years of hands-on experience in enterprise data modelling using tools such as ERwin, ER/Studio, or Power Designer Proven experience with Databricks, PySpark, Python, SQL, and modern data platform architectures including data lakes and data warehouses Knowledge of batch and streaming ingestion, CI/CD tools (Azure DevOps ...

strong and broad understanding and experience of data engineering skills and techniques, including XPATH, R, SQL, DaX, VBA coding, experience of PowerBI, Excel, Databricks and of version control methods such as GitHub. ...

robust data governance framework. Create and embed an effective BI support and ticketing model. Work hands-on across data architecture, financial data, integrations, and Databricks-driven solutions. Requirements Enterprise Data Architect background (must be willing to be hands-on). Strong Microsoft ecosystem experience (Dynamics 365, Azure, Power BI, Dataverse ...

principles. Evaluate emerging technologies and methodologies to enhance delivery practices. Have an awareness of different technologies used within a typical data stack, such as Databricks, Azure Data Factory and Power BI. Knowledge of data warehousing and data modelling approaches and appropriate use. ...

principles. Evaluate emerging technologies and methodologies to enhance delivery practices. Have an awareness of different technologies used within a typical data stack, such as Databricks, Azure Data Factory and Power BI. Knowledge of data warehousing and data modelling approaches and appropriate use. ...

deliver high-quality, secure, and scalable data solutions — gaining exposure to multiple cloud platforms (AWS, Azure, OCI, GCP) and technologies such as Palantir Foundry, Databricks, Spark, and Airflow. Other times you will be working directly with the client, using your analytical and data skills to support their decision-making. … customer environment. Eligible for UK Security Clearance (or 5+ years UK residency. Desirable Skills & Exposure Familiarity with data lakes, warehouses, or streaming architectures (e.g. Databricks, Spark, Kafka). Experience with ETL tools, orchestration frameworks, or automation pipelines. Understanding of version control and CI/CD (e.g. GitHub, Azure DevOps). ...

sector consultancy who are currently looking for a skilled Data Engineer with a lot of experience with R, Shiny & Databricks. Role Overview: As a Databricks Engineer, you will design, develop, and manage data solutions on the Databricks platform, enabling high-performance data pipelines and analytics. This role will work closely … with data scientists, analysts, and engineering teams to support data-driven decision-making across the organisation. Key Responsibilities: Develop and optimise data pipelines using Databricks, Azure Data Factory, Synapse, and ADLS. Utilize Azure Functions and Event Hub to manage data ingestion and streaming processes. Implement data storage solutions ...

governance, reporting and analytics. Hands-on delivery experience working with data, analysis and BI tools e.g. SQL, PowerQuery, Excel VBA, Python (e.g. Pandas, PySpark), DataBricks, Power BI, Tableau etc. The salary on offer for this Data Business Analyst Role is up to £120,000 + Bonus and Benefits package. … feeding forecasting & pre trade analytics Supporting users looking for data and helping them check it meets their needs Analysing data with tools, such as DataBricks, SQL, Python, Powerquery and Excel Helping business owners govern and catalogue their data Creating and maintaining a central catalogue under the steer of Data Owners ...

Role: Data Engineer (Azure Databricks Contract) Day Rate: £250-£300 (Outside IR35) Duration: 2 months (Initially) Location: Fully Remote (UK-based candidates only) Start Date: 5th January 2026 This role will focus on Azure Databricks, revamping Salesforce integrations, modernising data pipelines, and building a new integration layer to replace legacy … systems. Key Responsibilities: Lead development and optimisation of Azure Databricks pipelines and workflows. Work with Azure Data Factory and Azure Data Streaming to ingest, transform, and deliver data in real time. Collaborate with developers to make C# modifications as part of integration improvements. Rebuild and enhance data flows between Salesforce ...

Role: Data Engineer (Azure Databricks Contract) Day Rate: £250-£300 (Outside IR35) Duration: 2 months (Initially) Location: Fully Remote (UK-based candidates only) Start Date: 5th January 2026 This role will focus on Azure Databricks, revamping Salesforce integrations, modernising data pipelines, and building a new integration layer to replace legacy … systems. Key Responsibilities: Lead development and optimisation of Azure Databricks pipelines and workflows. Work with Azure Data Factory and Azure Data Streaming to ingest, transform, and deliver data in real time. Collaborate with developers to make C# modifications as part of integration improvements. Rebuild and enhance data flows between Salesforce ...

Title: SC Cleared - Data Engineer (Databricks/Azure) Location: Fully Remote (UK-based) Day rate: Up to £400 a day Inside IR35 Clearance: SC Clearance required Contract Type: 12-month contract Interview Process: One stage Role Overview We are looking for an experienced Data Engineer is required to support … Responsibilities Design, develop and support data pipelines as part of a cloud migration initiative Build and maintain data processing and transformation workflows using Databricks Support the migration of data from legacy systems into cloud-based platforms Work closely with architects, project managers and delivery teams to meet programme objectives Contribute ...

Building and validating models across areas such as classification, regression and NLP. Deploying and maintaining your work in a modern cloud environment (Azure/Databricks). Presenting insights clearly to both technical and non-technical colleagues. Working with other teams to bring data science outputs into everyday reporting and decision … experience with commonly used libraries. Solid SQL and experience working with cloud data platforms (Azure preferred). Experience deploying models or pipelines using Databricks (or similar). A good grounding in core DS/ML techniques and the ability to turn data into meaningful insight. Experience working with LLMs ...

Our client, an award-winning fintech specialising in investment and insurance data solutions, is urgently seeking a Senior Data Engineer. You will work with actuarial and asset management datasets, building end-to-end data pipelines ...

work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn, PyTorch, TensorFlow/Keras, LangChain, Pydantic, Spark, Kafka, Databricks, MLflow, Azure, Docker, Kubernetes. Salary: Up to £100k Working Environment: Fully Remote in UK What you'll do Research, prototype, and deploy LLM use cases … tune models using scikit-learn, PyTorch, TensorFlow/Keras, and XGBoost Create data pipelines for batch and streaming with Spark and Kafka Use Databricks and MLflow for experiments, deployment, and monitoring What you'll bring Hands-on Python for data science and ML Practical experience with LLM frameworks (e.g. LangChain ...

catalogue, glossary, lineage and metadata curation Onboard SQL, Azure, and other structured sources, ensuring quality, performance and coverage Configure and optimise lineage for ADF, Databricks, Synapse, SQL and other pipelines Build and govern data-product and domain models within Purview Interpret governance and data-strategy requirements into platform configuration Provide … where required Essential Experience Active SC Clearance Deep, hands-on experience across Microsoft Purview structured capabilities, including: Catalogue, glossary and metadata modelling Lineage (ADF, Databricks, Synapse, SQL) Automated classification for structured datasets Data-product and domain structure design Metadata curation and schema-level governance Proven experience leading Purview deployments independently ...

catalogue, glossary, lineage and metadata curation Onboard SQL, Azure, and other structured sources, ensuring quality, performance and coverage Configure and optimise lineage for ADF, Databricks, Synapse, SQL and other pipelines Build and govern data-product and domain models within Purview Interpret governance and data-strategy requirements into platform configuration Provide … where required Essential Experience Active SC Clearance Deep, hands-on experience across Microsoft Purview structured capabilities, including: Catalogue, glossary and metadata modelling Lineage (ADF, Databricks, Synapse, SQL) Automated classification for structured datasets Data-product and domain structure design Metadata curation and schema-level governance Proven experience leading Purview deployments independently ...