Abstract: Recent advancements in large language models (LLMs) have established pre-training on extensive textual cor-pora as a foundational methodology. However, in specialised applications such as ...