Small Language Models
August 02, 2024
October 17, 2024
A small language model (SLM) is a machine learning model typically based on a large language model (LLM) but of greatly reduced size. An SLM retains much of the functionality of the LLM from which it is built but with far less complexity and computing resource demand.
Goal
- Study and implement new methodologies for fine-tuning SLMs and improve their performance
- Adapting SLMs to the Italian language
- Study and implement new methodologies for building SLMs
- Build applications based on SLMs running on desktop computer or mobile devices