Benjamin Satzger 256bf1c0b2 Add model_type method for determining model categories ...

Introduce a model_type method to categorize models.

The simple functionality  right now is:
 * Returns :embedding for the mistral model
 * Returns :guard for models whose names start with llama-guard
 * Defaults to :text_generation for all other models

2024-12-09 09:34:59 +01:00

3.5 KiB

Raw Permalink Blame History

View Raw