slm - OpenSSM Documentation

This module contains the HuggingFaceBaseSLM class, and its subclasses, which are SLMs based on models from HugoingFace. The models may be served from HuggingFace's model hub, or a private internal server.

`Falcon7bSLM`

Bases: SLM

Falcon7bSLM is a wrapper for the Falcon7b model, which may be hosted remotely. If hosted remotely, the model_url and model_server_token must be provided through the Config class.

FALCON7B_MODEL_URL should be set appropriately: - If hosted on HuggingFace, set to the model's URL on HuggingFace. - If hosted on AWS/GCP, set to the model's URL on there - If not supported, set to "NONE" (or not set at all)

`SLM`

Bases: BaseSLM

This class is the base class for all SLMs based on models from HuggingFace. The models may be served from HuggingFace's model hub, or a private internal server.

model_url should be set appropriately: - If hosted on HuggingFace, set to the model's URL on HuggingFace. - If hosted on AWS/GCP, set to the model's URL on there - If not supported, set to "NONE" (or not set at all)