queue

Free GPU memory and/or unload models

Frees GPU memory by unloading models and/or freeing the resident model cache, controlled by the request flags.

post/api/free

Request body

unload_modelsboolean

Unload all models from VRAM/RAM

free_memoryboolean

Run garbage collection and free cached memory

Response

Memory freed

Changes