Free GPU memory and/or unload models

Frees GPU memory by unloading models and/or freeing the resident model cache.

post/api/free

Request body

free_memoryboolean

Run garbage collection and free cached memory

unload_modelsboolean

Unload all models from VRAM/RAM

Response

Memory freed

Changes