[REQ:] Option for unload model after generation

[mykeehu]

I use the Gradio app for text generation and another app for image generation in parallel, so it would be nice to have a switch that unload the model from memory and VRAM.

Update: I made a PR here

[abline11]

I use the Gradio app for text generation and another app for image generation in parallel, so it would be nice to have a switch that unload the model from memory and VRAM.

Update: I made a PR here

Sadly the memory management with Joycaption has piut me off using it. In my opinion it is one of the best uncensored captioners, but after running it for 4 or 5 different input images it crashes out.