Skip to main content

Local chat bot (LMStudio)

image.png

Lmstudio is a graphical interface that allows you to download and run local chat bots. It also has an optional server component that can be enabled, so other tools can make use of its backend.

On Linux it is distributed as AppImage. I highly recommend to install Gear Lever, which helps with installing AppImages (Open the AppImage with Gear Lever). Lmstudio also works very well on Windows.

If your computer does not have enough VRAM for a model, you can always let it be (partially) run on CPU:

image.png

image.png

Back to top