shashankswe2020-ux/local-llmup

local-llmup is a hardware-aware CLI tool for the management of local large language models. It provides an interactive terminal interface to evaluate the model's feasibility of running on the device (yes/slow/no) and estimated performance before downloading. Supports Ollama, llama.cpp and other backends to help users discover, install, service and manage the entire life cycle of local LLM.

Open resource