There is a tool called llmfit which can tell you what local llms your system is capable of running.