Will It Run? Local LLM Calculator

Pick a model and your GPU or Mac: see if it fits, how much memory it needs at each quantisation and an estimated speed. Model data updates daily.