Btw, the quantized models are on Huggingface, so step 1 and steps 3-6 can be avo...

		brandonasuncion on Oct 6, 2023 \| parent \| context \| favorite \| on: Ollama is now available as an official Docker imag... Btw, the quantized models are on Huggingface, so step 1 and steps 3-6 can be avoided. (The link is 3/4ths into the llama.cpp README)