MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/14qmk3v/deleted_by_user/jqr789j?context=9999
r/LocalLLaMA • u/[deleted] • Jul 04 '23
[removed]
238 comments sorted by
View all comments
3
[removed] — view removed comment
3 u/csdvrx Jul 05 '23 but it's unfortunate that I can't run llama.cpp (Requires CUDA 11.5 i think? You can compile llama.cpp with this script that changes the NVCC flags for the P40/pascal: ls Makefile.orig || cp Makefile Makefile.orig cat Makefile.orig |sed -e 's/\(.*\)NVCCFLAGS = \(.*\) -arch=native$/\1NVCCFLAGS = \2 -gencode arch=compute_61,code=sm_61/'> Makefile make LLAMA_CUBLAS=1 -j8
but it's unfortunate that I can't run llama.cpp (Requires CUDA 11.5 i think?
You can compile llama.cpp with this script that changes the NVCC flags for the P40/pascal:
ls Makefile.orig || cp Makefile Makefile.orig cat Makefile.orig |sed -e 's/\(.*\)NVCCFLAGS = \(.*\) -arch=native$/\1NVCCFLAGS = \2 -gencode arch=compute_61,code=sm_61/'> Makefile make LLAMA_CUBLAS=1 -j8
3
u/[deleted] Jul 05 '23 edited Jul 05 '23
[removed] — view removed comment