OpenTransformer
/

llama.cpp-prismml

llama.cpp-prismml / src /llama-cparams.cpp

Q1_0_g128 CPU kernel fix + AVX2 SIMD (fork of PrismML-Eng/llama.cpp)

03ba2cd verified 6 months ago

100 Bytes

	#include "llama-cparams.h"

	size_t llama_max_parallel_sequences(void) {
	return LLAMA_MAX_SEQ;
	}