Ken Cheung
kencwt
AI & ML interests
None yet
Organizations
None yet
Where can I find the inference.py mentioned in the CLI Inference section?
3
#29 opened 5 months ago
by
Zebin01
How to run multi-GPU inference on 2x NVIDIA T4?
1
#28 opened 5 months ago
by
Marshalldom
attn to cross_attn key conversion
#27 opened 5 months ago
by
kencwt
attn to cross_attn conversion
#7 opened 5 months ago
by
kencwt
attn key conversion
#6 opened 6 months ago
by
kencwt
attn key conversion
#25 opened 6 months ago
by
kencwt
diffusers integration
#23 opened 6 months ago
by
kencwt
[WIP] diffusers integration
#21 opened 6 months ago
by
kencwt
Upload ScreenShot_133686899390424580.JPG
#12 opened 6 months ago
by
Lisianna
GGUF versions
👀👍 5
2
#4 opened 6 months ago
by
maroo87
Struggling to get this to run on a 24gb gpu
17
#3 opened 6 months ago
by
CodeExplode
Switch to T5Gemma2Encoder for text encoding
#5 opened 6 months ago
by
kencwt
Switch to T5Gemma2Encoder for text encoding
#6 opened 6 months ago
by
kencwt
Switch to T5Gemma2Encoder for text encoding
#6 opened 6 months ago
by
kencwt
Switch to T5Gemma2Encoder for text encoding
#5 opened 6 months ago
by
kencwt