RWKV 1.5B for android and iOS
focus on Role play
should wait for RWKV runner updated to test this model, this model need select customized vocabs file
Runner have updated to be able using selected tokenzier files
use following txt file to inference and
https://huggingface.co/xiaol/RWKV-claude-for-mobile-v4-world-1.5B-16k/blob/main/rwkvvocabv20230424.txt
and use preset to change names to user and assistant which finetuned with this start prefix format details in this image:
more detail here:https://huggingface.co/xiaol/RWKV-paper-reviewer-and-reading-comprehension-wenda-Worldv4-7B-16k
or you can directly use it on phone make it as your own assistant
https://github.com/daquexian/faster-rwkv
temp 0.7 topp 0.4
评论