Releases · josStorer/RWKV-Runner · GitHub

20 Oct 07:57

v1.8.8 Latest

Latest

Changes

potential crash fix (#396)

Note: If you encounter WebView2 crash issues, please try opening the Windows Settings, click on Apps, search for WebView2, click Modify -> Repair to update your WebView2 runtime.

Install

Assets 7

29 Aug 07:46

v1.8.7

v1.8.7

withdrawing the obfuscated tiny package, as it caused some exceptions in the html webui

v1.8.6

Features

feat(python backend): function call support (#368) Great thanks to @EliwiiKeeya

feat(ui): add navigator for web on narrow screen (#376) Great thanks to @HaloWang

windows installer support: https://github.com/josStorer/RWKV-Runner/releases/latest/download/RWKV-Runner-amd64-installer.exe
add penalty_decay to the Completion Page

Improvements

improve WSL installation condition detection

Chores

downgrade to golang1.20 for compatibility with windows7 (#377)
update manifest.json (hide old models and add new models)
html-webui.zip is now added to the release

Install

Contributors

HaloWang and EliwiiKeeya

Assets 7

29 Aug 07:15

v1.8.6

Changes

Features

feat(python backend): function call support (#368) Great thanks to @EliwiiKeeya

feat(ui): add navigator for web on narrow screen (#376) Great thanks to @HaloWang

windows installer support: https://github.com/josStorer/RWKV-Runner/releases/latest/download/RWKV-Runner-amd64-installer.exe
add penalty_decay to the Completion Page

Improvements

improve WSL installation condition detection

Chores

downgrade to golang1.20 for compatibility with windows7 (#377)
update manifest.json (hide old models and add new models)
html-webui.zip is now added to the release

Install

Contributors

HaloWang and EliwiiKeeya

Assets 7

25 Jul 15:57

v1.8.5

Changes

Features

allow the use of the devtools (Ctrl/Cmd+Shift+F12)
allow custom user avatar image of presets

Upgrades

bump webgpu(python) (https://github.com/cryscan/web-rwkv-py)
bump rwkv.cpp (rwkv6 support) (https://github.com/RWKV/rwkv.cpp)

Improvements

improve prompts
improve error notifications during fine-tuning

Fixes

fix: #353, numpy2.0 error when fine-tuning

Install

Assets 6

29 May 08:42

v1.8.4

v1.8.4

fix f05a4ac, __init__.py is not embedded

v1.8.3

Deprecations

rwkv-beta is deprecated

Upgrades

bump webgpu(python) (https://github.com/cryscan/web-rwkv-py)
sync https://github.com/JL-er/RWKV-PEFT (LoRA)

Improvements

improve default LoRA fine-tune params

Fixes

fix #342, #345: cannot import name 'packaging' from 'pkg_resources'
fix the huge error prompt that pops up when running in webgpu mode

Install

Assets 6

28 May 15:15

v1.8.3

Deprecations

rwkv-beta is deprecated

Upgrades

bump webgpu(python) (https://github.com/cryscan/web-rwkv-py)
sync https://github.com/JL-er/RWKV-PEFT (LoRA)

Improvements

improve default LoRA fine-tune params

Fixes

fix #342, #345: cannot import name 'packaging' from 'pkg_resources'
fix the huge error prompt that pops up when running in webgpu mode

Install

Assets 6

16 May 06:00

v1.8.2

Changes

improve dynamic state api
fix a tps error

Install

Assets 6

12 May 15:45

v1.8.1

Changes

Features

add support for dynamic state-tuned models

Upgrades

bump webgpu mode ai00_server v0.4.8

Improvements

add tps console output
add torch cnMirror
disable pre_ffn and head_qk
improve frontend details

Chores

update manifest.json and defaultModelConfigs

Install

Assets 6

03 May 05:22

v1.8.0

Changes

bump webgpu mode ai00_server v0.4.3
fix remote customApiUrl (403 forbidden error)
update state-tuned safetensors converter

Install

Assets 6

30 Apr 15:14

v1.7.9

Changes

bump webgpu mode ai00_server v0.4.2 (huge performance improvement)
upgrade to rwkv 0.8.26 (state-tuned model support)
update defaultConfigs and manifest.json
chores

Breaking Changes

change the default value of presystem to false

For the convenience of using the future state-tuned models, the default value of presystem has been set to false. This means that the RWKV-Runner service will no longer automatically insert recommended RWKV pre-prompts for you:

User: hi

Assistant: Hi. I am your assistant and I will provide expert full response in full details. Please feel free to ask any question and I will always answer it.

If you are using the API service and conducting a rigorous RWKV conversation, please manually send the above messages to the /chat/completions API's messages array, or manually send presystem: true to have the server automatically insert pre-prompts.

If you are using the RWKV-Runner client for chatting, you can enable Insert default system prompt at the beginning in the preset editor.

Of course, in reality, even if you do not perform the above, there is usually no significant negative impact.

If you are using the new RWKV state-tuned models, you do not need to perform the above.

The new RWKV state-tuned models can be downloaded here, they are very interesting:

If you are interested in state-tuning, please refer to: https://github.com/BlinkDL/RWKV-LM#state-tuning-tuning-the-initial-state-zero-inference-overhead

Install

Assets 6