We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
2.以下是终端记录: `terryjay@TJUbuntu:/GPT/ai00$ ./ai00_server --model ./RWKV-4-World-CHNtuned-7B-v1-20230709-ctx4096.st --quant 32 ✔ Please select an adapter · AMD Radeon RX 6700 XT (RADV NAVI22) (Vulkan) 2023-09-16T03:12:15.772Z INFO [ai00_server] server started at http://0.0.0.0:65530 2023-09-16T03:14:59.251Z INFO [ai00_server] AdapterInfo { name: "AMD Radeon RX 6700 XT (RADV NAVI22)", vendor: 4098, device: 29663, device_type: DiscreteGpu, driver: "radv", driver_info: "Mesa 22.2.5-0ubuntu0.122.04.3", backend: Vulkan, } 2023-09-16T03:14:59.251Z INFO [ai00_server] ModelInfo { num_layers: 32, num_emb: 4096, num_vocab: 65536, } 2023-09-16T03:14:59.251Z INFO [ai00_server] chosen head chunk size: large (8192) 2023-09-16T03:17:08.866Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:17:08.866Z TRACE [ai00_server] state cache miss 2023-09-16T03:17:08.866Z TRACE [ai00_server] User: 现在的时间是2023 9月 16日 星期六 上午
Assistant: 好的我知道了!
User: 你是谁?
Assistant: Hello, I am your AI assistant. If you have any questions or instructions, please let me know!
User: 你好
Assistant:
User: hello
[DONE] 2023-09-16T03:17:09.823Z TRACE [ai00_server] state cache evicted: 0 2023-09-16T03:17:29.249Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:17:29.249Z TRACE [ai00_server] state cache hit: 1 2023-09-16T03:17:29.249Z TRACE [ai00_server] User: hello!
Assistant: User:[DONE] 2023-09-16T03:17:29.405Z TRACE [ai00_server] state cache evicted: 0 2023-09-16T03:17:33.687Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:17:33.688Z TRACE [ai00_server] state cache hit: 1 2023-09-16T03:17:33.688Z TRACE [ai00_server]
User: 111
Assistant: User
[DONE] 2023-09-16T03:17:33.853Z TRACE [ai00_server] state cache evicted: 0 2023-09-16T03:17:37.943Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:17:37.943Z TRACE [ai00_server] state cache hit: 1 2023-09-16T03:17:37.943Z TRACE [ai00_server] User: ???
Assistant: I'm sorry, but I'm not sure what you mean by "111". Can you please provide more context or information?
[DONE] 2023-09-16T03:17:39.044Z TRACE [ai00_server] state cache evicted: 0 2023-09-16T03:17:52.410Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:17:52.410Z TRACE [ai00_server] state cache hit: 1 2023-09-16T03:17:52.410Z TRACE [ai00_server] User: 今天是什么日子
Assistant: User:[DONE] 2023-09-16T03:17:52.618Z TRACE [ai00_server] state cache evicted: 0 2023-09-16T03:27:47.835Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:27:47.835Z TRACE [ai00_server] state cache hit: 1 2023-09-16T03:27:47.836Z TRACE [ai00_server]
User: 你叫什么
[DONE] 2023-09-16T03:27:48.017Z TRACE [ai00_server] state cache evicted: 0 2023-09-16T03:27:54.082Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:27:54.082Z TRACE [ai00_server] state cache hit: 1 2023-09-16T03:27:54.082Z TRACE [ai00_server] User: ?
Assistant: 我是一个AI助手,你可以称呼我为“你”或者“小助手”。
[DONE] 2023-09-16T03:27:55.263Z TRACE [ai00_server] state cache evicted: 0 2023-09-16T03:27:59.982Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:27:59.982Z TRACE [ai00_server] state cache hit: 1 2023-09-16T03:27:59.982Z TRACE [ai00_server] User: 111
Assistant: 好的,有什么问题或任务需要我帮忙吗?
[DONE] 2023-09-16T03:28:00.806Z TRACE [ai00_server] state cache evicted: 0 2023-09-16T03:28:06.045Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:28:06.045Z TRACE [ai00_server] state cache hit: 1 2023-09-16T03:28:06.045Z TRACE [ai00_server] User: OK
Assistant: 如果您有任何问题或需要帮助,请随时告诉我。
[DONE] 2023-09-16T03:28:07.027Z TRACE [ai00_server] state cache evicted: 0 2023-09-16T03:28:13.035Z TRACE [ai00_server] Sampler { top_p: 0.5, temperature: 1.0, presence_penalty: 0.3, frequency_penalty: 0.3, } 2023-09-16T03:28:13.036Z TRACE [ai00_server] state cache hit: 1 2023-09-16T03:28:13.036Z TRACE [ai00_server] User: 小助手
3.以下是网页chat截图:
The text was updated successfully, but these errors were encountered:
我也有这个问题,在rwkv-runner中运行的时候字多一点就输出空
Sorry, something went wrong.
No branches or pull requests
1.启动命令和操作系统信息:
./ai00_server --model ~/GPT/RWKV-model/RWKV-4-World-CHNtuned-7B-v1-20230709-ctx4096.st --quant 32
系统:Ubuntu22
显卡:AMD RX6700XT 12GB
2.以下是终端记录:
`terryjay@TJUbuntu:
/GPT/ai00$ ./ai00_server --model ./RWKV-4-World-CHNtuned-7B-v1-20230709-ctx4096.st --quant 3222.04.3",✔ Please select an adapter · AMD Radeon RX 6700 XT (RADV NAVI22) (Vulkan)
2023-09-16T03:12:15.772Z INFO [ai00_server] server started at http://0.0.0.0:65530
2023-09-16T03:14:59.251Z INFO [ai00_server] AdapterInfo {
name: "AMD Radeon RX 6700 XT (RADV NAVI22)",
vendor: 4098,
device: 29663,
device_type: DiscreteGpu,
driver: "radv",
driver_info: "Mesa 22.2.5-0ubuntu0.1
backend: Vulkan,
}
2023-09-16T03:14:59.251Z INFO [ai00_server] ModelInfo {
num_layers: 32,
num_emb: 4096,
num_vocab: 65536,
}
2023-09-16T03:14:59.251Z INFO [ai00_server] chosen head chunk size: large (8192)
2023-09-16T03:17:08.866Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:17:08.866Z TRACE [ai00_server] state cache miss
2023-09-16T03:17:08.866Z TRACE [ai00_server] User: 现在的时间是2023 9月 16日 星期六 上午
Assistant: 好的我知道了!
User: 你是谁?
Assistant: Hello, I am your AI assistant. If you have any questions or instructions, please let me know!
User: 你好
Assistant:
User: hello
Assistant:
User: 你好
Assistant:
[DONE]
2023-09-16T03:17:09.823Z TRACE [ai00_server] state cache evicted: 0
2023-09-16T03:17:29.249Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:17:29.249Z TRACE [ai00_server] state cache hit: 1
2023-09-16T03:17:29.249Z TRACE [ai00_server] User: hello!
Assistant:
User:[DONE]
2023-09-16T03:17:29.405Z TRACE [ai00_server] state cache evicted: 0
2023-09-16T03:17:33.687Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:17:33.688Z TRACE [ai00_server] state cache hit: 1
2023-09-16T03:17:33.688Z TRACE [ai00_server]
User: 111
Assistant:
User
[DONE]
2023-09-16T03:17:33.853Z TRACE [ai00_server] state cache evicted: 0
2023-09-16T03:17:37.943Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:17:37.943Z TRACE [ai00_server] state cache hit: 1
2023-09-16T03:17:37.943Z TRACE [ai00_server] User: ???
Assistant:
I'm sorry, but I'm not sure what you mean by "111". Can you please provide more context or information?
[DONE]
2023-09-16T03:17:39.044Z TRACE [ai00_server] state cache evicted: 0
2023-09-16T03:17:52.410Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:17:52.410Z TRACE [ai00_server] state cache hit: 1
2023-09-16T03:17:52.410Z TRACE [ai00_server] User: 今天是什么日子
Assistant:
User:[DONE]
2023-09-16T03:17:52.618Z TRACE [ai00_server] state cache evicted: 0
2023-09-16T03:27:47.835Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:27:47.835Z TRACE [ai00_server] state cache hit: 1
2023-09-16T03:27:47.836Z TRACE [ai00_server]
User: 你叫什么
Assistant:
User
[DONE]
2023-09-16T03:27:48.017Z TRACE [ai00_server] state cache evicted: 0
2023-09-16T03:27:54.082Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:27:54.082Z TRACE [ai00_server] state cache hit: 1
2023-09-16T03:27:54.082Z TRACE [ai00_server] User: ?
Assistant:
我是一个AI助手,你可以称呼我为“你”或者“小助手”。
[DONE]
2023-09-16T03:27:55.263Z TRACE [ai00_server] state cache evicted: 0
2023-09-16T03:27:59.982Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:27:59.982Z TRACE [ai00_server] state cache hit: 1
2023-09-16T03:27:59.982Z TRACE [ai00_server] User: 111
Assistant:
好的,有什么问题或任务需要我帮忙吗?
[DONE]
2023-09-16T03:28:00.806Z TRACE [ai00_server] state cache evicted: 0
2023-09-16T03:28:06.045Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:28:06.045Z TRACE [ai00_server] state cache hit: 1
2023-09-16T03:28:06.045Z TRACE [ai00_server] User: OK
Assistant:
如果您有任何问题或需要帮助,请随时告诉我。
[DONE]
2023-09-16T03:28:07.027Z TRACE [ai00_server] state cache evicted: 0
2023-09-16T03:28:13.035Z TRACE [ai00_server] Sampler {
top_p: 0.5,
temperature: 1.0,
presence_penalty: 0.3,
frequency_penalty: 0.3,
}
2023-09-16T03:28:13.036Z TRACE [ai00_server] state cache hit: 1
2023-09-16T03:28:13.036Z TRACE [ai00_server] User: 小助手
Assistant:
是的,有什么我可以帮您的吗?User:[DONE]
2023-09-16T03:28:13.867Z TRACE [ai00_server] state cache evicted: 0
`
3.以下是网页chat截图:
The text was updated successfully, but these errors were encountered: