Skip to content
This repository has been archived by the owner on Mar 1, 2022. It is now read-only.

对句子进行分词时句子长度的限制 #59

Open
KawhiZhao opened this issue Sep 1, 2020 · 0 comments
Open

对句子进行分词时句子长度的限制 #59

KawhiZhao opened this issue Sep 1, 2020 · 0 comments

Comments

@KawhiZhao
Copy link

您好,非常感谢您的工作
目前想对句子进行中英文混合分词,但句子太长会报错,如果固定长度分割后再分词,可能会破坏句子的连续性,这个问题有什么解决方法吗

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant