Max word limit for punctuation model #4612
Replies: 4 comments
-
|
Please help |
Beta Was this translation helpful? Give feedback.
-
|
max length for any transformer model will be the max_tokens for Bert its 512, check the lm ur using. But the punctuation model makes use of windowing. So there should be a max length constraint |
Beta Was this translation helpful? Give feedback.
-
|
This script splits the input into overlapping segments to run inference on long texts and overcome LM max_seq_length constraint. |
Beta Was this translation helpful? Give feedback.
-
|
is there any number for long text? We have paragraph of 10000 words. Will it be able to process it? |
Beta Was this translation helpful? Give feedback.
-
What is the maximum sentence length is allowed for punctuation model?
Beta Was this translation helpful? Give feedback.
All reactions