Syntax Analysis Config
Default value: SyntaxOptions()
Some thresholds can be modified to determine what is considered a short or a long sentence, as explained in Syntax Analysis.
from pydantic import BaseModel
class SyntaxOptions(BaseModel):
short_sentence_max_token: int = 3 # (1)
long_sentence_min_token: int = 16 # (2)
- Maximum number of tokens for a sentence to be tagged as short (e.g <=3 for the default)
- Minimum number of tokens for a sentence to be tagged as long (e.g >=16 for the default)