This pull request addresses issue #38 **Changes included:** - Added a `max_tokens` parameter to the typer cli for the `generate` command, allowing user to set a default number of tokens per chunk. - Introduced a default variable `MAX_TOKEN_PER_CHUNK` to centralize the default value. - Fixed a tokenization issue by inserting a comma, allowing the model to correctly read each chunk as intended rather than treating one chunk as a single sentence. **Future improvement suggestion :** - Consider enhancing the `split_into_best_sentences` function using regex to split text more accurately without modifying it, which would improve clarity and maintainability. --------- Co-authored-by: Václav Volhejn <8401624+vvolhejn@users.noreply.github.com>
9 lines
227 B
Python
9 lines
227 B
Python
DEFAULT_AUDIO_PROMPT = "alba"
|
|
DEFAULT_VARIANT = "b6369a24"
|
|
DEFAULT_TEMPERATURE = 0.7
|
|
DEFAULT_LSD_DECODE_STEPS = 1
|
|
DEFAULT_NOISE_CLAMP = None
|
|
DEFAULT_EOS_THRESHOLD = -4.0
|
|
DEFAULT_FRAMES_AFTER_EOS = None
|
|
MAX_TOKEN_PER_CHUNK = 50
|