1 Commits
Author SHA1 Message Date
nabil-tazi 670e777260 Add int8 dynamic quantization support (#147)
# Add int8 dynamic quantization
 
Closes #7
 
## Summary
 
This PR implements mixed-precision int8 dynamic quantization for
pocket-tts, as requested in issue #7. It adds a `quantize=True` flag to
`TTSModel.load_model()` that reduces runtime memory usage by ~48% and
improves inference speed by ~27% on x86 and up to 23% on ARM, with no
measurable impact on audio quality.
2026-03-24 11:29:14 +01:00