10 Commits
Author SHA1 Message Date
Xinyang Qiu b9d561240a Add inference steps and seed controls to Gradio demo (#40) 2025-12-23 20:57:21 -08:00
mrfakename e0bef6f8b2 Fix Gradio demo 2025-12-06 14:48:43 -08:00
mrfakename c25ae58bb2 LoRA inference (#14) 2025-09-24 15:05:02 -07:00
gregory-fanousandYaoyaoChang 6dd49cb720 feat: add Apple MPS device support (dtype + attention handling) to demos (#67)
* Enhance model loading with device support and error handling

Updated device handling for model loading and added support for MPS. Improved error handling and fallback mechanisms for attention implementations.

* Improve device handling and model loading logic

Updated device argument handling to support MPS and added validation for MPS availability. Enhanced model loading logic based on the selected device type.

* fallback only when flash_attention_2 and add some comments back

---------

Co-authored-by: YaoyaoChang <cyy574006791@qq.com>
2025-09-01 17:16:01 +08:00
YaoyaoChang 174e53fc04 gradio support sdpa 2025-08-30 08:22:32 -07:00
YaoyaoChang c72bc0c59b add Risks and Limitations in Gradio 2025-08-28 02:26:17 -07:00
NR 84710c4d2b Add immediate UI update for Generate and Stop buttons (#18)
### Summary
The Stop button previously appeared only after the backend generation job actually started, leaving users with no cancel affordance while a request sat in the queue. This PR makes the Stop button visible immediately after clicking **Generate Podcast**.

### Change
Adds a single non-queued `.then` step in the click event chain
that hides the Generate button and shows the Stop button instantly, before the queued job begins processing.
2025-08-28 15:24:43 +08:00
YaoyaoChang f57a9bffb1 speaker index from 1 2025-08-28 15:24:42 +08:00
_ 2c7c57eda0 script.replace("’", "'") in gradio_demo.py
prevents ’ characters from silencing succeeding word parts
2025-08-26 01:00:37 +01:00
pengzhiliang d5895e76d4 init 2025-08-25 15:28:13 +00:00