`torch.no_grad` is thread local, I now run the autoregressive generation in a separate thread, in addition of the thread running mimi, and forgot to add `torch.no_grad` to the function inside this thread.
`torch.no_grad` is thread local, I now run the autoregressive generation in a separate thread, in addition of the thread running mimi, and forgot to add `torch.no_grad` to the function inside this thread.