Is there a way to let HF generate tokens based on the last hidden states?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Get each generated token last layer hidden state | 3 | 113 | March 16, 2025 | |
| Avoid recalculating hidden states between generate calls? | 3 | 1261 | March 30, 2023 | |
| Streaming token output from models like T5 | 7 | 12327 | June 7, 2023 | |
| BLIP2 GreedySearchDecoderOnlyOutput, how can I extract the activations of a certain hidden layer? | 0 | 153 | July 5, 2023 | |
| T5.generate() cannot get hidden states although output_hidden_states=True | 0 | 570 | July 9, 2022 |