Instructions to use google/flan-t5-xxl with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use google/flan-t5-xxl with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("google/flan-t5-xxl") model = AutoModelForSeq2SeqLM.from_pretrained("google/flan-t5-xxl") - Notebooks
- Google Colab
- Kaggle
Not getting proper output from this model as before.
#50
by nisha7 - opened
Is there any chance, you have updated the model because its not giving correct results as it was giving before.
please update as soon as possible.
its very urgent.
I'm seeing the same problem. The output is complete junk all of the sudden. I was using this model via the inference endpoint for weeks, but now it's giving useless incorrect output. Clearly broken. I made a copy of a colab notebook I was working with a re ran the queries, the output is completely different from those captured previously in the notebook. The responses are very incoherent and obviously wrong.
This problem seems to be resolved today!
Yeah it is


