Category "huggingface-datasets"

Properly evaluate a test dataset

I trained a machine translation model using huggingface library: def compute_metrics(eval_preds): preds, labels = eval_preds if isinstance(preds, tuple)

How do I move a dataset from Huggingface to Google Cloud?

I am trying to use huggingface multi_nli to train a text multi-classification ai in google cloud. I want to call the ai from a firebase web app eventually. But

How to avoid the string NA from being interpreted as nan when using load_dataset

I have looked at it a number of places in the process. With panda beforehand I create a csv file and there are cells that contain the string NA which is meant

Huggingface models only work once, then spit out Tokenizer error

i am following along with this example on huggingface's website, trying to work with twitter sentiment. I am running python 3.9 on PyCharm. the code works fine

How to load custom dataset from CSV in Huggingfaces

I would like to load a custom dataset from csv using huggingfaces-transformers