Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use of seqeval locally with Hugging face evaluate #105

Open
BerndRusitschka opened this issue Jan 8, 2024 · 1 comment
Open

Use of seqeval locally with Hugging face evaluate #105

BerndRusitschka opened this issue Jan 8, 2024 · 1 comment

Comments

@BerndRusitschka
Copy link

I want to use the seqeval metric locally in my environment because I am blocked from internet access by my company when it comes to accessing resources on the internet.
I have already installed the Hugging Face evaluate package. I have access to the file "seqeval-1.2.2.tar.gz" but I have not yet installed it into my virtual environment.

When I call "evaluate.load("seqeval")" I get a ModuleNotFoundError.

My questions would be:

1.) What do I have to do in order to use seqeval locally in my virtual environment?
2.) Does anybody know what the use of this code snippet is?
https://huggingface.co/spaces/evaluate-metric/seqeval/blob/main/seqeval.py
It was used by a colleague of mine in order to compute seqeval metrics but I do not understand the logic.

Thanks in advance.

@jeffsgrover
Copy link

Using evaluate.load() instead of datasets.load_metric() solved the issue for me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants