Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support multi-class classification #115

Open
Firenze11 opened this issue Feb 23, 2020 · 1 comment
Open

Support multi-class classification #115

Firenze11 opened this issue Feb 23, 2020 · 1 comment
Labels
enhancement New feature or request rfc Request for comments

Comments

@Firenze11
Copy link
Contributor

Summary

The project currently doesn't support multiclass classification models, this should be valuable and relatively simple to implement.

Possible Solution

  • Each yPred files have multiple columns, each indicating predicted probability of one class
  • Automatic clustering algorithm uses nModels * (nClasses - 1) columns to do segmentation
  • Visualization doesn't have to change since one data point is still associated with one metric per model, which is the log-loss.
  • If users want to segment by performance on one single class, we can implement that based on user-defined performance metric (other metrics #105), where user specify the metric to be some sort of loss function comparing the prediction for class N with the ground truth for class N
@Firenze11 Firenze11 added enhancement New feature or request rfc Request for comments labels Feb 23, 2020
@Firenze11 Firenze11 added this to the P1 - strategic features milestone Feb 23, 2020
@imneonizer
Copy link

Does it support object detection models? If yes, how do i prepare my prediction data for manifold to be able to visualize model performace.
what would be the contents of features dataset, pixel values?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request rfc Request for comments
Projects
None yet
Development

No branches or pull requests

2 participants