MosquitoScan Project

Performance Evaluation

Model: eva02_tiny_patch14_224.mim_in22k

Dataset: exp-4-dataset-final-subset-1-objects

• Full Suite report - Combines all the individual experiment reports into a single document. The suite is composed of various checks such as:
  • Class Performance
  • Confusion Matrix
  • Prediction Drift report
  • Data Integrity
  • Model Evaluation
  • Train Test Validation
• Simple Model Comparison (stratified) - Compare given model score to simple model score (according to given model type)
• Simple Model Comparison (stratified at 0.6) - Similar to above, but focuses on a specific threshold (model performance gain over simple model is greater than 60%).
• Single Dataset Performance (test) - Analyzes the model's performance on the test dataset, evaluates the model's scores for each mosquito species.
• Single Dataset Performance (train) - Analyzes the model's performance on the train dataset, evaluates the model's scores for each mosquito species.