Tom Aarsen commited on
Commit
11a560e
1 Parent(s): e8414e7

Skip GGUF-ified models

Browse files

Perhaps in the future we'll have to make this stricter, e.g. skipping only GGUF models that don't also have pytorch models?

Files changed (1) hide show
  1. refresh.py +2 -0
refresh.py CHANGED
@@ -357,6 +357,8 @@ def get_mteb_data(
357
  for model in pbar:
358
  if model.modelId in MODELS_TO_SKIP:
359
  continue
 
 
360
  pbar.set_description(f"Fetching {model.modelId!r} metadata")
361
  meta = download_or_use_cache(model.modelId)
362
  MODEL_INFOS[model.modelId] = {"metadata": meta}
 
357
  for model in pbar:
358
  if model.modelId in MODELS_TO_SKIP:
359
  continue
360
+ if "gguf" in model.tags:
361
+ continue
362
  pbar.set_description(f"Fetching {model.modelId!r} metadata")
363
  meta = download_or_use_cache(model.modelId)
364
  MODEL_INFOS[model.modelId] = {"metadata": meta}