fix(classifier): local_encoder default model is gated, switch to bart-large-mnli #48

Merged
alee merged 1 commits from fix/local-encoder-default-model into main 2026-09-07 00:34:48 +00:00

1 Commits

Author SHA1 Message Date
adlee-was-taken
1f74895910 fix(classifier): local_encoder default model is gated, switch to bart-large-mnli
MoritzLaurer/deberta-v3-base-zeroshot-v2 (the local_encoder default)
started returning 401 on an unauthenticated GET of its own model page
-- gated or moved sometime after this project picked it, discovered
live 2026-09-06 when it took production down entirely (crash-loop,
exit code 1). The startup check (ensure_available) did its job --
refused to boot rather than fail opaquely on the first request -- but
the service still couldn't come up until the default was fixed.

Switched to facebook/bart-large-mnli: HuggingFace's own reference
model for the zero-shot-classification pipeline, confirmed publicly
accessible live. Larger than the old default (~407M vs ~184M params)
but that's the honest tradeoff for "still works."

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01VRQXz5SYZYVWscxS1QqF6U
2026-09-06 20:34:01 -04:00