alee/6krrt
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat(local-llm): route file_summarization + diff_checking to a metered local Ollama model #22

Merged
alee merged 14 commits from feat/expand-local-llm-usage into main 2026-09-02 06:15:30 +00:00
Conversation 0 Commits 14 Files Changed 27 +5292 -106
alee commented 2026-09-02 06:13:21 +00:00
Owner
Copy Link

Adds nemotron-mini-router:4b as an 'ollama-local' catalog row restricted to file_summarization + diff_checking via an eligible_categories hard filter. Local dispatch metered into local_energy_observations with a real tariff-priced cost (seed_local_dispatch_energy.py), circuit-breaker failover to cloud, /outcome attribution for local answers, 14 new eval tasks, multi-provider eval runner, and docs.

Todos 1-12 complete and verified (Final Wave F1-F4 approved, 1020 tests). Todo 13 (live runbook) is BLOCKED on the user providing a real local_energy.tariff_usd_per_kwh and Ollama hardware — leave until the tariff is supplied.

Adds nemotron-mini-router:4b as an 'ollama-local' catalog row restricted to file_summarization + diff_checking via an eligible_categories hard filter. Local dispatch metered into local_energy_observations with a real tariff-priced cost (seed_local_dispatch_energy.py), circuit-breaker failover to cloud, /outcome attribution for local answers, 14 new eval tasks, multi-provider eval runner, and docs. Todos 1-12 complete and verified (Final Wave F1-F4 approved, 1020 tests). Todo 13 (live runbook) is BLOCKED on the user providing a real local_energy.tariff_usd_per_kwh and Ollama hardware — leave until the tariff is supplied.
alee added 14 commits 2026-09-02 06:13:22 +00:00
feat: eligible_categories hard filter in routing c8dde842e9
feat: local dispatch model config + eligible-category validation 3517fca510
feat: local dispatch config section + file_summarization/diff_checking categories 6fd934e01f
feat: file_summarization + diff_checking eval task set bef20b6c92
feat: ollama-local catalog rows via eligible_categories column + poller seeding fce64470c7
test: recompute diff-pair answers + category hygiene for new eval tasks c305872212
feat: local dispatch call + response shaping with energy metering 4e66204a7e 
Ultraworked with [Sisyphus](https://github.com/code-yeongyu/oh-my-openagent)

Co-authored-by: Sisyphus <clio-agent@sisyphuslabs.ai>
feat: route + pin dispatch to local Ollama models across chat and dispatch endpoints be8d3cc193
feat: measured tariff-priced token rates for local dispatch models 5e5eaae500
docs: expand-local-llm-usage Todo 9 findings 88a4756c4e
feat: eval runner measures ollama-local identities per provider a4995f1b7b
feat: /outcome attribution for local-dispatch answers via local energy ledger 2e9f1c4856
docs: local dispatch model, eligible-categories filter, cost seeding, and /outcome attribution eee8f7d0da
fix: local dispatch metering + seed module LOC ceiling 1ba4ad3f2c 
- _run_local_dispatch now returns metering data it already measured,
  and dispatch_endpoint builds Telemetry from that instead of spawning a
  second local_energy.measure that wrapped nothing and double-logged.
- Split seed_local_dispatch_energy.py pure derivation into
  seed_local_dispatch_core.py so the CLI script stays under 250 LOC.
- Update imports/stubs and assert single measure + single log in the
  /dispatch telemetry test.

Verification: pytest target files 86 passed; full suite 1020 passed.
alee merged commit dd08bd36e6 into main 2026-09-02 06:15:30 +00:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
No items
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
alee
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: alee/6krrt#22
Delete Branch "feat/expand-local-llm-usage"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?