alee/6krrt
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Review follow-up to #62: docstring indentation and invisible U+202F spaces #63

Merged
alee merged 1 commits from fix/peer-rate-docstring into main 2026-09-09 02:05:44 +00:00
Conversation 0 Commits 1 Files Changed 1 +4 -4
1 changed files with 4 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
src/proficiency_outcome.py
View File

@@ -72,10 +72,10 @@ def recompute_category(
For each row:
1. Re-compute benchmark via ``blend()`` on stored leaderboard / self_eval
components. If neither component exists the row skips the conversion.
2. Collect *all* rows with ``outcome_samples > 0`` and compute the
category-level *peer_rate* (sample-weighted pooled rate:
Σoutcome_samples × outcome_score / Σoutcome_samples) and
*peer_benchmark* (mean benchmark_score over the same set).
2. Collect *all* rows with ``outcome_samples > 0`` and compute the
category-level *peer_rate* (sample-weighted pooled rate:
Σoutcome_samples × outcome_score / Σoutcome_samples) and
*peer_benchmark* (mean benchmark_score over the same set).
3. Call ``expected_success_rate`` per row with the benchmark, outcome, and
peer statistics. Write the final ``blended_score`` and ``source``.
"""