Code

WIP: Final eval#46

Code

Closed

sallyom wants to merge 9 commits intoopendatahub-io:mainopendatahub-io/ilab-on-ocp:mainfrom sallyom:final-evalsallyom/ilab-on-ocp:final-evalCopy head branch name to clipboard

+1,062-246

Commits

Commits on Oct 6, 2024

• add final eval: mmlu_branch, mt_bench_branch

  Show description for 2ee2573
  sallyom

  committed
  2ee2573

  Copy full SHA for 2ee2573

• update sdg faked fixtures with knowledge

  Show description for 7ebfc43
  sallyom

  committed
  7ebfc43

  Copy full SHA for 7ebfc43

• add helper functions

  Show description for 94b54a3
  sallyom

  committed
  94b54a3

  Copy full SHA for 94b54a3

• update mtbench-evaluator

  Show description for 9cf4672
  sallyom

  committed
  9cf4672

  Copy full SHA for 9cf4672

• add taxonomy to mock sdg & typo

  Show description for 83e6bc0
  sallyom

  committed
  83e6bc0

  Copy full SHA for 83e6bc0

• add max_workers back

  Show description for 209c9d6
  sallyom

  committed
  209c9d6

  Copy full SHA for 209c9d6

• add base_model_name and update branch outputs

  Show description for 9969a18
  sallyom

  committed
  9969a18

  Copy full SHA for 9969a18

• update from rebase

  Show description for 180c20c
  sallyom

  committed
  180c20c

  Copy full SHA for 180c20c

• ruff format standalone.py

  Show description for c9a807c
  sallyom

  committed
  c9a807c

  Copy full SHA for c9a807c