Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 17, 2025

• [Doc] Installation.md update (#1830)

  thejishnunair

  authored
  ffdc917

  Copy full SHA for ffdc917

• [Update] Update method to add dataset in docs (#1827)

  Show description for 70da9b7
  Myhs-phz

  authored
  70da9b7

  Copy full SHA for 70da9b7

Commits on Jan 16, 2025

• [Feature] Add support for InternLM3 (#1829)

  Show description for 531643e
  MaiziXiao

  authored
  531643e

  Copy full SHA for 531643e

Commits on Jan 10, 2025

• added predicted win rates reporting to bradley terry subj eval methods with an option to switch between win rates and elo ratings (#1815)

  acylam

  authored
  7f2aeef

  Copy full SHA for 7f2aeef

Commits on Jan 9, 2025

• [CI] Fix path conflict (#1814)

  Show description for 121d482
  zhulinJulia24

  authored
  121d482

  Copy full SHA for 121d482

• [CI] Update daily test metrics threshold (#1812)

  Show description for abdcee6
  

  zhulinJulia24

  and

  MaiziXiao

  authored
  abdcee6

  Copy full SHA for abdcee6

• [Feature] Support MMLU-CF Benchmark (#1775)

  Show description for e039f3e
  

  fistyee

  and

  liushz

  authored
  e039f3e

  Copy full SHA for e039f3e

Commits on Jan 7, 2025

• [Update] Update LiveMathBench (#1809)

  Show description for f1e50d4
  tonysy

  authored
  f1e50d4

  Copy full SHA for f1e50d4

Commits on Jan 6, 2025

• [Update] Update o1 eval prompt (#1806)

  Show description for 8fdb72f
  tonysy

  authored
  8fdb72f

  Copy full SHA for 8fdb72f

Commits on Jan 3, 2025

• [Feature] Add Bradley-Terry Subjective Evaluation method to Arena Hard dataset (#1802)

  Show description for f871e80
  acylam

  authored
  f871e80

  Copy full SHA for f871e80

• [Feature] Add Longbenchv2 support (#1801)

  Show description for 117dc50
  

  MaiziXiao

  and

  abrohamLee

  authored
  117dc50

  Copy full SHA for 117dc50

Commits on Dec 31, 2024

• [BUMP] Bump version to 0.3.9 (#1790)

  MaiziXiao

  authored
  f322043

  Copy full SHA for f322043

• [Feature] Add LiveStemBench Dataset (#1794)

  Show description for 9c980cb
  liushz

  authored
  9c980cb

  Copy full SHA for 9c980cb

• [Fix] Fix generic_llm_evaluator output_path (#1798)

  Show description for fc0556e
  tonysy

  authored
  fc0556e

  Copy full SHA for fc0556e

• [Feature] Added Bradley-Terry subjective evaluation

  acylam

  authored
  dc6035c

  Copy full SHA for dc6035c

Commits on Dec 30, 2024

• [Feature] Update o1 evaluation with JudgeLLM (#1795)

  Show description for 98435dd
  tonysy

  authored
  98435dd

  Copy full SHA for 98435dd

• [Feature] Support G-Pass@k and LiveMathBench (#1772)

  Show description for 8e8d4f1
  jnanliu

  authored
  8e8d4f1

  Copy full SHA for 8e8d4f1

Commits on Dec 27, 2024

• [Update] Add 0shot CoT config for TheoremQA (#1783)

  MaiziXiao

  authored
  42b54d6

  Copy full SHA for 42b54d6

• [Fix] Fix model summarizer abbr (#1789)

  Show description for 357ce8c
  bittersweet1999

  authored
  357ce8c

  Copy full SHA for 357ce8c

• [CI] Pypi deploy workflow update (#1786)

  MaiziXiao

  authored
  ae9efb7

  Copy full SHA for ae9efb7

• [CI] Update deploy python version (#1784)

  MaiziXiao

  authored
  f103e90

  Copy full SHA for f103e90

Commits on Dec 26, 2024

• [ci] remove daily step retry and update pr score (#1782)

  Show description for ebeb578
  zhulinJulia24

  authored
  ebeb578

  Copy full SHA for ebeb578

• [Update] Volc status exception handle (#1780)

  Show description for 56eaac6
  MaiziXiao

  authored
  56eaac6

  Copy full SHA for 56eaac6

Commits on Dec 25, 2024

• [ci] remove testcase into volc engine (#1777)

  Show description for c48bbde
  zhulinJulia24

  authored
  c48bbde

  Copy full SHA for c48bbde

Commits on Dec 19, 2024

• [Update] Update OC academic 202412 (#1771)

  Show description for ebefffe
  MaiziXiao

  authored
  ebefffe

  Copy full SHA for ebefffe

• [Update] Customizable tokenizer for RULER (#1731)

  Show description for d70100c
  changlan

  authored
  d70100c

  Copy full SHA for d70100c

• [Fix] Fix Local Runner Params Save Path (#1768)

  Show description for 4993028
  jnanliu

  authored
  4993028

  Copy full SHA for 4993028

Commits on Dec 18, 2024

• [Fix] Fix lark reporter issue (#1769)

  HAOCHENYE

  authored
  9a5adbd

  Copy full SHA for 9a5adbd

• [ci] add fullbench testcase (#1766)

  Show description for 111f817
  zhulinJulia24

  authored
  111f817

  Copy full SHA for 111f817

• [Fix] Fix Subjective summarizer order error (#1767)

  Show description for 38dba99
  bittersweet1999

  authored
  38dba99

  Copy full SHA for 38dba99

Commits on Dec 17, 2024

• [Bump] Bump version to 0.3.8 (#1765)

  Show description for d593bfe
  MaiziXiao

  authored
  d593bfe

  Copy full SHA for d593bfe

• [Update] Update requirement and deepseek configurations (#1764)

  MaiziXiao

  authored
  eadbdcb

  Copy full SHA for eadbdcb

Commits on Dec 16, 2024

• [Fix] Fix vllm max_seq_len parameter transfer (#1745)

  Show description for 5c8e91f
  

  liushz

  and

  zhulinJulia24

  authored
  5c8e91f

  Copy full SHA for 5c8e91f

• [Feature] Added CompassArena-SubjectiveBench with Bradley-Terry Model (#1751)

  Show description for 1bd594f
  acylam

  authored
  1bd594f

  Copy full SHA for 1bd594f

Commits on Dec 13, 2024

• add new dataset summerizer (#1758)

  Show description for aeded4c
  zhulinJulia24

  authored
  aeded4c

  Copy full SHA for aeded4c

Pagination

Previous

Next