All pull requests

Pull requests

• Fix AttributeError when scoring dictionary-form code-execution results

  #164·designguruin opened Oct 23, 2026·

  ·

• Add opt-in Bayes@N summaries to score reporting

  #162·mohsenhariri opened Oct 20, 2026·

  ·
  1

• Fix binary stdin and stdout handling in the code-generation judge

  #161·mantuoluozk opened Sep 30, 2026·

  ·
  1

• [Bug] Fix setuptools packaging: include all lcb_runner subpackages

  #156·PharosEast opened Sep 11, 2026·

  ·

• Honor start_date/end_date and release_version on every loader path

  #154·AUTHENSOR opened Sep 5, 2026·

  ·
  1

• Add GraniteInstruct prompt style and Granite 3.3 instruct models

  #152·DrStranded opened Sep 3, 2026·

  ·

• Allow overriding the gated Llama-3 tokenizer used for the LLaMa3 prompt style

  #151·DrStranded opened Sep 3, 2026·

  ·

• fix: double BOS in llama3 prompts with vLLM

  #146·samuki opened Jun 11, 2026·

  ·

• fix: broken readme link

  #135·CoderUni opened Nov 27, 2025·

  ·

• accept output if no backticks as well

  #127·roshansridhar opened Oct 14, 2025·

  ·

• Added precise python backtick check

  #118·RiddleHe opened Aug 12, 2025·

  ·
  1

• Default stop flag to None

  #117·RiddleHe opened Aug 12, 2025·

  ·
  3

• Update code_generation.py for livecodebench/code_generation_lite

  #110·lhoestq opened Jul 16, 2025·

  ·
  1

• Fix: memory explosion issue

  #103·sijieaaa opened Jun 18, 2025Contributor·

  ·
  5