All pull requests

Pull requests

• fix: preserve sequence offsets in unpooled batched embeddings

  #2395·linjiaye929 opened Oct 31, 2026·

  ·

• docs: explain shared Llama instance concurrency

  #2394·karthiksenv opened Oct 29, 2026·

  ·

• docs(server): explain streaming request interruptions

  #2391·original4422 opened Oct 26, 2026·

  ·

• feat: improve server robustness, context manager support, and fix windows dll handling

  #2390·SiddardhaShayini opened Oct 22, 2026·

  ·

• fix(tokenizer): honor add_bos in HF tokenization

  #2389·dajiaohuang opened Oct 21, 2026·

  ·
  1

• fix: resize detokenization buffer for long token pieces

  #2388·grinder81 opened Oct 21, 2026·

  ·

• fix(embed): respect physical batch limits for non-causal embeddings

  #2387·original4422 opened Oct 17, 2026·

  ·
  1

• fix(server): accept max_completion_tokens in chat requests

  #2386·laulauraluo opened Oct 15, 2026·

  ·
  1

• fix: respect CPU affinity and cgroup CPU quota for default thread counts

  #2385·manunicholasjacob opened Oct 14, 2026·

  ·

• fix: correctly size Llama.scores when draft_model implies logits_all

  #2384·yadukpb opened Oct 13, 2026·

  ·

• fix: retain end-of-generation token logprobs

  #2383·Kumar-Abhimanyu opened Oct 13, 2026·

  ·
  1

• Bump llama.cpp to 4fbc76dec51d0add466f0210855c0596589b60d4

  #2382·jamesbiederbeck opened Oct 12, 2026Contributor·

  ·
  1

• feat(llama): add CPU MoE offloading support

  #2381·Madrawn opened Oct 10, 2026·

  ·

• fix(server): preserve delimiters in string metadata overrides

  #2380·allenflux opened Oct 9, 2026·

  ·

• fix(ci): prevent corrupted Metal wheel releases

  #2379·provoke210 opened Oct 4, 2026·

  ·

• fix: support unconstrained array item schemas

  #2378·tuanzirwar opened Oct 1, 2026·

  ·

• fix(grammar): preserve distinct JSON Schema reference identities

  #2377·Metis-dot opened Oct 1, 2026·

  ·

• fix(chat): stop Qwen generation on the turn-end token

  #2374·SashaMIT opened Sep 27, 2026·1 task done·

  ·

• fix(llama): mark seven llama_sampler_init_* bindings positional-only

  #2372·Belal0066 opened Sep 22, 2026·

  ·
  1

• fix: respect GGML_METAL=OFF on macOS

  #2370·provoke210 opened Sep 22, 2026·

  ·
  1

• fix(grammar): decode JSON Pointer escapes in schema references

  #2368·YaoxinHuang opened Sep 21, 2026·

  ·

• Add top probabilities to the output

  #2365·Dakantz opened Sep 5, 2026·

  ·

• fix: stop silently swallowing unknown Llama kwargs; --rpc_servers is a no-op (#2210)

  #2364·Anai-Guo opened Sep 5, 2026Contributor·

  ·
  1

• fix(llama): grow the detokenize buffer when a token piece exceeds 32 bytes

  #2363·Anai-Guo opened Sep 4, 2026Contributor·

  ·
  1

• chore(deps): bump docker/login-action from 4 to 4.5.2

  dependenciesgithub_actions
  #2351·dependabot[bot] opened Jul 30, 2026Bot·

  ·