All pull requests

Pull requests

• feat: Add least_con_sticky policy for more even loads on vLLM instances

  #306·nikonyrh-siloai opened Sep 23, 2026·

  ·

• fix(validation): reject top_p = 0

  #303·git-jxj opened Sep 23, 2026·

  ·
  1

  1

• [Bugfix][Protocol] Preserve model-specific chat message roles

  #301·lio1226 opened Sep 23, 2026·

  ·
  1

  5

• fix: remove empty response user indexes after deletion

  #300·git-jxj opened Sep 22, 2026·

  ·
  1

• feat(policies): add request-scoped preprocessing context

  #297·yigitcan-ozturk opened Sep 22, 2026·

  ·
  5

• fix: keep response user index consistent on overwrite

  bug
  #292·RainieLLM opened Sep 19, 2026·

  ·
  1

  1

• Fix consistent hash virtual_nodes configuration

  bug
  #291·RainieLLM opened Sep 19, 2026·

  ·
  1

• bench: add router CPU fast-path baseline harness

  enhancement
  #290·jiannan-17 opened Sep 18, 2026Contributor·

  ·
  8

• fix: clean worker indexes on re-registration

  bug
  #289·DatenpflegeNordHL opened Sep 18, 2026·

  ·
  1

• fix: count Unicode characters in logprob offsets

  bug
  #288·DatenpflegeNordHL opened Sep 18, 2026·

  ·
  1

• fix: advance sequence read offset after append_text

  bug
  #287·DatenpflegeNordHL opened Sep 18, 2026·

  ·
  1

• feat: send Retry-After with the rate-limit 429

  enhancement
  #281·areslp opened Sep 16, 2026·

  ·
  1

• fix: hold the concurrency slot for the whole streaming response

  bug
  #280·areslp opened Sep 16, 2026·

  ·
  4

• [Bugfix] Reject NaN in config validation for lower-bound floats

  bug
  #278·itu-itis24-iyigun24 opened Sep 15, 2026·

  ·
  1

  1

• fix(protocols): make tool function parameters optional

  bug
  #277·jabdoa2 opened Sep 15, 2026·

  ·
  1

• fix: report initial health for registered workers

  bug
  #274·jiangwu25 opened Sep 14, 2026Contributor·

  ·
  1

  3

• [Feature] Add EPD routing with JSON metadata

  enhancementomni-modality
  #266·gty111 opened Sep 10, 2026·

  ·
  12

• [Bugfix] Respect explicit token acquisition timeout

  bug
  #248·LOGO127 opened Sep 8, 2026·

  ·
  1

  5

• [Bugfix] Forward session headers to consistent-hash routing in PD discovery mode

  bug
  #243·simondanielsson opened Sep 7, 2026Contributor·

  ·
  5

• [Feature] Unify cache aware routing for PD/DP routers

  enhancement
  #242·simondanielsson opened Sep 7, 2026Contributor·

  ·
  5

• Spread stateless consistent-hash requests across healthy workers

  enhancement
  #240·rawsh opened Sep 4, 2026·

  ·
  6

• feat: cache aware per request affinity

  enhancement
  #238·sdevare-nv opened Sep 4, 2026·

  ·
  2

• [Bugfix] Content-aware routing should work with token ids

  bug
  #237·simondanielsson opened Sep 3, 2026Contributor·

  ·
  11

• feat(router): add sticky least-loaded session routing

  enhancement
  #235·bvolpato opened Sep 3, 2026·

  ·
  4

• fix: skip unhealthy workers in proxy GET endpoints

  bug
  #232·Bevisy opened Sep 2, 2026Contributor·

  ·
  1

  6