bug: Assertion failed: (size == length), function deserialize, file src/scanner.c, line 160.

[will]

Did you check existing issues?

• I have read all the tree-sitter docs if it relates to using the parser
• I have searched the existing issues of tree-sitter-c

Tree-Sitter CLI Version, if relevant (output of tree-sitter --version)

I'm not using the cli

Describe the bug

I'm using the 0.23.0 release (commit 66579f) of the ruby treesitter parser. Found this with neovim and first tried reporting it there neovim/neovim#30811 . I put a lldb backtrace there if that's helpful at all.

Steps To Reproduce/Bad Parse Tree

load a file with the contents in Repro section, it will crash with bug: Assertion failed: (size == length), function deserialize, file src/scanner.c, line 160.

Expected Behavior/Parse Tree

not crash

Repro

<<~"BASH
  if the string inside is too short it doesn't crash
  but I haven't found exactly how many chars is the problem

  if the string inside is too short it doesn't crash
  but I haven't found exactly how many chars is the problem

  it needs this line
BASH