使用BMCook对GLM 10B模型压缩提速推理 #6

Open

opened

on Aug 26, 2022

你好，请问BMCook支持对GLM等大模型的模型压缩，提高推理速度吗？

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests