Skip to content

Decrease model inference time #3

@Chintan2108

Description

@Chintan2108
  • Currently the sentence pair similarity algorithm uses the pre-trained model of 3 million vectors, and the inference time of the model for a single pair instance is around 1000ms which is too high
  • Perform quantitative analysis and subset the model vectors to decrease the inference time and increasing the sentence grouping accuracy

Metadata

Metadata

Assignees

No one assigned

    Labels

    SLoP-150SLoP Level 4 IssueenhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions