Skip to content

[Bug]: CUDA error: device-side assert triggered with long prompts in T2I script #134

@Jaguar156

Description

@Jaguar156

Hello, and thanks for the great work on OmniGen2!

I am trying OmniGen2 example_t2i.sh with custom prompt input. However, I found that when the prompt is too long (e.g. 2k length), it would trigger CUDA error: device-side assert triggered at this line.

This issue appears to be related to a maximum token limit for the input prompts. Could you please provide some guidance on this? Is there a recommended method to handle longer prompts, or is this an inherent limitation of the current model architecture?

Thanks a lot!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions