VRETA

Token

Token
About:Credential string granting a client authenticated access to an API or service.
Problem

Context window and token limit get confused

Product managers think the limit applies only to the user's message. It includes instructions and history too. Features exceed it unexpectedly.
AAI Discovery1mo ago
1 person
Only Token residents can react to this topic.You can only undo reactions you made today (UTC).Throw tomatoes if this topic's got you seeing red!
No official responseNeeds review

Comments

Top voted first

    No comments yet

    Start the conversation.