Enterprise+, Proposal Pro, QPilot Essential
QorusDocs does not impose a character limit for prompts, aside from the token per session restriction set by GPT. The restriction will vary based on the AI model used. However, there are specific areas where limitations apply:
- Smart Skill prompts are limited to 25,000 characters.
- AI Text Smart fields allow a maximum prompt size of 25,000 characters.
Due to these limitations, you may occasionally encounter warning or error messages in QPilot related to session token limits. Below, we’ve outlined these messages, their meanings, and step-by-step guidance to help you troubleshoot them effectively.
1. Prompt text and references exceed the maximum word count
2. Your current chat conversation reached the maximum word count
1. Prompt text and references exceed the maximum word count
- Message Displayed: “Prompt failed. Prompt text and references exceed the maximum word count. Reduce the number of words in the prompt and attachments and try again.”
- Cause: This occurs when your latest prompt, including any references, is nearing the maximum session token limit. The token limit includes both the prompt and the response, so if the latest prompt uses up a significant portion of the available tokens, you may encounter this issue.
- Resolution: To address this, consider simplifying or shortening your prompt. Remove unnecessary references or split the prompt into smaller parts. You can also try adjusting the prompt to use fewer tokens, ensuring it remains within the allowable limit.
2. Your current chat conversation reached the maximum word count
- Message Displayed: “This model's maximum context length is 128000 tokens. However, your messages resulted in 502886 tokens. Please reduce the length of the messages.”
- Cause: This occurs when the cumulative tokens used across the entire session, including previous prompts and responses, approach the maximum session token limit. Even if the latest prompt itself is not near the maximum token limit, the accumulated tokens from prior interactions can contribute to reaching the limit.
- Resolution: To resolve this issue, please start a new session. This can be done by ending the current session and beginning a fresh one.
3. Selected document(s) exceed the maximum word count
- Message Displayed: "You have reached the maximum number of selected documents"
- Cause: This issue arises when the number of references selected in the 'Select Documents' dropdown, while creating a new document or presentation with AI Text Smart Fields, has reached its limit.
- Resolution: To address this issue, please run QPilot without adding any additional documents. QPilot will still generate responses using your current set of reference documents.
General Tips
- Break Down Prompts: If you have a complex query, break it down into smaller, more manageable parts. This approach helps reduce token usage and makes it easier to manage session limits.
- Review Prompt Efficiency: Ensure that your prompts are clear and concise. Removing extraneous details can help minimize token consumption.
Comments
Please sign in to leave a comment.