Ask Sage Tokens
Your gateway to AI-powered insights and data processing
📑 Table of Contents
What is a Token?
In the context of Generative Artificial Intelligence (GenAI), a token represents a unit of text that the model processes. Tokens can vary in length, ranging from a single character to an entire word, depending on the language and the model's implementation.
💡 Quick Quiz: What is a token?
A token is roughly equivalent to 3.7 English characters.
Token Counting
The total token count encompasses both the user's prompt and the model's response. For instance, if a user submits a prompt that is 10 tokens long and the model generates a response of 20 tokens, the overall token count for that interaction would be 30 tokens.
- The cost of tokens can vary depending on the model used
- Token costs in the prompt and response may differ
- Users should monitor their token usage to manage costs effectively
Example Interaction
- The user prompt consists of 7 tokens
- The model's response consists of 8 tokens
- The total interaction uses 15 tokens
- Be mindful of the token costs, as they can vary by model
- The cost of tokens in the prompt and response may differ
What are Ask Sage Tokens?
Ask Sage tokens are unique in that they are model-agnostic and serve as the central currency for interacting with the Ask Sage platform. These tokens enable users to access and utilize any model on the platform without additional effort or extra costs.
token system that can be used across all models on the platform. This simplifies the process of managing tokens and ensures a consistent user experience across different models. Managing Your Tokens
Users can view their token usage and manage their subscription plans through the Tokens menu/settings tab. Here, they can access detailed information about their tokens.
- Subscription: View your current subscription plan
- Inference Tokens: Check the number of inference tokens used and remaining
- Training Tokens: Check the number of training tokens used and remaining
Enterprise plan and not an Admin, reach out to your Admin for more tokens. Ask Sage Inference Tokens
Ask Sage Inference Tokens are used to make predictions or inferences using the models available on the platform. These tokens are consumed when users submit prompts, use the plugins/agents to generate responses, or interact with the models in any way that requires processing text data.
inference tokens if they exceed their allocated limit or require more tokens for their tasks. This flexibility ensures that users can continue to use the platform without interruptions or restrictions. Inference tokens are not transferrable between months, so it is essential for users to utilize their tokens effectively within the allocated time frame. Inference tokens cost varies based on the model. The information being processed via a prompt has a different cost rate than the response generated by the model. Ask Sage Training Tokens
Ask Sage Training Tokens play a pivotal role for users interested in enhancing their experience with the Retrieval-Augmented Generation (RAG) feature. These tokens are primarily used for creating and populating datasets.
datasets, but note that the data sources ingested into a workbook use training tokens for the initial ingestion process. However, once the data is in the workbook, and users perform actions on the data, it will use inference tokens for any subsequent actions. training token usage is essential. Token Refill and Subscription Plans
Enterprise plan and are not an Admin, please contact your Admin for additional tokens. The following information is primarily intended for individual users. Ask Sage provides users with the option to refill their tokens or upgrade their subscription plans according to their needs. Users can purchase extra tokens or move to a higher subscription tier for increased access.
Tokens do not carry over from one month to the next, so it is crucial for users to make the most of their tokens within the designated time frame.