Ask Sage Tokens
In this section, we will provide a comprehensive overview of tokens and their usage within the Ask Sage platform. Understanding the concept of tokens is crucial, as they serve as the primary means of accessing the platform and function as its currency.
Table of contents
What is a Token?
In the context of Generative Artificial Intelligence (GenAI), a token represents a unit of text that the model processes. Tokens can vary in length, ranging from a single character to an entire word, depending on the language and the model’s implementation. For instance, in English, common words like “cat” or “dog” are typically counted as single tokens, while punctuation marks and spaces are also treated as individual tokens. The model utilizes these tokens to generate, understand, and manipulate text.
For users of Ask Sage, tokens are allocated based on their subscription plan. These tokens can be used to access various platform features, such as training models and making inferences.
What is a token?
Click to see the answer
A token is approximately 3.7 English characters. The token count includes both the prompt and the response provided by Ask Sage.What are Ask Sage Tokens?
Ask Sage tokens are unique in that they are model-agnostic and serve as the central currency for interacting with the Ask Sage platform. These tokens enable users to access and utilize any model on the platform without additional effort or extra costs. Consequently, Ask Sage tokens are consumed based on the type of operation performed, such as training a model or making an inference. It is important to note that each model consumes tokens differently, depending on its complexity and the amount of data processed.
Also, Ask Sage tokens are divided into two categories:
-
Inference Tokens -
Training Tokens
Ask Sage provides users with a seamless experience and flexibility by offering a unified
tokensystem that can be used across all models on the platform. This simplifies the process of managingtokensand ensures a consistent user experience across different models as it pertains totokenusage.
As a reminder users can view their token usage and manage their subscription plans through the Tokens tab, users can view their token information and manage their tokens.
- Subscription: Users can see the subscription they are on.
- Inference Tokens: Users can see the number of inference tokens they have used and have left.
- Training Tokens: Users can see the number of training tokens they have used and have left.
Tokens replenish automatically on the first day of each month. Users can also purchase additional tokens if needed.
Ask Sage Inference Tokens
Ask Sage Inference Tokens are used to make predictions or inferences using the models available on the platform. These tokens are consumed when users submit prompts, use the plugins/agents to generate responses, or interact with the models in any way that requires processing text data. The consumption of inference tokens is based on the complexity of the model and the amount of data processed during the inference process.
Inference tokens are limited by the user’s subscription plan, and users can monitor their token usage in the Ask Sage platform. This feature allows users to track their token consumption and manage their usage effectively.
Users can purchase additional inference tokens if they exceed their allocated limit or require more tokens for their tasks. This flexibility ensures that users can continue to use the platform without interruptions or restrictions.
Inference tokens are not transferrable between months, so it is essential for users to utilize their tokens effectively within the allocated time frame.
Inference tokens cost varies based on the model. As well it’s important to note that the what information is being processed via a prompt has a different cost rate than the response generated by the model.
Ask Sage Training Tokens
Ask Sage Training Tokens are used to create training datasets in the Ask Sage platform. These tokens are consumed when users upload data to a dataset. Note that training tokens cost less than inference tokens, as training tokens are used to create datasets and not to make predictions. The consumption of training tokens is based on the size of input data (i.e., files, text) that is uploaded to the platform for training purposes.
Similar to inference tokens, training tokens are limited by the user’s subscription plan, and users can monitor their token usage through the Token/Subscription window in the Ask Sage platform. This feature allows users to track their token consumption and manage their usage effectively.
Training tokens are not transferrable between months, so it is essential for users to utilize their tokens effectively within the allocated time frame. Additionally, training tokens cost $0.80 per 1 Million training tokens.
Token Refill and Subscription Plans
If you are associated with a Enterprise plan and not an Admin, reach out to your Admin for more tokens. The information below is primarily for individual users.
Ask Sage offers users the flexibility to refill their tokens or upgrade their subscription plans based on their requirements. Users can purchase additional tokens or switch to a higher subscription tier to access more tokens and features. This ensures that users have the resources they need to work efficiently and effectively on the platform.
Additionally, Ask Sage tokens replenish automatically on the first day of each month, providing users with a fresh allocation of tokens to use for the month. This feature ensures that users can continue to use the platform without interruptions and plan their tasks accordingly.
Tokens do not transfer from one month to another, so it is essential for users to utilize their tokens effectively within the allocated time frame.