ThursdAI - The top AI news from the past week cover image

πŸ”₯ πŸ“… ThursdAI - Sep 12 - OpenAI's πŸ“ is called 01 and is HERE, reflecting on Reflection 70B, Google's new auto podcasts & more AI news from last week

ThursdAI - The top AI news from the past week

NOTE

Transparency in Token Billing

Reasoning tokens, which are integral to the model's processing, remain invisible within API responses, yet they still consume resources in the model's context window and contribute to the billing as output tokens. This lack of visibility leads to users indirectly paying for a component of the process that is not clearly delineated, contrasting with previous systems that provided explicit categorization of token types. Clarity in how these tokens are utilized and billed can improve user understanding and expectations regarding costs and system functionality.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner