Meta’s Adam Mosseri says AI token budgets could soon be capped per engineer
Instagram head Adam Mosseri believes companies will eventually need to manage AI token spending the same way they manage payroll or other operating expenses, predicting that engineers could soon face limits on how much they spend using AI tools.
Get smart on it
AI token spend refers to the cost of processing AI prompts and responses, which has become expensive enough that major tech companies are rethinking their approach to AI experimentation. Meta recently shut down an internal leaderboard tracking employee AI spending after costs put the company on track for billions of dollars, and other companies like Uber and Microsoft have similarly faced unexpected AI budget overruns. According to Meta's head of Instagram, the company may need to implement per-engineer caps on AI token budgets within a year or two, similar to how other resources like payroll and operating expenses are currently managed. These caps would be proportional to each engineer's ability to use the budget in a way that generates positive return on investment.
Related news
OpenAI may announce a ChatGPT smart speaker this year
OpenAI's first device is set to be a smart speaker that lets you talk with ChatGPT, according to a report from Bloomberg. The device apparently won't have a screen, but will use a camera and additional sensors to "understand" your environment. The report comes just days after Apple filed a lawsuit against OpenAI that accused the AI company of stealing hardware secrets. OpenAI, in a new statement on Tuesday, said that it is "not aware of any evidence that this complaint has meri
OpenAI’s first hardware device is reportedly a screenless speaker that can move
The device is weirdly described as involving "mechanical elements that can move on their own" and the Bloomberg report includes the detail that the device is designed to "feel like a companion and become a physical manifestation of OpenAI’s ChatGPT."
