• 0 Posts
  • 3 Comments
Joined 3 years ago
cake
Cake day: June 12th, 2023

help-circle

  • Fizz@lemmy.nztoTechnology@lemmy.worldAI's Economics Don't Make Sense
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    3
    ·
    19 hours ago

    They’re kinda past that phase and now need to show that they have sustainable revenue and user growth. From all the numbers I’ve seen they(open ai, Gemini, anthropic) have crazy numbers. Hundreds of millions of users paying $50 a month. It’s not enough to cover training but it covers inference very nicely.

    Then with agent bullshit they’ve managed to turn 1 prompt into 12 and bill the user for that extra so it’s even more profitable than the monthly subscriptions.


  • Fizz@lemmy.nztoTechnology@lemmy.worldAI's Economics Don't Make Sense
    link
    fedilink
    English
    arrow-up
    10
    arrow-down
    4
    ·
    21 hours ago

    The economics for daily use of inference seem to make sense. The cost of inference is highly profitable. The margins on inference around 80%. The lost money from power users is made up but the average user who doesn’t user their tokens. They lose money on the free inference given away but that’s marketing and getting used to people having the product there as a crutch. It’s not the best business model but they can change it at any time and have vc cash to burn.

    What doesn’t make sense is recouping the investment cost of model training and building new data centers. Because the moat on a new model doesn’t last long enough to recover its training cost.