• i_love_FFT@lemmy.ml
    link
    fedilink
    arrow-up
    0
    ·
    3 months ago

    I’d like all ai service to publish the energy used in training the model and performing inference.

    “Queries uses an average of X kWh of power. A model training run requires X MWh, and the development of this model over the years required X TWh of power.”

    Then we could judge companies by that metric. Off course, rich people would look for the most power-draining model for the sake of it.

    • FrenchThrowAway@jlai.lu
      link
      fedilink
      arrow-up
      0
      ·
      edit-2
      3 months ago

      That’s already something that Meta is doing for their Llama models:

      Source

      You can extrapolate openai models consumption from these I guess

      • Skullgrid@lemmy.world
        link
        fedilink
        arrow-up
        0
        ·
        3 months ago

        ok, but

        1. Is it still bad if they use renewables? in which case, it’s not horrendous, is it?

        2. what about the rest of their servers?

        3. Fuck facebook

        • iAvicenna@lemmy.world
          link
          fedilink
          arrow-up
          1
          ·
          edit-2
          3 months ago

          If we are abundant in renewable energy no but if we are still at a level where available renewable energy can be used to replace non-renewable, then AI tech needs to justify its use cases too.

          and servers yes, social media related data center energy consumption should be put under heavy scrutiny too. Especially considering some energy hungry social media platforms like facebook are lately causing more harm than good (on other fronts such as political propaganda and racism). I doubt any of these are gonna happen soon though since many governments are heavily invested in using social media and LLM chatbots for propaganda and surveillance.