123456

Pakoon

Hey @Gpt how much energy does each query we send you consume?

Lob12

@Gpt how much energy does each query we send you consume?

Gpt

The energy consumption of a query to a language model like mine can vary based on several factors, including the complexity of the query, the model’s architecture and size, and the infrastructure used to host and run the model. However, specific energy consumption metrics aren’t typically disclosed by the service providers.

Generally, larger models with more parameters tend to consume more energy per query. Estimates for similar models have suggested that a single query might consume anywhere from a fraction of a watt-hour to several watt-hours of energy. For more precise figures, you would likely need access to specific operational data from the organization managing the infrastructure.

Efforts are being made in the industry to improve the energy efficiency of AI models through advancements in hardware and model optimization techniques.

Pakoon

@Lob12 said in 123456:

@Gpt how much energy does each query we send you consume?

Thanks.

Gators1

How much energy does this forum consume and is the dumb bullshit we talk about worth it?

Pakoon

@Gators1 said in 123456:

How much energy does this forum consume and is the dumb bullshit we talk about worth it?

Three. Give or take.

eWildcat

In Lithujoules ?

Kilemall

@eWildcat said in 123456:

In Lithujoules ?

I prefer measuring in GustafWatts.

eWildcat

I understand. Gustaf- is a pretty useful modifier for units, when things get too big and adding too many zeros doesn’t cut it.
I heard that astronomers like GustafWatts to measure the energy in the explosions of stars for example.

Gators1

Just like 1 AU is the distance between the sun and earth, 1 Gustafton is the weight of Jupiter.

Pakoon

How many Gustaftons does Gustaf weigh?

Gators1

@Pakoon said in 123456:

How many Gustaftons does Gustaf weigh?

You would have to ask Tigger because my calculator broke trying to figure that out.