You might also want to consider cost of DR, we haven't included in this cost.

Usually this cost will make sense if you can turn on some instance to do high token usage and turn it off or keep using this for multiple use cases.

Even if you keep it on for 24*7 this will still be at far lower cost then GPT 4 or 3.5 for few use cases.

--

--

Mastering LLM (Large Language Model)
Mastering LLM (Large Language Model)

Written by Mastering LLM (Large Language Model)

MasteringLLM is a AI first EdTech company making learning LLM simplified with its visual contents. Look out for our LLM Interview Prep & AgenticRAG courses.

No responses yet