Nov 9, 2023
You might also want to consider cost of DR, we haven't included in this cost.
Usually this cost will make sense if you can turn on some instance to do high token usage and turn it off or keep using this for multiple use cases.
Even if you keep it on for 24*7 this will still be at far lower cost then GPT 4 or 3.5 for few use cases.