Oct 15, 2024
Yes it is, this is an approximate formula & doesn't consider parameters like context size, number of users, model architecture etc.
There are calculators to calculate exact required GPU for a model.
Written by Mastering LLM (Large Language Model)
MasteringLLM is a AI first EdTech company making learning LLM simplified with its visual contents. Look out for our LLM Interview Prep & AgenticRAG courses.