This is typically the job of the congestion control and the application constraints set by the developer. Dynamic Frame rate control is just one tool in the congestion control toolbox and works only for small frame sizes (typically thumbnails), which perhaps is fine for Hangout-ish large conference with one or two active speakers.

But there are other use-cases where doing dynamic frame rate wont be sufficient.