Don't let mBufferSize fall out of sync with the actual buffer size.  Pervents unnecessary buffer re-creations.

Change-Id: Ie40300865dcd7830fe8eafbccfaa3edad46c7b52