vertex color works only great on high resolution mesh,
more vertex better and crisp results .
But that mean increase mesh density , that is not the goal of handy animtion objects and certainly not for game assets.
Therefore you need bake your vertex color into a uv based texture .