I have adjusted the color of various parts of my model using the Diffuse color for the material settings tab. When i export my Unity 3D Fbx its not getting baked into the diffuse map.  Can I get some help in understanding better how to do that?  
Below you can see the diffuse map is black and white and I'm adding color to the shirt using the Diffuse color picker box.  It exports the diffuse map as is , just black and white.