Low dust emissivities and radial variations in the envelopes of Class 0 protostars: Possible signature of early grain growth