We report the detailed optical properties of Cd3As2 crystals in a wide parameter space: temperature, magnetic field, carrier concentration, and crystal orientation. We investigate high-quality crystals synthesized by three different techniques. In all the studied samples, independently of how they were prepared and how they were treated before the optical experiments, our data indicate conspicuous fluctuations in the carrier density (up to 30%). These charge puddles have a characteristic scale of 100 μm, they become more pronounced at low temperatures, and possibly, they become enhanced by the presence of crystal twinning. The Drude response is characterized by very small scattering rates (∼1 meV) for as-grown samples. Mechanical treatment, such as cutting or polishing, influences the optical properties of single crystals, by increasing the Drude scattering rate and also modifying the high-frequency optical response. Magnetoreflectivity and Kerr rotation are consistent with electronlike charge carriers and a spatially nonuniform carrier density.