A three-dimensional (3D) object reconstruction technique that uses only phase information of a phase-shifting digital hologram and a phase-only spatial-light modulator is proposed. It is well known that a digital hologram can store both amplitude and phase information of an optical electric field and can reconstruct the original 3D object in a computer. We demonstrate that it is possible to reconstruct optically 3D objects using only phase information of the optical field calculated from phase-shifting digital holograms. The use of phase-only information enables us to reduce the amount of data in the digital hologram and reconstruct optically the 3D objects using a liquid-crystal spatial light modulator without optical power loss. Numerical evaluation of the reconstructed 3D object is presented.