We present the initial results of a novel technique that uses only phase information from a digital hologram for the reconstruction of three-dimensional (3D) objects. Our holograms are created using phase-shift digital holography. Perspectives of the 3D object are usually reconstructed numerically on a computer. For large holograms this can be a computationally intensive task. We believe that the proposed reconstruction technique is promising for 3D display because the phase-encoded digital holograms admit optical, and therefore realtime, reconstructions that use commercially available display devices such as liquid crystal spatial light modulators. Numerical evaluation of the reconstructed 3D object and an experimental demonstration are presented.