Depth extraction is an important aspect of three-dimensional (3D) image processing with digital holograms and an essential step in extended focus imaging and metrology. All available depth extraction techniques with macroscopic objects are based on variance; however, the effectiveness of this is object dependent. We propose to use disparity between corresponding points in intensity reconstructions to determine depth. Our method requires a single hologram of a scene, from which we reconstruct two different perspectives. In the reconstruction the phase information is not needed, which makes this method useful for in-line digital holography. To our knowledge disparity based 3D image processing has never been proposed before for digital holography.