The private equity pioneer died of a self-inflicted gunshot wound in his Manhattan office, local media reports.