Minister Tripathi had indicated the middlemen as ‘powerful ghosts’