From the tip of the Mumbai peninsula take an hour boat ride to nearby Elephanta Island where you will visit Buddhist and Hindu rock cut cave temples. While you can see more impressive caves near Aurangabad, these will certainly impress you on your first exposure to India.
The caves are about a km walk from the boat dock (past a bunch of stall selling stuff – or take the small toy train. Beware of aggressive monkeys along the trail.