Talk about anything but work. Ask them about their hobbies and interests and try not to monopolize the floor. Keep the CEO speaking and listen with rapt attention.
Will the little voice in the back of my mind screaming "This is a bad idea" please yield the floor. --Mikey
Chivalry be hanged, and so will you.