We’re all so desperate to get away. But were our summer trips as good as we remember? Famous travellers tell their sorry tales