Doctors have heard it all. Don't be shy about that. The doctor might be able to get you in with a community service or know about some way to solve this. Go ahead and tell the doctor.
Where I live, we've had 2 elderly people who froze to death on their doorstep after taking a cab from the hospital. The cab drove off and they couldn't open their door. Really. A cab might not be the answer.