Why not? It's a popular US holiday spot. I'm not sure I understand why you think you couldn't, but ask at the US embassy or check their website. http://www.usembassy.org.uk/
I understand that during the process of applying for a green card, the person may not leave the United States. Aren't the Bahamas outside the United States?