When you address an envelope in what language do you put the country's name?

I want to send a letter from USA to Czech Republic, Croatia, and Ghana. On the envelope do I write the country in english? I'm so confused. And will the post office send my letter to these countries? Will they send my letter to all "exotic" countries?