To quote: "Public Mobile here. Sorry, we do not offer text messaging outside of Canada" I thought it had to do with the fact that I didn't have the APN settings set up, but when I got those in, it still didn't want to work. I haven't really tested it...
It took my phone about three hours to be properly functional. Until then, I got messages saying that I wasn't in the country, but they seem to have ceased.