Outputting UTF-16 text files from SS?

Hi everyone,

I'm in the process of scraping information from a European website, which means I have to handle and correctly output diacritical marks (accents, umlauts, etc.).

While I found a way to handle the diacritical marks via the unescapeHtml function in Apache's useful StringEscapeUtils class (org.apache.commons.lang.StringEscapeUtils), I need to encode the resulting text file in UTF-16 so it can be correctly interpreted by Excel. (Don't ask...there's an bug in earlier versions of Excel where XL can't correctly interpret text files encoded in UTF-8 but can do those encoded in UTF-16)

Although I've tried the following, the text file that is output by SS doesn't look like it is :
- My 'write script' includes the line: OutputStreamWriter out = new OutputStreamWriter(new FileOutputStream(session.getVariable( "OUTPUT_FILENAME"), true),"utf-16");
(where OUTPUT_FILENAME is the name of the text file)
- the default Character set on my settings page is set to UTF-16
- the default font is set to Lucidia Sans Unicode.

Any ideas on how I can check whether the text file generated by SS is actually UTF-16 vs. UTF-8? (outside of opening it in Excel, that is)

Thanks!
Justin

Please Ignore - - Problem is in Excel

Sorry - I discovered that SS is outputting the diacritical marks properly, but Excel was refusing to see it when I opened it a particular way. I changed the way I opened this file and Excel and the diacritical marks now appear properly in the spreadsheet.

Thanks!
Justin