Terminal rendering Korean characters as question marks in boxes - terminal

Code is
with open("test.csv", 'a') as csvfile:
writer = csv.writer(csvfile)
for row in pre_list1:
row.decode('utf-8')
print row
I want the question marks to show their true values, essentially. These boxes are supposed to be Korean letters. I am not sure if I have to download a language pack for my terminal. I don't know how though. Thanks!
Here is the locale:

I had to change the system locale from English to Korean.

Related

Why is facepalm emoji 🤦‍♀️ followed by U+200D♀

I am trying to send utf-8 symbols via serial device to browser and display them. I have found out when I print facepalm emoji 🤦‍♀️ (on windows 10 Win+.) it has U+200D and ♀ characters behind. Others emojis don't have that. I was using View non-printable unicode characters tool. Also I found, if you print it in notepad it will show you ♀, when you print it in browser address bar ♀ is invisible but if you press backspace you delete it. And finally, if you print it in some html text input, you can delete whole emoji with single backspace. Why is that?
Emoji sequences have more than one code point to signify variations (below may or may not look different for each sequence depending on browser):
🤦 PERSON FACEPALMING U+1F926
🤦‍♂️ MAN FACEPALMING U+1F926 U+200D U+2642 U+FE0F
🤦‍♀️ WOMAN FACEPALMING U+1F926 U+200D U+2640 U+FE0F
References:
Emoji List, v13.1 No. 260-262.
Full Emoji List, v13.1, No. 260-262 (With browser-specific images)
Unicode® Standard Annex #29, UNICODE TEXT SEGMENTATION
Some editors/browsers handle the sequences better than others and may not show differences in all variations or may not recognize the latest Unicode specfication and newer emojis.

Default value not visible in PdfTextFormField

I am using the code:
textfield.setValue(params.defval);
to set a default value for a PdfTextFormField. When the default value is not Latin characters (e.g. Hebrew or Russian) it only appears when the field has focus. For Latin text it appears always. Any assistance in solving this problem would be greatly appreciated.

Viewing unicode strings in Intellij Idea debugger

How to view Unicode encoded strings in Intellij Idea debugger data view?
e.g. consider following code
String str = "सुझाव"; //some Unicode string: utf-8
String str1 = "\u0938\u0941\u091d\u093e\u0935";
System.out.println(str);
Not able to view the variable- str - in data view of debugger, it shows garbage value.
Even though set value shows proper value.
Any suggestions/work-arounds?
Probably, missing some encoding setting somewhere.
Check project encoding. I have same issue. Idea shows variables content encoding in WIN-1252.
In version in Editor > File Encodigs you have: IDE Encoding, and Project Encoding. After changing Project Encoding to UTF-8 everything looks ok.
The issue is in the debugger font.
Since you can view your unicode string in the code editor it means that everything is good with your symbols and encoding of the file.
A font may not have glyphs for each unicode character. That's the issue. You have different fonts for code editor and debugger. The debugger's font doesn't have glyphs for those symbols. Unfortunately, it turns out you can't change the font of the debugger.
I've just got resolved similar issue: Why Intellij IDEA doesn't display 𝔊 symbol?
blank squares means those characteristics are not supported by your IDE font . change IDE font should solve it (File -> Settings -> Appearance & Behavior -> Appearance)
This should work. I copied your code and I can see your characters in my debugger.
Perhaps your file encoding is wrong - can you look in the lower right edge of your intellij window, does it say UTF-8 or something else?
Alternatively, if you use the operation convert to Basic Latin (position your cursor on the string and use alt-enter), does this work?
String str = "\u0938\u0941\u091d\u093e\u0935"; //some Unicode string: utf-8

Superscript ® in Title bar

I need to insert the ® character as a superscript into the title bar of an app for the iPad. How can this be done in XCode?
As of iOS 5.x, you can't set text attributes like bold, superscript, etc. on individual characters within a label's text. (This includes the builtin labels of navigation bars.)
You can just insert the ® character in your string (you can type it on a US Mac keyboard with option-R, or use the escape code as in Jessedc's answer). Whether it appears small and superscript depends on the font used for the label -- some fonts make that symbol appear as such already, others make it larger and baseline-aligned.
Grab the unicode character
put it in a string
NSString *string = #"\u00AE"; //this is your (r)
Nearly a duplicate of How do I escape a Unicode character in my Objective-C source code?

How to display unicode control characters in visual studio text visualizer?

I get some text string from service, which contains Unicode control characters
(i.e \u202B or \u202A and others for Arabic language support).
But while debugging I can't see them in default text visualizer. So I need to enable display for such characters to determine which of them my text consists of. There is checkbox in text visualizer "show all characters", but it doesn't work as I expect.
Any suggestions?
Thanks in advance
Those are codes for explicit RLE and LRE order, ie if in RLE something should be displayed in LRE order.
http://unicode.org/reports/tr9/#Directional_Formatting_Codes

Resources