Encoding 'utf-16' is not consistent when convert lisp string from/to C string -


i find when use 'utf-16' encoding convert lisp string c string cffi, actual encoding used 'utf-16le'. but, when convert c string lisp string, actual encoding used 'utf-16be'. since i'm not familiar 'babel' yet (which provides encoding facility 'cffi'), i'm not sure whether that's bug.

(defun convtest (str to-c from-c)   (multiple-value-bind (ptr size)       (cffi:foreign-string-alloc str :encoding to-c)     (declare (ignore size))     (prog1         (cffi:foreign-string-to-lisp ptr :encoding from-c)       (cffi:foreign-string-free ptr))))  (convtest "hello" :utf-16   :utf-16)     ;=> garbage string (convtest "hello" :utf-16   :utf-16le)   ;=> "hello" (convtest "hello" :utf-16   :utf-16be)   ;=> garbage string (convtest "hello" :utf-16le :utf-16be)   ;=> garbage string (convtest "hello" :utf-16le :utf-16le)   ;=> "hello"

the `convtest' convert lisp string c string lisp string, `to-c', `from-c' encoding. output garbage string same. test see if use 'utf-16' `to-c' , `from-c' @ same time, conversion failed.

here encoding to-c assumes little endian (le) default. from-c has big-endian default (be).

the platform (x86) little endian. utf-16 prefers big endian or takes information byte-order mark.

this depends on platform running on? platforms seem have different defaults.

best source code, why encodings chosen. may ask on cffi mailing list encoding choices , how depend on platform, if @ all.


Comments

Post a Comment

Popular posts from this blog

javascript - Google App Script ContentService downloadAsFile not working -

i have web app developed using google app script htmlservice , html form, populating excel sheet in google drive using spreadsheetapp . , 1 section calling contentservice download data excel file. function doget(e) { // read excel sheet //getappfile(); // render application html template return htmlservice.createtemplatefromfile('index').evaluate() .settitle('go smart') .setsandboxmode(htmlservice.sandboxmode.iframe); } function downloaddoublequatecsvfile() { var sheetid = propertiesservice.getscriptproperties().getproperty('sheetid'); var ss = spreadsheetapp.openbyid(sheetid).getactivesheet(); //var ss = spreadsheetapp.getactivespreadsheet().getactivesheet(); var maxcolumn = ss.getlastcolumn(); var maxrow = ss.getlastrow(); var data = ss.getrange(1, 1, maxrow, maxcolumn).getvalues(); if (data.length > 1) { var csv = ""; (var row = 0; row < data.length; row++) { (var c...
Read more

javascript - Function overwritting -

is there way overwrite function or event handling in function? using addeventlistener, can have many event handlers on element want var test=document.getelementbyid("div"); test.addeventlistener("click",function(){alert("im first");},false); test.addeventlistener("click",function(){alert("im second");},false); // alerts "im first" , after "im second" but if want overwrite function/event example based on client width example this function one() { alert("first"); } function two() { alert("second"); } window.onresize = function() { var test = document.getelementbyid("div"); if (window.innerwidth > 500) { test.onclick = 1 } else { test.onclick = two; } } is possible in javascript? in case use effective little known approach. addeventlistener can accept object property handleevent event handler. in case it's easy overwr...
Read more

php - Find a regex to take part of Email -

i have following emails need extract part from: bestellnummer xxx: 1 von xxx, 1er pack ------------- anfang der nachricht ------------- foo bar baz foo bar baz // <<<<< need text here ------------- ende der nachricht ------------- ------------- anfang der nachricht ------------- foo bar baz foo bar baz ------------- ende der nachricht ------------- there 0 unlimited occurences of ------------- anfang der nachricht ------------- ------------- ende der nachricht ------------- and i'm able extract first part regex: $re = "/------------- .*? -------------.?(.*?).?------------- .*? -------------/s"; but, i'm quite new on learning regex, i'm pretty sure there must better regex extract part (foo bar baz foo bar baz) of text between ------------- anfang der nachricht ------------- ------------- ende der nachricht ------------- as can in different languages, i'm using .? to match between hyphens. i...
Read more