Hello,
I need to apply URL encoding on a text (see: //http://www.blooberry.com/indexdot/html/topics/urlencoding.htm).
I know I can use several
Thank you!
Ok, after some investigation, I found this:
It works. But is there a better way?
New version!
In this case you don't need to put replaced symbols in two different places:
Look for the title "URL encode and decode " on this page:
http://www.newlisp.org/index.cgi?page=Code_Snippets
you also have to encode special characters and spaces.
The "Code Snippets" page is also accessible from here:
http://www.newlisp.org/index.cgi?Tips_and_Tricks
//http://static.artfulcode.net/newlisp/web.lsp.html ?
In the Code Snippets example:
(replace "+" str " ") ; optional
(replace "%([0-9A-F][0-9A-F])" s (char (int $1 0 16)) 1))
should be
(replace "+" str " ") ; optional
(replace "%([0-9A-F][0-9A-F])" str (char (int $1 0 16)) 1))
in which 's' in the second replace is changed to 'str'.
-- Sam
I spent quite a while on the UTF8 urlencoding decoding stuff in Dragonfly, because all of the newLISP code I had seen previously was "doing it wrong." If I recall correctly, they weren't properly converting characters that took 3 or more bytes (or was it 4?) to represent in UTF8, and because of that failing to properly encode and decode many (if not all) Asian characters.
I think I came up with the fastest solution possible without resorting to native code, and unlike the examples above, it should handle the entire Unicode range of characters. If you can think of any improvements let me know and I'll incorporate them into Dragonfly!
Taken from dragonfly-framework/lib/request.lsp:
(constant 'REGEX_HEX_ENCODED_CHAR (regex-comp {%([0-9A-F][0-9A-F])} 1))
(define (hex-encode-str str , cnvrt)
(setf cnvrt (dup "%%%X" (length str)))
(eval (append '(format cnvrt) (unpack (dup "b" (length str)) str)))
)
;; @syntax (utf8-urlencode <str> [<bool-everything>])
;; @param str the string to encode
;; @param bool-everything whether to escape the entire string or just most of the "non-ascii friendly" parts.
;; <p>Use this function to safely encode data that might have foreign characters in it, or simply
;; characters that should be placed into URLs:</p>
;; <b>example:</b>
;; <pre> (utf8-urlencode "What time is it?") => "What%20time%20is%20it%3F"</pre>
(define (utf8-urlencode str everything)
(if everything
(hex-encode-str str)
(replace REGEX_HTTP_SPECIAL_STR str (hex-encode-str $1) 0x10000)
)
)
;; @syntax (utf8-urldecode <str>)
;; <p>Decodes a utf8-urlencoded string. Converts '+''s to spaces.</p>
(define (utf8-urldecode str)
(replace "+" str " ")
(replace REGEX_HEX_ENCODED_CHAR str (pack "b" (int $1 nil 16)) 0x10000)
)
'format' can take the values to format in a list, so you can simplify the first function:
(setf cnvrt (dup "%%%X" (length str)))
(format cnvrt (unpack (dup "b" (length str)) str))
)
> (hex-encode-str "newLISP")
"%6E%65%77%4C%49%53%50"
>
Quote from: "Lutz"
Thanks Lutz, didn't know that. I've commit that change to the Dragonfly repo.