Text only | Text with Images

newLISP Fan Club

Forum => newLISP newS => Topic started by: methodic on May 17, 2009, 05:29:32 PM

Title: SentenceBoundary.lsp?
Post by: methodic on May 17, 2009, 05:29:32 PM
Doesn't appear to exist anymore:

http://www.newlisp.org/code/SentenceBoundary.lsp.txt



Anyone have a copy of this? Thanks in advance.
Title:
Post by: cormullion on May 18, 2009, 08:42:30 AM
Yes, I have a copy here. It's Rev: 2630, dated 2006.



Which means it doesn't work with current versions of newLISP.



If you don't hear from the authors directly, I'll post a copy. I'd rather they had the opportunity to decide what to do with it first.
Title:
Post by: Lutz on May 19, 2009, 03:04:29 PM
I have put it back here:



http://www.newlisp.org/syntax.cgi?code/SentenceBoundary.lsp.txt



if you change (inc 'i) to (inc i) and use 'setf' on the lines where 'nth-set' is used, then it should work for version 10.
Title:
Post by: Lutz on May 22, 2009, 05:35:23 PM
Now has been updated for newLISP v.10.0 :



http://www.newlisp.org/syntax.cgi?code/SentenceBoundary.lsp.txt
Title:
Post by: Lutz on May 22, 2009, 07:28:23 PM
thanks to methodic fo correcting a typo, now at rev 2697:



http://www.newlisp.org/syntax.cgi?code/SentenceBoundary.lsp.txt
Title:
Post by: cormullion on May 23, 2009, 01:10:29 AM
Are these lines correct?


Code Select
(setf (word_list (- i 1) -1) (append (word_list (- i 1) -1) "."))
(setf (word_list (- i 1)) word_list (append (word_list (- i 1)) tmp))
Title:
Post by: Lutz on May 23, 2009, 04:50:17 AM
They are a direct translation from the 'nth-set' statements with flat version 9.0 syntax.



It does a good job on wikipedia pages (corrected link):



(url-to-sentences "http://en.wikipedia.org/wiki/Grady_(band)" 15000)



but it bombs on your home page :-(. Perhaps Methodic can put some more work into it.
Title:
Post by: cormullion on May 23, 2009, 06:11:27 AM
I think  my version works:


Code Select
(println (slice (url-to-sentences "http://unbalanced-parentheses.nfshost.com/" 10000) 0 20

("blog: unbalanced-parentheses" "about this blog" "atom newsfeed" "contact me" "twitters @ 12:25"
 "#opensources newLISP 10.0.6: newLISP is a Lisp-like, general-purpose scripting language."
 "It has al." "http://chilp.it/?76b031" "from OpenSources (Jacob Peacock)" "1 day and 20 hours ago"
 "newLISP 10.0.6 - newLISP is a Lisp-like, general-purpose scripting language." "It has all the magic of traditional L. http://bit.ly/ZCc1L"
 "from fmannounce (freshmeat announces)" "1 day and 22 hours ago" "Development release 10.0.6 features minor enhancements and bug fixes: http://www.newlisp.org/downloads/development/"
 "from newlisp (newLISP)" "2 days and 17 hours ago" "@ghfischer Hey do you have a copy of the Sentence Boundary code? I can't find it on newlisp.org anymore."
 "from m3thodic (tony)" "5 days and 12 hours ago")


I think your conversion to v10 has more errors than mine... :)
Title:
Post by: Lutz on May 23, 2009, 07:08:32 AM
Can you post a link to the corrected version or post the critical correction?
Title:
Post by: cormullion on May 23, 2009, 08:37:28 AM
The lines in my version that differ from yours are (according to BBEdit):


Code Select
line  91:    (if (not break_token) (set 'break_token ""))
line 176:   (set 'word_list (map (fn(x) (parse x " ")) sentence_list))
line 212:             (setf (word_list (- i 1))    (append (word_list (- i 1)) tmp))
line 215: (begin
            (inc i)
          )



I think line 212 is the culprit.
Title:
Post by: Lutz on May 23, 2009, 08:56:40 AM
Thanks Cormullion, now I see the superfluous 'word_list' . A new version is posted:



http://www.newlisp.org/syntax.cgi?code/SentenceBoundary.lsp.txt
Title:
Post by: cormullion on May 23, 2009, 09:02:22 AM
I think that version has a stray "syntax highlighting with newLISP and syntax.cgi" line near the end...



This file is definitely jinxed...!
Title:
Post by: Lutz on May 23, 2009, 09:15:50 AM
I had to look that up:



 jinxed

 adj : (usually used colloquially) causing or accompanied by misfortune [syn: hexed]



definitely hexed :)
Title:
Post by: methodic on May 23, 2009, 01:19:58 PM
Just a quick post on a bug I found..



On line 180, GetSentences will fail if on the last argument if the sentence passed in has any whitespace in it; ie: "The brown fox jumped high. "



Adding a trim statement to any line before the parse will fix it. I'm sure it was written so that you pass the string through clean-html first, but for what I'm using it for I don't need that function.



Thanks again to everyone who helped make this 10.0 compliant! :)
Title:
Post by: methodic on May 24, 2009, 03:23:41 PM
Trim wasn't the issue after all... I _think_ I found the bug... sent Lutz a new file which he should be posting shortly. :)
Title: Re: SentenceBoundary.lsp?
Post by: kanen on January 11, 2011, 09:25:04 PM
You should probably change the Contact information in Sentence Boundary, as neither of these e-mail addresses work any longer. :)


Quote
;; Creative Commons Attribution (by) License v2.5

;; Full text - http://creativecommons.org/licenses/by/2.5/

;; Contact - fischer@kozoru.com, desanto@kozoru.com

;; Copyright (c) 2006, kozoru, Inc.
Text only | Text with Images