Text only | Text with Images

newLISP Fan Club

Forum => newLISP in the real world => Topic started by: pjot on January 23, 2008, 12:31:11 PM

Title: Nth behaviour?
Post by: pjot on January 23, 2008, 12:31:11 PM
Code Select

peter@AsteroidRider:~$ newlisp
newLISP v.9.2.17 on Linux, execute 'newlisp -h' for more info.

> (sys-info)
(362 268435456 358 1 0 140733193390080 9217 1)
> (nth 6 (sys-info))
140733193397249
> (nth 7 (sys-info))
140733193388033
> (nth 8 (sys-info))

list index out of bounds
> (nth 5 (sys-info))
140733193390080


Why is this happening? An (nth 6 (sys-info)) used to return the version number of newLisp (here 9217).



Peter
Title:
Post by: Lutz on January 23, 2008, 12:43:06 PM
Still works over here on Mac OS X, Free BSD 4.9 and Linux 2.6


Code Select

~/newlisp-9.2.17> uname -a
Linux webserver28 2.6.16-xenU #1 SMP Mon May 28 03:41:49 SAST 2007 i686 athlon i386 GNU/Linux
~/newlisp-9.2.17> ./newlisp
newLISP v.9.2.17 on Linux, execute 'newlisp -h' for more info.

> (nth 6 (sys-info))
9217
> (sys-info 6)
9217
> ((sys-info) 6)
9217
>


what kind of Linux are your running? The above Linux is a custom Amazon Ec2 services Linux, RedHat based.



Can you do a uname -a to fined out? Do previous versions give the same error?



Lutz



ps: and what makefile did you use to compile, if this is a 64-bit Linux, then you can compile as either 32bit or 64bit Linux. That big number should be 2038 (stack depth)
Title:
Post by: pjot on January 23, 2008, 01:19:20 PM
It is the 64 bit version of Slackware Linux 12.0 called 'SLAMD' (www.slamd64.com).


Quote
peter@AsteroidRider:~$ uname -a

Linux AsteroidRider 2.6.22.8 #1 SMP Tue Sep 25 20:41:25 BST 2007 x86_64 x86_64 x86_64 GNU/Linux


I have compiled newLisp as follows:
Quote
make -f makefile_linux_readline


If I run 'make', it will automatically use the 'linux_makefile' version.


Quote
peter@AsteroidRider:~/installation/newlisp-9.2.17$ make

./build



Discovered Linux:

make[1]: Map '/home/peter/installation/newlisp-9.2.17' wordt binnengegaan

make -f makefile_linux

make[2]: Map '/home/peter/installation/newlisp-9.2.17' wordt binnengegaan

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX newlisp.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-symbol.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-math.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-list.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-liststr.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-string.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-filesys.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-sock.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-import.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-xml.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-web.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-matrix.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-debug.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX pcre.c

gcc newlisp.o nl-symbol.o nl-math.o nl-list.o nl-liststr.o nl-string.o nl-filesys.o nl-sock.o nl-import.o nl-xml.o nl-web.o nl-matrix.o nl-debug.o pcre.o -g -lm -ldl -o newlisp

strip newlisp

make[2]: Map '/home/peter/installation/newlisp-9.2.17' wordt verlaten

make[1]: Map '/home/peter/installation/newlisp-9.2.17' wordt verlaten


Peter
Title:
Post by: Lutz on January 23, 2008, 02:41:17 PM
Assuming that it has 32-bit libs installed, try using:


Code Select
make -f makefile_linux64ILP32

if that doesn't work do:


Code Select
make -f makefile_linux64LP64

but the first will most likely work, most 64-bit Linux are configured with two sets of libraries, and the header of the binary lets the loader automatically choose the right one.



Lutz



ps: makefile_linux64 is the same as makefile_linux64ILP32
Title:
Post by: pjot on January 23, 2008, 10:20:53 PM
The first makefile does not work at all:
Quote
peter@AsteroidRider:~/installation/newlisp-9.2.17$ make -f makefile_linux64ILP32

make: *** No rule to make target `makefile_linux64LP32', needed by `newlisp.o'.  Stop.


The second makefile works, but there is no difference:
Quote
peter@AsteroidRider:~/installation/newlisp-9.2.17$ make -f makefile_linux64LP64

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX -DNEWLISP64 newlisp.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX -DNEWLISP64 nl-symbol.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX -DNEWLISP64 nl-math.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX -DNEWLISP64 nl-list.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX -DNEWLISP64 nl-liststr.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX -DNEWLISP64 nl-string.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX -DNEWLISP64 nl-filesys.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX -DNEWLISP64 nl-sock.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX -DNEWLISP64 nl-import.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX -DNEWLISP64 nl-xml.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX -DNEWLISP64 nl-web.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX -DNEWLISP64 nl-matrix.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX -DNEWLISP64 nl-debug.c

gcc -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX -DNEWLISP64 pcre.c

gcc newlisp.o nl-symbol.o nl-math.o nl-list.o nl-liststr.o nl-string.o nl-filesys.o nl-sock.o nl-import.o nl-xml.o nl-web.o nl-matrix.o nl-debug.o pcre.o  -g -lm -ldl -o newlisp

strip newlisp

peter@AsteroidRider:~/installation/newlisp-9.2.17$ ./newlisp

newLISP v.9.2.17 64-bit on Linux, execute 'newlisp -h' for more info.



> (nth 6 (sys-info))

140733193397249

> (nth 5 (sys-info))

2048

> (sys-info)

(362 576460752303423488 358 1 0 2048 9217 1)


However, I noticed that implicit indexing works well:
Quote
newLISP v.9.2.17 64-bit on Linux, execute 'newlisp -h' for more info.



> (sys-info)

(362 576460752303423488 358 1 0 140733193390080 140733193397249 1)

> ((sys-info) 6)

9217

> (sys-info)

(362 576460752303423488 358 1 0 2048 9217 1)


As you may see, the (sys-info) is generating some other value again.



Peter
Title:
Post by: pjot on January 23, 2008, 10:27:20 PM
Later I saw your remark:
Quote
makefile_linux64 is the same as makefile_linux64ILP32


The 'makefile_linux64ILP32' does not work:
Quote
peter@AsteroidRider:~/installation/newlisp-9.2.17$ make -f makefile_linux64ILP32

make: *** No rule to make target `makefile_linux64LP32', needed by `newlisp.o'.  Stop.


But the 'makefile_linux64' does work:
Quote
peter@AsteroidRider:~/installation/newlisp-9.2.17$ make -f makefile_linux64

gcc -m32 -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX newlisp.c

gcc -m32 -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-symbol.c

gcc -m32 -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-math.c

gcc -m32 -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-list.c

gcc -m32 -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-liststr.c

gcc -m32 -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-string.c

gcc -m32 -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-filesys.c

gcc -m32 -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-sock.c

gcc -m32 -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-import.c

gcc -m32 -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-xml.c

gcc -m32 -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-web.c

gcc -m32 -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-matrix.c

gcc -m32 -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX nl-debug.c

gcc -m32 -Wall -pedantic -Wno-uninitialized -Wno-strict-aliasing -Wno-long-long -c -O2 -g -DLINUX pcre.c

gcc newlisp.o nl-symbol.o nl-math.o nl-list.o nl-liststr.o nl-string.o nl-filesys.o nl-sock.o nl-import.o nl-xml.o nl-web.o nl-matrix.o nl-debug.o pcre.o -m32 -g -lm -ldl -o newlisp

strip newlisp

peter@AsteroidRider:~/installation/newlisp-9.2.17$ ./newlisp

newLISP v.9.2.17 on Linux, execute 'newlisp -h' for more info.



> (sys-info)

(362 268435456 358 1 0 2048 9217 1)

> (nth 6 (sys-info))

9217

> ((sys-info) 6)

9217


Now the (sys-info) and the (nth) and also implicit indexing are working correctly!



From C compilation point of view it seems to come down to the '-m32' flag which is missing in the other situations...?



Peter
Title:
Post by: pjot on January 23, 2008, 10:34:07 PM
Hm, I cannot import 64-bit libraries anymore with this last compilation:
Quote
newLISP v.9.2.17 on Linux, execute 'newlisp -h' for more info.



>  (import "libgtk-server.so" "gtk")



problem loading library in function import : "libgtk-server.so: wrong ELF class: ELFCLASS64"


This used to work with the plain 'makefile_linux', I can run all my GTK-server apps in 64bit. Obviously I do not use 'nth' that much.
Quote
peter@AsteroidRider:~/apps/comic$ file /usr/bin/newlisp

/usr/bin/newlisp: ELF 32-bit LSB executable, Intel 80386, version 1 (SYSV), dynamically linked (uses shared libs), stripped

peter@AsteroidRider:~/apps/comic$ file /usr/lib/libgtk-server.so

/usr/lib/libgtk-server.so: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), stripped


Peter
Title:
Post by: Lutz on January 24, 2008, 04:24:31 AM
You have to locate the 32-bit libraries on that machine, when you run newLISP as a 32-bit app.



running 64-bit newLISP with nth does it fine on OS X:


Code Select
newLISP v.9.2.17 64-bit on OSX, execute 'newlisp -h' for more info.

> (nth 6 (sys-info))
9217
>


Can you give me access to that machine? Also I wonder if this occurs only for sys-info. Can you run: ./newlisp qa-dot ? What about the whole test suite: make test ?



Lutz
Title:
Post by: pjot on January 24, 2008, 05:02:54 AM
You can have access to my machine, I'll send the details tonight by PM.



Peter
Title:
Post by: newdep on January 24, 2008, 01:19:20 PM
Big and Little where sitting on the wall... !!
Title:
Post by: pjot on January 24, 2008, 01:55:41 PM
Indeed, we think this maybe an Endian issue.



If I look to the datatypes in (sys-info), then it appears that the first elements are of type 'long' and 'size_t', each of which is 8 bytes. These are shown correctly.
Code Select

cell = stuffIntegerList(
8,
cellCount,
MAX_CELL_COUNT,
symbolCount,
(UINT)recursionCount,
(UINT)envStackIdx,
MAX_CPU_STACK,
version,
opsys);


The problem starts when arriving at MAX_CPU_STACK, which is an int of 4 bytes. Also the 'version' is an int of 4 bytes.



There might be a problem aligning the bytes in memory. There are systems like the IA64 with 'switchable Endiannes', but I cannot find hard proof that this 64bit Intel machine has this feature. See also http://en.wikipedia.org/wiki/Endianness



Peter
Title:
Post by: Lutz on January 24, 2008, 04:28:36 PM
Seems to be a sign extension issue from 4 byte int to 8 byte unsigned long,



this should fix it:


Code Select
cell = stuffIntegerList(
    8,
    cellCount,
    MAX_CELL_COUNT,
    symbolCount,
    (UINT)recursionCount,
    (UINT)envStackIdx,
    (UINT)MAX_CPU_STACK,
    (UINT)version,
    (UINT)opsys);


because on 64 bit newLISP:


Code Select
> (format "%x" 140733193397249)
"2401"
> 0x2401
9217


Lutz





ps: that machine seems to be turned off now, so I couldn't try myself

pps: there also may be 'import' issues
Title:
Post by: pjot on January 24, 2008, 11:12:19 PM
Hi Lutz,



This indeed seems to work:
Quote
peter@AsteroidRider:~/installation/newlisp-9.2.17$ ./newlisp

newLISP v.9.2.17 on Linux, execute 'newlisp -h' for more info.



> (sys-info)

(362 268435456 358 1 0 2048 9217 1)

> (nth 6 (sys-info))

9217

> (import "libgtk-server.so" "gtk")

gtk <2B193AD47A59>



peter@AsteroidRider:~/installation/newlisp-9.2.17$ ldd newlisp

        libm.so.6 => /lib64/libm.so.6 (0x00002abcdbbd7000)

        libdl.so.2 => /lib64/libdl.so.2 (0x00002abcdbe5a000)

        libc.so.6 => /lib64/libc.so.6 (0x00002abcdc05e000)

        /lib64/ld-linux-x86-64.so.2 (0x00002abcdb9ba000)


Funny this 'signed-issue' does not occur in other places as well...?



The machine went to power saving and therefore was not reachable... sorry about that, it is available now for any further testing.



Thanks!



Peter
Text only | Text with Images