File size limit exceeded for files > 2GB

[Emiliano]

Hy everibody,
when creating files bigger than 2GB I get error "File size limit
exceeded"...
I use woody, kernel 2.6.7, libc6 2.3.2.ds1-13, and this is the output
from ulimit -a:

core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
file size (blocks, -f) unlimited
max locked memory (kbytes, -l) 32768
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 10239
virtual memory (kbytes, -v) unlimited


I can't get the solution to this problem.
Have I to recompile the utilities ( scp, ftp and so on ) against new
kernel headers? ( hope this is not necessary).



Thanks.

Emiliano

[Stefan O'Rear]

Post by Emiliano
Hy everibody,
when creating files bigger than 2GB I get error "File size limit
exceeded"...
I use woody, kernel 2.6.7, libc6 2.3.2.ds1-13, and this is the output
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
file size (blocks, -f) unlimited
max locked memory (kbytes, -l) 32768
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 10239
virtual memory (kbytes, -v) unlimited
I can't get the solution to this problem.
Have I to recompile the utilities ( scp, ftp and so on ) against new
kernel headers? ( hope this is not necessary).

Maybe. Making a file bigger than 2GB requires 64-bit indices rather
than 32-bit indices, so apps need to be recompiled with
-D_FILE_OFFSET_BITS=64
No. New kernel headers are unnecessary.

To see if an app is compiled with 64bit file pointers:

stefan:~$ strace -eopen tail -0 /etc/passwd
...stuff edited out...
open("/etc/passwd", O_RDONLY|O_LARGEFILE) = 3

O_LARGEFILE means the program was compiled for >2G files.

[John Summerfield]

Post by Emiliano
Hy everibody,
when creating files bigger than 2GB I get error "File size limit
exceeded"...
I use woody, kernel 2.6.7, libc6 2.3.2.ds1-13, and this is the output
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
file size (blocks, -f) unlimited
max locked memory (kbytes, -l) 32768
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 10239
virtual memory (kbytes, -v) unlimited
I can't get the solution to this problem.
Have I to recompile the utilities ( scp, ftp and so on ) against new
kernel headers? ( hope this is not necessary).

It "should" just work. To support files larger than 2 Gbytes you need
any 2.4 or later kernel, libc 2.2 and later. I frequently handle files
larger than that - the _only_ system that gives me grief is my Mac (OSX).

I'm looking right now at a file that's hosted on Woody, kernel
2.4.18-1-686, libc 2.2.5.

If you're using a 2.6 kernel and libc6 2.3 then it's evident it's far
from standard Woody and whatever you've done to it may well be the
source of your problems.
--
Cheers
John

-- spambait
***@computerdatasafe.com.au ***@computerdatasafe.com.au
Tourist pics http://portgeographe.environmentaldisasters.cds.merseine.nu/

[Emiliano]

Post by Emiliano
Hy everibody,
when creating files bigger than 2GB I get error "File size limit
exceeded"...
I use woody, kernel 2.6.7, libc6 2.3.2.ds1-13, and this is the output
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
file size (blocks, -f) unlimited
max locked memory (kbytes, -l) 32768
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 10239
virtual memory (kbytes, -v) unlimited
I can't get the solution to this problem.
Have I to recompile the utilities ( scp, ftp and so on ) against new
kernel headers? ( hope this is not necessary).
Thanks.
Emiliano

Ok, solution found.
I recompiled the ftp and scp utilities, ans this (tried ftp on 6GB file,
scp on 2.2 GB) just worked ok...now i've my 6GB backup on my Debian.

Thanks Stefan, I thought i had to recompile, your hint definitively
pointed it out.

Thanks John too: I only moved a monolitic 2.6 kernel on this woody,
which is our production environment, everything else is original woody :).

Regards.

Emiliano.