I'm currently using Google Refine on EC2 server and facing a JVM exception when simply starting the application.
Once started, the application is working fine but crashing as soon as I try to work with "big" files (2 go).
Message (caught in log on output), when starting the app is :
Java HotSpot(TM) 64-Bit Server VM warning: Failed to reserve shared memory (errno = 28)
And message, when crashing is the classic one :
Java heap space.
Here is my configuration :
- Ubuntu Lucid 64 bits
- 17 go ram, dedicated server.
- I reserved 10 go for Google Refine
- Google refine startup options : add_option "-Xms512M -Xmx$REFINE_MEMORY -Drefine.memory=$REFINE_MEMORY -XX:MaxPermSize=256M -XX:+CMSClassUnloadingEnabled -XX:+UseLargePages -XX:+UseParallelGC -XX:-UseGCOverheadLimit" ==> where $REFINE_MEMORY is 12000M
- So far, nothing in /etc/security/limits.conf
- Limits :
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 20
file size (blocks, -f) unlimited
pending signals (-i) 16382
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) unlimited
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
The exception is also raised if I assign less memory to the application (ex : 2000M).
After a lot of googling on that, I didn't find anything really usefull.
Can you please give me some advice in order to fix this ?