I tried to answer earlier, but the forums seemed to break down every time that I logged in.
But here it goes anyway.
I did install Oracle Xe on Ubuntu 11.04 and it worked just fine. But after I upgraded to 11.10 Oracle Xe didn't work anymore. And after reading the hints in this thread and somewhere else. it came down to this: