Is it possible to find a way for the checkpoint flushes to flush to S3 instead of the local >filesystem ?I'll display my ignorance of AWS by saying that when the BDB (C) testing was done, the storage was on S3, and my colleague there remarked:
As far as I can tell, S3 is the normal storageMaybe other folks can chime in? And if you carry on, it would be interesting to hear about how it works for you.
method for EC2 and I am not sure if I even have the option
of separating the two.
Also, I would think you could just keep uploadingEarlier, we answered the question about whether S3 could be used as the storage an Amazon EC2 /BDB application. Then Matt asked about verification scripts or tools, which us discuss it internally a bit more. The complete answer should really also ask whether S3 is appropriate for JE storage.
log-file segments to S3 as they close -- and thus
never lose more than 10MB of the latest DB changes.
(And that threshold could be decreased by uploading
partials or decreasing the configured log-file size.)
S3 is a storage solution based on RESTful webExactly. If that file system is accessed over the Internet, and then via HTTP, I fail to see how it would be even remotely (no pun intended) appropriate for a database. (Except for database backup, of course.)
services, so it is probably quite slow.
Thanks, Charles. Amazing it can be made to work, withMany of the contemporary web-server machines do not have a lot of local disk space and actually can't be expanded to have much. Consider the Sun T1000. It comes with 80GB of SATA storage and no real room for expansion. Sun expects this to be a middle tier web server with the back end work being done by some heavier iron. For a JE instance running under the app server on such a machine, it might make sense to access the storage via NFS/SMB.
a couple of restrictions. Still, if you have local
storage available, why use network storage?
I see. Thanks for pointing this out. Must confess I do not much about machinery. If they get their network almost as fast and reliable as a local disk, why not?[...] if you have local storage available,Many of the contemporary web-server machines do not
why use network storage?
have a lot of local disk space and actually can't be
expanded to have much. [...] For a JE instance running
under the app server on such a machine, it might make
sense to access the storage via NFS/SMB.