ArangoDB: Split collection that does not fit into memory

Question

I have painted myself into a corner by creating a collection in ArangoDB that is too large to fit into memory. When I try to load it, my computer reports RAM and hard disk usage of 100% ... I waited for twenty minutes, but the collection was not loaded.

Is there a way to split the collection into smaller parts without loading it? Maybe via the Arango Shell, or by playing around with the database files? (I am using Windows 8.1).

Answer 1

I am not sure if it is possible to split the collection without loading but using ArangoDB with the storage engine "rocksdb" could solve your problem, whereas "mmfiles" is the default storage engine.

Rocksdb is optimized for datasets that are bigger than main memory. The engine stores a hot set of data in main memory and is still able to load additional data from disk if it is not cached in the hot set.