Bookshelf showing actual color of the book would be nice, but implementing it would require a custom renderer for the bookshelf, which will make performance worse. And it has other potential issues with it.
I don't think it's worth the hassle, to be honest.