I would try Views Tree.

This sceenshot (ignore the stupid test node titels) shows an expanded tree of node titles and entity references. Anything with a > is an entity reference field and all nodes with the same value for that field go under it.

The module was built initially for taxonomy I believe so I imagine it's much the same.

My sort is the default Title sort and it seems to be exactly what you want. (Check the nodes starting with B in the middle of the references) You can have them collapsed by default and use css to disable clicks on the terms.

I would try Views Tree.

Edited: To use Views Tree, the genres would have to be a content type and the books would the use entity reference. It will do an alphabetical list as OP asked but it's unsuitable for his requirements.