You can set the filter to only show downloaded books. At the top left of your screen just under the search bar there are three lines. Tap on them. There will be a number of options for what you would like your library to display.
Edited to add: I have to take that filter off when adding new books and then tap the books to get them downloaded then put the filter back on.