Based on your description, it seems like it should work, but it’s hard to say without screenshots showing how you have everything configured.
However, for something like this, I would personally create a relation in the book table linking the book to the chapters. Then, assuming you are on the book detail screen, change the source of the collection to use the relation. Then you won’t need a filter.