I can replicate that, and I think its a Data Editor bug.
However, I don’t believe that will have any impact on how it works in the published App. Users that are not signed in will only have access to rows that do not have row owners applied.
You can conduct a test for yourself to confirm this. Pick a table that has row owners applied, and add a collection to your “public” screen that uses that table as a source. Then access that screen without signing in. The collection should not appear.