Remove Row Owner - What happens then?

I’m using Row Owners to control the access level of users to certain content in the app
Like images I consolidate rows by using Level 1, Level 2, Level 3, Level 4 - In the date bases this consolidates to Level and I made this the row owner.
I’ve witnessed that controlling access by this disturbs the User experience - you have to click twice to move down the levels of the menu - My question is:
What happens to the app If I remove the access Levels and the row owner - all going well and by default all users then have access again or might i loose the structure built for navigation?
your insight is apprecited