Would it help if you created your own ID column? When rows are added from Glide use the Unique Identifier and when added from outside glide a different unique Id generator.
My guess is if you had a column with unique ids you could figure the rest out.