I actually just solved for myself, but will leave this up in case it helps others.
The issue was that I was signed in to Glide with a different google account then the one that owns the drive I was trying to access. I added my other google account that has the drive I want access to as an admin and then signed in to the other email and am now able to access.