I’m not sure what you mean by “my server” here, but generally your app should be safe if you apply the right security method.
Then that would mean other users can download the images they see, which I think you might not want.
Just set your app to allow logging in, that’s an easy switch in Settings > Privacy. If you want to keep part of your app public, choose “Optional sign-in”, else “Required sign-in”.