Yes, but it only takes a few seconds. Guests sign in with their Google account or a one-time code sent to their email — no password to remember and no app to download.
This means you always have verified email addresses for your attendees, and they can manage their own RSVPs (cancel, rejoin, etc.) without needing to contact you.