Issues with daemon as systemd user unit

Hi!

I'm trying to run the emacs daemon as a systemd user unit, and I'm seeing this error when trying to launch the GUI client:

Authorization required, but no authorization protocol specified

From what I've seen online it might be due to it trying to start before I'm logged in or something like that.
It does work after restarting the unit but I don't want to do that every time.

Anyone else see this before? Any ideas for a fix? Is there a better way of starting the emacs daemon?