Weird behavior on upvoting cross instance

I don't know if this is just me or what, but sometimes I can upvote successfully on posts, but then again sometimes I get an error message stating: "This thread was retrieved via lemmy.world. You're not logged in there." When I open Connect for Lemmy, and go to the same post, I can upvote normally. Is this a bug or a feature?