Two minutes ago I was logged out of my account. I had not cleared my cache or anything that normally makes me need to log in. Should I change my password?
If you aren't using business internet, chances are your IP address is dynamic, and sometimes your internet service provider gives you a different one upon automatic renewals.
That's how your ISP manage limited IP addresses for consumers at an inconvenience to you, because websites generally don't allow simultaneous logins from multiple IP addresses.
If you do feel like there's something odd, then do what you need to do to secure your account.