Just tested, and noticing this too. When you click the Follow button it DOES change to Unfollow, but returning to the page/refreshing will reset it to "Follow".

Just noting that this is still the case. The follow does actually work, though -- they show up on the followed by you page.