Done it a few times with my mate on the Trent; absolutely awesome! Strictly speaking you shouldn't do it on non-tidal rivers without permission from the riparian land owners, but in my experience, as long as you extend some courtesy to other anglers fishing on the bank you generally don't get any hassle.
On the tidal you can fish anywhere as far as I'm aware; goes back to the Magna Carta.