Except when they're at the other end of the house when you need them...

That made me laugh :)

Having a plastic container that I chuck the bar into as I'm getting in, and then I put the bar on the caddy as I'm getting out, sounds like a good possible solution.