How safe is it to be walking on a broken ankle liberally?

I broke my ankle about two weeks ago and the doc gave me a set of crutches and told me no weight bearing for another two weeks, then a walking cast. I hate the crutches and occasionally, like when I'm walking around the house, it's just easier to walk and it doesn't even hurt I feel fine. Last weekend I was hammered drunk and the crutches took too much coordination so I just walked, and it worked fine. I'm young and I have a feeling I heal really quick. So is it alright to put SOME weight on it every now and then? Or am I setting myself back even more?