Since you have v-braks you would be a good candidate for a flip-flop hub (SS on the one side and fixie on the other). This way you could experiment with fixie off-roading but not have to be 100% commited.
Alan gives solid advice.
However, if ur gonna go single stick to freewheeling for now. It will be a very cheap conversion.
Fixed is beautiful, but I could see where someone can get mangled.
And I love my fixed gear.
Btw my conversion to fix was a 30 something dollar investment. A tommicog bolts on to where my disc would normally sit, reverse the tread and im all set. O and take off that rear brake.