I end up using my 20# tank around the garage to blow dust and crap off my bench or projects so I can't say for certain for off road only use. (Its just too convenient in the garage when the other option is to pull down the compressor and turn it on and deal with the loud noise while the tank pressurizes.) You have to think of it in terms of how much you air down then need to inflate back up to when you're done wheeling. i.e. highway psi of 35 down to 15 then back up is a difference of 20 psi multiplied by 4 tires.
Anyway, I found this chart that details it. Its from powertank though so I'd perhaps be a bit skeptical to some of the claims.
To swap out my 20# tank it costs like $24 or something like that from UCS. When I was wheeling a lot (and actually airing down) I seem to remember swapping it out a couple times a year. I didn't have crazy big tires though (33s) and didn't drop PSI that much so I did get a decent amount of fill ups. The other thing to consider is that in a group other people with the cute little air compressors or that don't have air will ask to use your tank because its so quick.
I really do love my tank but it is kind of a pain to pack it because of its size, weight, and shape. It bangs and rattles unless its decently isolated from other hard objects. Due to these things I have considered getting a ARB compressor to mount under the hood but hadn't prioritized it yet.