I decided to jump into this wonderful side hobby with both feet. I love the atmosphere these things can bring to gaming. I purchased the Swamp Village set, and all the other items (glue, ruler, etc), but I have one question. I can't find anywhere in the instructions *how many* of each section to print out? Assuming a 'standard' setup, that is. Is this information somewhere that I'm missing...?

And that estimate is based on you already knowing what you're going to build - obviously, planning in advance can cut down substantially on how much you need to print.
I would recommend taking a look at what adventure/module/setting you plan to "demo" it with, sketch out a quick arrangement (nothing too fancy - 3x3 here, 6x6 here, walls here and here...). Go back over that and print out everything you need to build it.
For the first few builds this means reduced flexibility, but as you begin to accumulate more pieces you can start to build things "on the fly".