Jason,
Here're a couple of thoughts, take it anyway you want...
You aren't going to know what you "know" until you get to test it under fire in the most critical situation. Much is said pro & con about working in the recording racket in Los Angeles, New York, Toronto, Nashville, Miami, or Chicago (in my mind North America's top markets). but one feature is clear: you are more likely to be tested against the best in the field. Not to say that every producer/engineer you run into - take Nashville, for instance, you're been down here, haven't you? - is going to be really good at some facet of the gig, but the average is higher, and you're more likely to run into someone that you'll relate to.
The infrastructure is broader and more competitive in bigger markets. Think musician's services such as instrument sales, rental & repair and cartage and guitar techs, not to mention performance support, such as rehearsal facilities, live sound, lighting & staging gear & personal and knowlegable management (ever try to find a good monitor mixer or an LD in the phone book?). Other services count, too: technical support (convenient electronics supply houses, and good technicians), business support (knowlegable accounting & legal services), even catering.
Every wonder where most of that infrastructure came from? In every music community I've ever been acquainted with, those people started out as musicians / artists / songwriters / engineers & etc. Whether they 'gave up' (which is not neessarily a bad thing) or simply found another opportunity to feed their family or something they liked to do better, it results in a community that has a broader experience and is more knowledgable and often sympathetic to the rigors of "the business".
At the end of the day, the point is to be somewhere where you'll be happy with the quality of life. I left Los Angeles in part because I couldn't see myself bringing up my kid there, and in part because the resources it offered didn't interest me as they once did. Before that, I lived and worked in Paris. Looking back it was essential for me to work in a community of professionals that had a lot to teach me, both about life (Paris) and work (Los Angeles). If the tiniest opportunity presented itself, I'd move back to Paris in a heartbeat. On the other hand, if unlimited opportunities presented themselves in Los Angeles, I'm not sure I'd be home for the call.
Oh, one more thing. I don't know how close you and your future wife are, but that's going to be a big part of your decision. For sure go somewhere where she's happy or you're going to hear about it every day all day long in the most strident...the most unpleasant terms.
George