Ok, I live in Texas but I play on Napa, so there's a bit of latency there.
After watching it for a while longer, I think... I have found my problem.
My main crafter is doing Heartwood while I have another mule doing lumberjacking (hey, gotta support the habbit somehow!). The LJ client is recalling in and out like crazy (seperate computer). EVERYTIME the crash has happened, the LJ is at the house, about 2 tiles away from the Heartwood client's recall spot.
Now I know that sounds pretty coincidental. So I tested it by moving my LJ to the bank (thank god for commodity boxes, thanks EA.) and since that point I have had 0 crashes over 100+ runs.
I'll chalk it up to memory leak, bad timing... heck, even bad mojo. But the problem resolved itself.
Thanks for the replies!