I just noticed that Mail.app is synchronizing my gmail (IMAP). I saw the mail count that needed to be downloaded and could not stop myself from taking a screenshot and posting it on my blog.
The screenshot reads:
4573 of 17448 [Close]
I have seen gmail accounts with 30k+ emails so I know my situation is not as bad as it looks. That and I pretty much never delete emails if I can help it.