First of all, It should come in addition to scanning also the "from" header" and not instead.
If the body and subject are scanned, so should the "from" header.
Secondly, the question is how much legit messages you miss out. This isn't a forum where it's already only people who really want to write, but the casual visitor who enters a business site and may ask to be a client if they feel like it in the second they spend on the site.