Well I think I got it now.
It actually appears to be a bug in pfSense (firewall sitting in front of the server).
It was filtering SMTP regardless of the ruleset, until i turned on logging, and turned it off again. Voila!
Now on to integrating anti virus and spam protection.