I've spent some time hacking IMAP code and it's not particularly pleasant.
What makes IMAP great is that you can just download certain headers and/or individual MIME-chunks of messages (contrast with POP). Unfortunately, this means that a minimally useful IMAP client needs to be able to parse all manner of shitty abominations to RFC[2]822 and RFC204x.
Other thorny issues: how do you generate persistent UUIDs for messages? How do you handle IDLE and locking of mailboxes (both SMTP and IMAP side). How many of the various login methods do you want to support? What kinds of user<->mailbox mapping do you want to support? Do you want to handle TLS yourself, or just punt to stunnel? Is Sieve important?
There is room out there for a good extensible IMAP server, but IMO Dovecot is the closest thing there is.

Could you elaborate on the maildir arrangement? I'm curious because I perceived dovecot to be quite flexible in this regard.

Ultra cool. I thought that the twisted (python) IMAP demo was pretty neat, but I'm a bit weary how it scales. Having something that does would be great!

Matt the situation with dovecot is a little bit complex to explain, but in short a legacy system which I sometimes help out with has mailboxes which are stored all over the place. There are two different systems being used for the archives - one maildir, and one mbox. The paths for them look like this:

# maildir
/archive/10-03-1976/example.com/bob/{new cur tmp}


# mbox
/home/chris/example.com/10-03-1976/chris

The intention is that you'd login with "[email protected]" and you'd see all the files available to you - but because they are stored beneath "/archive/$date/" it is hard to select all of them. (Ditto for ~/chris/example.com)

Were it just mbox we'd use symlink farms to present /mail/[email protected]/box[1-N] but that fails for Maildir, due to files being renamed as they are marked read, etc.

Again you're right to draw attention to the trick parts. Parsing this is easy:

11 UID fetch 1:* (FLAGS)

Parsing, and responding correctly to, this is hard:

a0005 FETCH 1:1 (UID FLAGS INTERNALDATE RFC822.SIZE BODY.PEEK[HEADER.FIELDS (DATE FROM SUBJECT TO CC MESSAGE-ID REFERENCES CONTENT-TYPE CONTENT-DESCRIPTION IN-REPLY-TO REPLY-TO LINES LIST-POST X-LABEL)])

Still from a client point of view its lovely to be able to say "Hey server, gimme just these bits of the message.

Mostly generating UIDs isn't so hard, but locking is something I've not even attempted to handle yet, and login is just plain with stunnel being an option for TLS.

For the part-time server I'd like a reasonably "full" server. For my own needs I'd be happy with something that just viewed messages stored in mysql/on disk. e.g my spam service has a quarantine, exporting that read-only via IMAP would be a nice thing. Perhaps:

quarantine/
quarantine/example.com/
quarantine/example.com/11-06-2009/
quarantine/example.com/12-06-2009/

I was heavily involved in running a regional ISP for many years -- and it's given me a hatred for email.
;-)

"For the part-time server I'd like a reasonably "full" server. For my own needs I'd be happy with something that just viewed messages stored in mysql/on disk. e.g my spam service has a quarantine, exporting that read-only via IMAP would be a nice thing."
If you're OK with it being stored in mysql or postgresql, you might look into DBMail. This is the project I hacked on back in the day.. They had a pretty good IMAP implementation. At the time they were higher performing than Dovecot, though it may very well be that Dovecot has advanced significantly since then.
http://www.dbmail.org/
The authors were very helpful in debugging issues that I saw and the code was pretty decent C.

Thanks for the pointer Matthew!

Right now my mail-scanning service uses a hybrid approach with all mails stored on disk, but much of the meta-information stored in the database.

So, I have a table:

From	[email protected]
To	localpart
Subject	This is a mail subject
...	...

The intention is that I can pull most quick searches and indexes from the database without needing to hit the disk unless the user wishes a body-text search, or to download the actual mail.

Haven't tried it myself, but Perl has a Net::IMAP::Server module that looks like it should be easy to subclass.
http://search.cpan.org/dist/Net-IMAP-Server/

Thanks for the link Dave - it seems like a nice module and a good set of abstractions.

My own attempt is here and splits things up into :

• skximap::core - For all the input parsing.
• skximap::local - Which is the interface for presenting messages.

The actual handling of the local-level protocol is masked in a way that I don't like, but I think that Net::IMAP::Server might be the way to go...