ok im doing a heavy process on processing each email. lets say im making an AI for a system at he will auto-reply the email that he receive, but im still dont know where to start.heres what im thinking ofarchitecture 1
problems :[*]lets say we have 1000 emails / sec how does a mail server, exim or sendmail, davecot etc exactly work?[*]can the parseandsavetomysql.py process 1000 emails in a sec though piping? how does that work too? btw currently its working fine, but i need to know about this.[*]is my logic correct about a worker? or a queuing system? i have tried to see resque and friends but i still just dont get it how can we lock a session lets say in this this problem "hey im processing this file dont work on email1.rawemail work on other" how can we do that the correct or simpler way?architecture 2
problems?[*]as written[*]how can a pop/stmp server receive 1000 emails/sec?[*]we can get email via imap and pop? becouse we are just processing is pop3 the right way to chose on performance? *there is a imap_open on php that im currently using*addon[*]is there a good link or blog post that solve the same problem as me?[*]please give me links of projects,app or 3rd parties that solve my problem?[*]if there is anything in mind, please do write them down.thanks for helping out, Adam Ramadhanedited my current architecture
