[Dbix-class] Help with Titanic Number of Inserts

Ryan Richt rjr2 at cec.wustl.edu
Wed Jan 24 01:01:00 GMT 2007


Hey Guys and Gals...

	We are just starting a DBIx::Class project here at the Washington  
University Genome Sequencing Center in St. Louis, and __of__course__  
we choose DBIx::Class over all that other stuff ;-).

Anyway, we need to make > 112,000,000 inserts per day.  I _know_ that  
DBIx::Class is not concerned with performance, but with the  
(wonderful) design/interface/features.

However, other than wrapping it in a transaction, do you have any  
other tips on making this manageable?  Currently this would take 130  
DAYS to insert w/o transactions, and something like 30 DAYS with  
transactions.

(As far as setup goes, this is currently in SQLite and soon to be  
Oracle once SQLite explodes, testing on a newer dual processor  3gig  
ram machine, and could deploy on anything from 1000+ node cluster or  
50 node cluster of Opertons or 5 x 100gig ram itanium quad processor  
machines, if that could help us in any way!).

Thank you very much!

Ryan



More information about the Dbix-class mailing list