Performance bulk-loading data from an XML file to MySQL

vikassaini01

New Member
Should an import of 80GB's of XML data into MySQL take more than 5 days to complete?I'm currently importing an XML file that is roughly 80GB in size, the code I'm using is in this gist and while everything is working properly it's been running for almost 5 straight days and its not even close to being done ...The average table size is roughly:\[code\]Data size: 4.5GBIndex size: 3.2GBAvg. Row Length: 245Number Rows: 20,000,000\[/code\]Let me know if more info is needed!Server Specs:Note this is a linode VPSIntel Xeon Processor L5520 - Quad Core - 2.27GHZ4GB Total RamXML Samplehttps://gist.github.com/2510267Thanks!After researching more regarding this matter this seems to be average, I found this answer which describes ways to improve the import rate.
 
Back
Top