[KLUG Members] MySQL -vs- Postgresql - speed.

Adam Williams members@kalamazoolinux.org
27 Oct 2002 10:19:43 -0500


>PostgreSQL is ACID/Transactional.  Loading 20,000 records in a single
>transaction is going to be quite slow.  It is very much the wrong way to
>do such a thing.  If for some reason the "upload" died at record 9,675 
>what would he do?  Was the "last" record loaded completely in the table
>or not?  What he wants is a bulk loader that pops in the records,
>wrapped in transactions,  about a hundred at a time.  I do this

Ah, I found the URL.  
http://ems-hitech.com/pgsqlutils/

These guys sell (that is, they charge money) for a bulk loader.  But if
you do much with databases (either MySQL or PostgreSQL) it will be the
best $29 you ever spend.

You can load directly from M$-Excel, DBF, CSV, or fixed record length
files, there are wizards to setup the table:field mapping, adjust date
layouts, define column width on fixed record length files.  And for
PostgreSQL adjust the number of records to load between commits. 
Available for both Win32 and Linux.

I've been using it for awhile,  and although it is commercial (I put it
in the same catagory as VMware) it is a must have.  Saves oodles of
time.

I have no affiliation with EMS-HiTech except as a happy customer.