RE: Performance problems ? witch parameter to change ?

> -----Message d'origine-----
> De : Schroeder, Alexander [mailto:alexander.schroeder@xxxxxxx]
> Envoyé : vendredi 28 janvier 2005 10:48
> À : Fabrice Bourdel
> Objet : RE: Performance problems ? witch parameter to change ?
>
>
> Hello Fabrice,
>
> please tell how you insert these lines (which interfaces, are
> this single line inserts or batch inserts). Do you insert these
> rows having some 'autocommit' property on?
>
> Regards
> Alexander Schröder
> SAP DB, SAP Labs Berlin
>
> > Also, i think i have also another problem when i am doing
> > lots in insertions
> > on maxdb : i need to insert monthly 25000 to 30000 ligns of
> > data ; each line
> > contains mostly text data, but not more then 10 fields. I
> > take a very long
> > time and the disk while inserting is accessed all the time,
> > maybe a problem
> > with caching ? i searched and saw that MaxDb is waiting for
> > the log to be
> > written to disk ; is the log_io_queue param the only param to
> > shift ? the
> > actual
> > value is 50 pages ; for the example above, i tryed to shift
> > le value to 100
> > pages but the insertion is not quicker. Any suggestions ?

Hello,


thanks for quick response.

I use php 5.0.2, Apache 2.0.52, phpmaxdb (r1.6, the last), maxdb 7.5.0.19
and the version of sqldbc of the release of maxdb (0.19)
Also, i do not autocommit (that's default behevior), i tested that in this
case
ii should make the process 3.6 time longer.
I use also the quickier way to speed the process, with prepared
statement ; il would maybe a bit quicker with a prepared stored proc.

here is for example the script for generating the values of the a_b_c_test
table :

<?php
  $link = maxdb_connect('localhost', 'SA', 'SA', 'MASTER');
  maxdb_real_query($link, "DELETE FROM A_B_C_TEST");
  $stmt = maxdb_prepare($link, 'INSERT INTO A_B_C_TEST(CH2, CH3) VALUES(?,
?)');
  $chFrom = ord('A');
  $chTo   = ord('Z');
  maxdb_stmt_bind_param($stmt, 'is', $ch2, $ch3);

  $ifrom = microtime(true);
  $imax = 10000;
  for ($i = 1; $i <=$imax; $i++) {
    $ch2 = rand(0,10000);
    $ch3 = chr(rand($chFrom, $chTo));
    maxdb_stmt_execute($stmt);
  }
  maxdb_commit($link);
  $ito = microtime(true);
  $itime = $ito - $ifrom;
  echo "Time : ", $itime, "<br />";
  echo "Time/s = ", $imax / $itime;

?>


Also, i have no choice, i must use a process that insert lign by lign, in
fact
i have big transformations lign/lign, field/field to do before with php.
I insert normaly a text file (.csv), around 25000-30000 ligns.

Regard


-- 
MaxDB Discussion Mailing List
For list archives: http://lists.mysql.com/maxdb
To unsubscribe:    http://lists.mysql.com/maxdb?unsub=gcdm-maxdb@xxxxxxxxxxx