#    -*- mode: org -*-
#+TITLE: benchbase to do list
#+AUTHOR: Benoit Delbosc
* Tasks
** TODO autodetect jmeter/fl import
   remove the -f option
** TODO improve sar rendering
   -> create index on stamp ?
   -> convert sar date into  stamp as well
** TODO sar monitoring should report memory swap usage
** TODO gc monitorring
   -> pb with start date?
     benchbase import-gc -h hostname -m"comment" -d "9:10:30" BID FILE
** TODO diff or trend reports
** TODO plot groupthread
   plot groupthread
** TODO list should display start and duration date
** TODO command: delete bid
** TODO command: update comment
   benchbase comment -m"bla" 1
** TODO command add metadata
** TODO command add misc file 
    as blob

    btrack add-file -m"comment" [-g GROUP] foo.bar
    btrack list-file
     | BID | filename | comment |
     |-----+----------+---------|
     |     |          |         |
    btrack get-file BID [filename]

    keep a blob for each imported file
    add an export cmd to build a zip of all files + script to import
* Changelog
** 1.1.0 [2011-09-20 mar.]
*** DONE support funkload import and report
    CLOSED: [2011-09-20 mar. 11:26]
    :LOGBOOK:
    - State "DONE"       from "TODO"       [2011-09-20 mar. 11:26]
    :END:
*** DONE split stats into period
  CLOSED: [2011-09-17 sam. 00:13]
  :LOGBOOK:
  - State "DONE"       from "TODO"       [2011-09-17 sam. 00:13]
  :END:
  - propose optimal period or settable
    p = time in second / graph size
    -> filter for each simple
    ex: 4h sur 800p: 1p=18s

    select time(stamp, 'unixepoch', 'localtime') TIME, count(na)
    from sample 
    where bid = ${bid} ${filter} 
    group by stamp order by stamp\"" u 1:2 lt 3 notitle with points, "< sqlite3 ${dbpath}

    select stamp,
      (SELECT COUNT(na) FROM sample WHERE bid = ${bid} AND stamp >
         (a.stamp - ${ravg}) AND stamp <= a.stamp ${filter}) 
    FROM sample a 
    WHERE bid = ${bid} ${filter} ORDER BY stamp

  - write data into a data file (easier to work on)


time count avg max min stdev med p10 p90 p95 p98 total success tput error_rate
CUs STEP ERROR MIN AVG MAX P10 P50 P90 P95 APDEX
plot "${data}"  u 1:3 t "avgmed/p90/p95" w candlesticks lt 1 lw 1 whiskerbars 0.5, "" u 1:8:5:7:7 w candlesticks lt 2 lw 1 t "min/p10/med" whiskerbars 0.5, "" u 1:3 t "avg" w lines lt 3 lw 2
1 1
8 7 p50
10 10 p95
9 9 p90
7 8 p10
5 3 avg
4 5 min

1:8:8:10:9
1:7:7:10:9
*** DONE Ordering samples by total time
    CLOSED: [2011-09-16 ven. 15:28]
    :LOGBOOK:
    - State "DONE"       from "TODO"       [2011-09-16 ven. 15:28]
    :END:
*** DONE use a python sqlite aggregator for stdev/percentil
    CLOSED: [2011-09-16 ven. 14:39]
    :LOGBOOK:
    - State "DONE"       from "TODO"       [2011-09-16 ven. 14:39]
    :END:

    - add percentil and stdev aggregator
*** DONE accept gzipped files
    CLOSED: [2011-09-15 jeu. 23:28]
    :LOGBOOK:
    - State "DONE"       from "TODO"       [2011-09-15 jeu. 23:28]
    :END:
*** DONE add functional tests
  CLOSED: [2011-09-15 jeu. 23:27]
  :LOGBOOK:
  - State "DONE"       from "TODO"       [2011-09-15 jeu. 23:27]
  :END:
  test case data zipped format
  bench1/jmeter sar gc
*** DONE split sources
    CLOSED: [2011-09-15 jeu. 23:28]
    :LOGBOOK:
    - State "DONE"       from "TODO"       [2011-09-15 jeu. 23:28]
    :END:
*** DONE sar monitoring
    CLOSED: [2011-09-05 lun. 13:42]
    :LOGBOOK:
    - State "DONE"       from "NEXT"       [2011-09-05 lun. 13:42]
    :END:
      benchbase import-sar -h hostname -m"comment" BID FILE
        -> extract cpu, disk, swap ?
*** DONE fix bug report path relative
    CLOSED: [2011-09-02 ven. 17:00]
    :LOGBOOK:
    - State "DONE"       from "TODO"       [2011-09-02 ven. 17:00]
    :END:


** 1.0.0 [2011-09-02 ven.]
*** DONE add summary with min/max/avg
    CLOSED: [2011-09-02 ven. 15:04]
    :LOGBOOK:
    - State "DONE"       from "TODO"       [2011-09-02 ven. 15:04]
    :END:
*** DONE align all chart start/end
    CLOSED: [2011-09-02 ven. 12:13]
    :LOGBOOK:
    - State "DONE"       from "TODO"       [2011-09-02 ven. 12:13]
    :END:
*** DONE align bottom of charts 0
    CLOSED: [2011-09-02 ven. 12:13]
    :LOGBOOK:
    - State "DONE"       from "TODO"       [2011-09-02 ven. 12:13]
    :END:
*** DONE use a mako rest template
    CLOSED: [2011-09-02 ven. 12:13]
    :LOGBOOK:
    - State "DONE"       from "TODO"       [2011-09-02 ven. 12:13]
    :END:
*** DONE use mako to generate gnuplot script and rest template
    CLOSED: [2011-09-02 ven. 00:24]
    :LOGBOOK:
    - State "DONE"       from "TODO"       [2011-09-02 ven. 00:24]
    :END:
    
*** DONE handle command
    CLOSED: [2011-09-01 jeu. 23:35]
    :LOGBOOK:
    - State "DONE"       from "TODO"       [2011-09-01 jeu. 23:35]
    :END:
    list
     ->
    import -m"" -j|-f file
     -> display bid
     handle bench type

    report  <bid> -o
     -> 
*** DONE handle multiple bench and group
    CLOSED: [2011-09-02 ven. 00:26]
    :LOGBOOK:
    - State "DONE"       from "TODO"       [2011-09-02 ven. 00:26]
    :END:

    - btrack list
      | BID  | comments   |
      |------+------------|
      | G-01 | un comment |

    - btrack import --jmeter -m"comment" file.xml PREFIX
      PREFIX-01
       


