[Monetdb-developers] re-organizing PF/MXQ tests
Dear all, before adding another ~80 tests (all 4 flavors of the XBench benchmark suite) to the current pathfinder test set of 1384 tests, I'd like to propose a re-organization/re-structuring of the pathfinder test set. With all tests enabled, testing takes almost 30 minutes --- with an optimized 64-bit binary with 32-bit OIDs on my Athlon64 X2 3800+ (2GHz) with 2GB RAM. A quick analysis clusters the tests in 5 categories: 1) compiler ("pf" only) tests 2) tests for features provided by the MXQ runtime 3) tests for additional/optional modules (PFtijah) 4) tests derived from bug reports, use cases, etc. 5) benchmark tests Currently, the respective tests reside in the follwoing directory trees: 1) compiler// 2) runtime// 3) modules// 4) tests// 5) tests// This allows to conveniently run each category individually (e.g., `Mtest -r compiler/`), except from the "tests/" tree, which contains two categories: 4 & 5. I propose to replace 5) tests// by 5) benchmarks// i.e., add "benchmarks/" and move all benchmark tests from tests// to benchmarks//, basically: mv tests/{MBench,X007,XBench,XMach-1,XMark,XPath,XPathMark} benchmarks/ Additionally, I'd suggest to also move the tests/XRpc/xmark_queries to benchmarks/XMark/XRpc Open question: should we then also move tests/Music to benchmarks/Music ? Votes? Well, as you might imagine, I'v everything ready here for checkin ;-) Hence, unless there are complains or different suggestions by Saturday (Oct 14 2006) morning, I'll apply above changes during the weekend. Kind regards, Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |
participants (1)
-
Stefan Manegold