Commit graph

427 commits

Author SHA1 Message Date
Aleksey Bragin 3147006bd2 - Delete regtests framework by Casper. It's useless.
svn path=/trunk/; revision=40349
2009-04-03 10:33:41 +00:00
Timo Kreuzer c9aae814df Skip kernel32 virtual tests again. sysreg isn't ready for that yet.
svn path=/trunk/; revision=40309
2009-04-01 02:49:32 +00:00
Timo Kreuzer 0bbce9519c Add one more test for SetDCPenColor
svn path=/trunk/; revision=40307
2009-04-01 02:02:21 +00:00
Colin Finck 9148284b91 Readd the hack for skipping the bitmap font tests.
As long as we have no working bitmap font driver, it results in endless loops and fails, which even get sysreg2 into an uncomfortable state.

svn path=/trunk/; revision=40231
2009-03-25 16:31:17 +00:00
Colin Finck 8cb8fb4761 Remove all Skip hacks from the Wine tests as we resume from crashes now
svn path=/trunk/; revision=40229
2009-03-25 14:37:01 +00:00
Timo Kreuzer 809d606072 Add the macro I forgot.
svn path=/trunk/; revision=40220
2009-03-25 04:25:39 +00:00
Timo Kreuzer 9a1d43e359 Add one test for NtGdiDeleteObjectApp, and a bunch of tests for NtGdiSaveDC and NtGdiRestoreDC.
svn path=/trunk/; revision=40217
2009-03-25 03:51:22 +00:00
Colin Finck 1463b225be Output "SYSREG_ROSAUTOTEST_FAILURE" for sysreg2 in case of a failure inside rosautotest
svn path=/trunk/; revision=40211
2009-03-24 20:49:04 +00:00
Colin Finck 0a05554c18 Take the line number as an integer, the STRINGIZER macro didn't work as expected
svn path=/trunk/; revision=40208
2009-03-24 12:37:54 +00:00
Timo Kreuzer 8c84226668 - Add a bunch of tests for NtGdiDeleteObjectApp
- Add Is handle valid function to check whether a handle is still valid.

svn path=/trunk/; revision=40199
2009-03-24 01:25:03 +00:00
Colin Finck 10f13abcb5 Big testing system commit
rosautotest
- Rewrite rosautotest in C++
  Should increase maintainability and expandability, since most of the functionality is encapsulated in classes and there exist some abstract classes for further enhancements (i.e. new test types).
  Furthermore, due to the usage of STL strings, we don't need x lines anymore just for building a string out of several small parts.
- The new codebase made it fairly easy to implement a Crash Recovery feature based on a journal.
  If you start rosautotest with the /r option under ReactOS, it will keep a journal about the tests to run and the tests already ran. In case of a crash, it can just continue with the next test in the list then.
- Add some reasonable timeouts to avoid certain hangs in case a test crashes

sysreg2
- Make the necessary changes to sysreg2 to restart the VM in case of such a crash in 3rd stage, but set a maximum number of allowed crashes as well.
  Christoph, please test and review that on the Buildslave :-)
- Prepend all sysreg messages with [SYSREG] through a new function SysregPrintf, so the BuildBot aggregator script of testman can distinguish between debug output and sysreg messages.
- Put all header includes into the central header file "sysreg.h"
- Remove unnecessary libs from the Makefile

testman
- Change the testman Web Interface to show such crashes as CRASH in the Compare and Detail views.

svn path=/trunk/; revision=40147
2009-03-21 01:39:04 +00:00
Christoph von Wittich 71362c59fd more precise error descriptions
svn path=/trunk/; revision=40059
2009-03-16 13:39:03 +00:00
Christoph von Wittich 5c6d424c26 add some wlanapi tests
svn path=/trunk/; revision=40057
2009-03-16 12:15:02 +00:00
Dmitry Chapyshev 83f58a9337 - Add winetests for mscms, msvcrtd, quartz, secur32
svn path=/trunk/; revision=39794
2009-02-27 17:57:06 +00:00
Dmitry Chapyshev bd5f91d815 - Add winetests for pdh, qmgr, rasapi32, serialui, snmpapi, spoolss, twain_32, userenv, wldap32
svn path=/trunk/; revision=39793
2009-02-27 17:32:07 +00:00
Dmitry Chapyshev 3fa4b5dde4 - Add winetests for msctf, msvfw32, ntdsapi, ntprint, oleacc
svn path=/trunk/; revision=39791
2009-02-27 16:45:02 +00:00
Dmitry Chapyshev 06448880e7 - Add winetests for inetcomm, inetmib1, itss, localspl, localui
svn path=/trunk/; revision=39790
2009-02-27 16:23:50 +00:00
Dmitry Chapyshev 569bd394b8 - Add winetests for credui, cryptnet, cryptui, dnsapi, fusion
svn path=/trunk/; revision=39788
2009-02-27 15:57:39 +00:00
Dmitry Chapyshev 7183be3ead - Sync winetests with Wine head (comcat, crypt32, gdiplus, lz32, mapi32, mlang, msacm32, mshtml, msvcrt, netapi32, riched20, riched32, rsaenh, schannel, setupapi, shdocvw, urlmon, user32, usp10, uxtheme, version, winhttp, wininet, wintrust, ws2_32)
svn path=/trunk/; revision=39773
2009-02-26 13:26:26 +00:00
Colin Finck a98eb8d135 Add a /c option to supply a comment for the web service submission.
This can be useful for giving more information about the used build for the test.

The necessary changes in testman will follow later :-P

svn path=/trunk/; revision=39698
2009-02-21 17:02:39 +00:00
Christoph von Wittich 25c067c47e sync mshtml and shdocvw winetests with wine 1.1.15
svn path=/trunk/; revision=39594
2009-02-13 18:47:09 +00:00
Christoph von Wittich 1d451b9296 sync jscript_winetest with wine 1.1.15
svn path=/trunk/; revision=39590
2009-02-13 18:05:50 +00:00
Colin Finck 43659c9ace - Add some checks to prevent crashes in unexpected situations and add useful error messages for them.
This should make debugging something like r39578 easier :-)
- Prevent some memory leaks in case of failure (well, some memory wasn't even freed in case of success :-P)

svn path=/trunk/; revision=39584
2009-02-13 17:39:58 +00:00
Christoph von Wittich 4a2b32d1ad add resource file to kernel32_winetest
this fixes all kernel32 resource tests
spotted by Giannis Adamopoulos

svn path=/trunk/; revision=39526
2009-02-10 09:25:02 +00:00
Dmitry Chapyshev 37a3abe6fe - Sync advapi32_winetest with Wine head
svn path=/trunk/; revision=39481
2009-02-08 09:32:24 +00:00
Christoph von Wittich 7c69e20a49 sync ole32_winetest with wine 1.14
svn path=/trunk/; revision=39474
2009-02-08 08:56:01 +00:00
Christoph von Wittich 25286fb023 sync oleaur32_winetest with wine 1.1.14
svn path=/trunk/; revision=39473
2009-02-08 08:55:17 +00:00
Christoph von Wittich 43eb75a9e4 sync mshtml and shdocvw winetests with wine 1.1.14
svn path=/trunk/; revision=39390
2009-02-04 14:36:08 +00:00
Gregor Schneider 7da4798c20 Testcase extension by Evgeny Boltik <BSTSoft AT narod DOT ru>:
- Test StretchBlt ROP codes similar to BitBlt
- Offset drawing coordinates with SetWindowOrgEx
- Show an overview of several hatched brushes
- This was used to test r39336, r39332 and r39326 and the src&dst StretchBlt ROP support

svn path=/trunk/; revision=39337
2009-02-03 16:11:31 +00:00
Timo Kreuzer 849e2133ac Add tests for SetWindowExtEx, one more test for CreateCompatibleDC
svn path=/trunk/; revision=39280
2009-02-02 00:37:01 +00:00
Christoph von Wittich 9b57ce8177 sync wintrust_winetest with wine 1.1.14
svn path=/trunk/; revision=39256
2009-02-01 05:43:40 +00:00
Christoph von Wittich 15a996c26b sync shlwapi_winetest with wine 1.1.14
svn path=/trunk/; revision=39239
2009-01-31 14:49:08 +00:00
Christoph von Wittich 66e2845732 sync crypt32_winetest with wine 1.1.14
svn path=/trunk/; revision=39237
2009-01-31 14:31:11 +00:00
Christoph von Wittich fe9f224169 sync msi_winetest with wine 1.1.14
svn path=/trunk/; revision=39235
2009-01-31 14:17:07 +00:00
Christoph von Wittich 16d774c385 sync msxml3_winetest to wine 1.1.14
svn path=/trunk/; revision=39222
2009-01-31 11:27:33 +00:00
Timo Kreuzer fa581e2636 Add more tests for SetMapMode
svn path=/trunk/; revision=39201
2009-01-29 19:16:45 +00:00
Christoph von Wittich d1494fca12 fix stdole2 dependencies
svn path=/trunk/; revision=39037
2009-01-23 10:48:53 +00:00
Colin Finck 0cedc2a03c Output the string indicating the test which is going to be run in one call.
This should prevent a race condition, when another application also outputs something over the debug line.

svn path=/trunk/; revision=39027
2009-01-22 22:12:13 +00:00
KJK::Hyperion 64b55a2448 No harm in deleting this (it was previously disabled in r39016)
svn path=/trunk/; revision=39020
2009-01-22 16:12:02 +00:00
KJK::Hyperion 421738ed03 Wow, did you know about "test" modules? Seems nobody does, because they are broken in rbuild. Luckily, kernel32_test is the only such module left
svn path=/trunk/; revision=39016
2009-01-22 14:50:14 +00:00
Christoph von Wittich f2e519c99a sync netapi32_winetest with wine 1.1.13
svn path=/trunk/; revision=38981
2009-01-20 17:09:46 +00:00
Christoph von Wittich 7506e507ee sync wintrust_winetest to wine 1.1.13
svn path=/trunk/; revision=38944
2009-01-19 17:04:46 +00:00
Christoph von Wittich ab1f060739 sync crypt32_winetest with wine 1.1.13
svn path=/trunk/; revision=38943
2009-01-19 16:47:57 +00:00
Christoph von Wittich 326b221c21 skip crashing virtual tests
svn path=/trunk/; revision=38935
2009-01-19 12:04:09 +00:00
Christoph von Wittich 2fef907b66 fix handle leaks
svn path=/trunk/; revision=38927
2009-01-19 05:08:11 +00:00
Christoph von Wittich e67174808a hack: skipping RegisterWaitForSingleObject tests as they don't finish
svn path=/trunk/; revision=38926
2009-01-19 04:20:06 +00:00
Stefan Ginsberg 5986aff6bd - Remove outdated msvcrt Winetest compilation hack, add _CRT_NONSTDC_NO_DEPRECATE to silence the 'unlink' warnings
svn path=/trunk/; revision=38918
2009-01-18 21:35:18 +00:00
Christoph von Wittich 130bfcf51a sync ole32 winetest to wine 1.1.13
svn path=/trunk/; revision=38907
2009-01-18 19:23:06 +00:00
Stefan Ginsberg 60882e8641 - ws2_32 Winetest: Define __ROS_LONG64__
- rpcrt4 Winetest: Fix an implicit declaration warning -- this should be sent to Wine

svn path=/trunk/; revision=38897
2009-01-18 15:48:55 +00:00
Christoph von Wittich f47bbd7d27 re enable pipe tests
svn path=/trunk/; revision=38892
2009-01-18 14:10:28 +00:00
Stefan Ginsberg eef79b36ef - Fix warnings in ros' tests
svn path=/trunk/; revision=38887
2009-01-18 12:20:51 +00:00
Christoph von Wittich 0195906a3c sync msi_winetest with wine 1.1.13
svn path=/trunk/; revision=38876
2009-01-18 09:03:44 +00:00
Christoph von Wittich 16ccdf83b4 sync msacm32_winetest with wine 1.1.13
svn path=/trunk/; revision=38875
2009-01-18 08:59:27 +00:00
Christoph von Wittich aa7409c841 sync mapi32_winetest with wine 1.1.13
svn path=/trunk/; revision=38874
2009-01-18 08:56:17 +00:00
KJK::Hyperion bfc3948cfe Warning killing commit
modified   tests/polytest/polytest.cpp
   Use %ld to print LONGs, not %d

modified   tests/vmtest/vmtest.c
   Don't do pointer arithmetics on PVOID

Everything else
   Compile winetests with __ROS_LONG64__

svn path=/trunk/; revision=38873
2009-01-18 06:31:44 +00:00
Christoph von Wittich 9c245e9ec1 sync rsaenh_winetest with wine 1.1.13
svn path=/trunk/; revision=38848
2009-01-17 20:25:16 +00:00
Christoph von Wittich 8991e24d23 sync ws2_32_winetest with wine 1.1.13
svn path=/trunk/; revision=38847
2009-01-17 20:21:03 +00:00
Christoph von Wittich 56f186a682 sync comdlg32_winetest with wine 1.1.13
svn path=/trunk/; revision=38846
2009-01-17 20:15:01 +00:00
Christoph von Wittich be6f9a9db3 sync browseui_winetest with wine 1.1.13
svn path=/trunk/; revision=38845
2009-01-17 20:13:53 +00:00
Christoph von Wittich aecfced223 sync advpack_winetest with wine 1.1.13
svn path=/trunk/; revision=38844
2009-01-17 20:12:48 +00:00
Colin Finck be72d98a83 Convert all line-endings to LF first in StringOut before passing the strings to printf and OutputDebugStringA.
Both functions treat the string as text and convert the line-endings themselves to CRLF. If you already give them a CRLF line-ending, it'll be converted to CRCRLF..
By unifying the line-endings in StringOut, it is also possible now to pass both LF and CRLF to the function.

This should fix the empty lines in the BuildBot log.
Thanks to Christoph for the help!

svn path=/trunk/; revision=38840
2009-01-17 19:58:18 +00:00
Christoph von Wittich 63bca16061 sync cabinet_winetest with wine 1.1.13
svn path=/trunk/; revision=38830
2009-01-17 18:30:21 +00:00
Ged Murphy 4786fa151f update comctl32 winetest
svn path=/trunk/; revision=38829
2009-01-17 17:42:01 +00:00
Christoph von Wittich c331fd3dad sync riched20_winetest to wine 1.1.13
svn path=/trunk/; revision=38827
2009-01-17 17:13:11 +00:00
Michael Martin 31efcbd841 - Revert 38719.
svn path=/trunk/; revision=38720
2009-01-12 12:29:53 +00:00
Michael Martin 5888e8aa1c - Re-enable pipe tests as the npfs driver is in much better shape.
- Change the timeout value passed to WaitForSingleObject to 20 so tests pass on slower systems.
- Re-enable process console test as they now complete.

svn path=/trunk/; revision=38719
2009-01-12 12:13:54 +00:00
KJK::Hyperion 7c38c73a99 modified tests/pseh2/psehtest.c
Don't obscure the names of testcases with macro trickery. It gets old fast
   Regression test for #4004 (fixed in r38668)

svn path=/trunk/; revision=38669
2009-01-09 16:38:28 +00:00
Timo Kreuzer ce56804010 More tests for NtGdiCreateDIBSection
svn path=/trunk/; revision=38657
2009-01-09 00:52:04 +00:00
Timo Kreuzer 132c804512 More tests for GetObject
svn path=/trunk/; revision=38656
2009-01-09 00:50:20 +00:00
Colin Finck 4cc7302baf - It actually wasn't a very good idea to authenticate against the MD5 password hash instead of the password itself.
This didn't really improve security, but just made things more difficult for the user. Change that, so the web service and rosautotest expect a password in the "rosautotest.ini" file now.
- Read the "rosautotest.ini" from the application's directory instead of the Windows directory.
- Little adjustmensts here and there

svn path=/trunk/; revision=38655
2009-01-08 23:09:10 +00:00
Timo Kreuzer 39c466cd17 Tests for NtGdiCreateDIBSection and NtGdiExtTextOutW
svn path=/trunk/; revision=38636
2009-01-08 00:34:38 +00:00
Colin Finck d2148478c6 Introducing the "ReactOS Automatic Testing Utility", superseding our current syssetup/cmd/dbgprint hack for running automatic regression tests.
Without any parameters, it mostly works the same as our current solution, but all in a standalone application.
Adding the /w parameter will submit all results to the web service committed in my previous commit.

The application would also make it possible to run Wine Tests regularly on a Windows machine and submitting the results.
This would make sure that all Wine tests also pass under Windows.

svn path=/trunk/; revision=38580
2009-01-05 12:41:34 +00:00
Christoph von Wittich 35f9beeabd enable oleaut32_winetest
svn path=/trunk/; revision=38575
2009-01-05 08:02:13 +00:00
Timo Kreuzer bd38886763 Add tests for CreateFontIndirect
svn path=/trunk/; revision=38571
2009-01-04 21:48:32 +00:00
Christoph von Wittich bda8492140 sync oleaut32_winetest with wine 1.1.12
svn path=/trunk/; revision=38570
2009-01-04 19:19:05 +00:00
Christoph von Wittich 35f684f9d5 sync ole32_winetest with wine 1.1.12
svn path=/trunk/; revision=38569
2009-01-04 17:52:22 +00:00
Christoph von Wittich 7d6f7e3e2f sync browseui_winetest with wine 1.1.12
svn path=/trunk/; revision=38557
2009-01-04 11:34:13 +00:00
Christoph von Wittich 97415b80b6 sync hlink_winetest with wine 1.1.12
svn path=/trunk/; revision=38556
2009-01-04 11:33:07 +00:00
Christoph von Wittich 64915ab8ed sync iphlpapi_winetest with wine 1.1.12
svn path=/trunk/; revision=38555
2009-01-04 11:31:13 +00:00
Christoph von Wittich 02a42aaf0d sync msxml3 with wine 1.1.12 (2/2)
svn path=/trunk/; revision=38554
2009-01-04 10:48:31 +00:00
Christoph von Wittich 3befe40733 add func_iphlpapi winetest from wine 1.1.11
svn path=/trunk/; revision=38466
2008-12-30 09:10:17 +00:00
Christoph von Wittich 8845107b6e add ws2_32 winetest from wine 1.1.11
svn path=/trunk/; revision=38464
2008-12-30 09:04:22 +00:00
KJK::Hyperion 030aa56625 modified tests/pseh2/psehtest.c
finally_13 test re-enabled, as it doesn't crash anymore
   finally_14 test fixed. Now we know how exceptions thrown in a __finally are supposed to be handled
   PSEH test suite now has 91 tests and passes all of them with both GCC and Visual C++

svn path=/trunk/; revision=38461
2008-12-30 04:04:51 +00:00
Christoph von Wittich 7b72ed4a02 fix copy and paste error
svn path=/trunk/; revision=38451
2008-12-29 10:30:50 +00:00
Christoph von Wittich ca3c085687 add crypt32 winetest from wine 1.1.11
svn path=/trunk/; revision=38449
2008-12-29 10:10:25 +00:00
Christoph von Wittich 789db79fc6 add wintrust winetest from wine 1.1.11
svn path=/trunk/; revision=38447
2008-12-29 09:53:21 +00:00
Christoph von Wittich 5f2dcdc0e9 add jscript winetest from wine 1.1.11
svn path=/trunk/; revision=38445
2008-12-29 09:41:56 +00:00
Christoph von Wittich 00f0db8d9a sync urlmon winetest to wine 1.1.11
svn path=/trunk/; revision=38443
2008-12-29 08:42:01 +00:00
Christoph von Wittich 439cb72ec1 sync riched20 winetest to wine 1.1.11
svn path=/trunk/; revision=38441
2008-12-29 08:27:52 +00:00
Christoph von Wittich 97d06533f8 sync browseui winetest to wine 1.1.11
svn path=/trunk/; revision=38417
2008-12-28 11:31:26 +00:00
Christoph von Wittich 5389561279 sync usp10 winetest to wine 1.1.11
svn path=/trunk/; revision=38416
2008-12-28 11:28:48 +00:00
Christoph von Wittich 1eee77ac31 sync version winetest to wine 1.1.11
svn path=/trunk/; revision=38415
2008-12-28 11:27:26 +00:00
Christoph von Wittich 7222acc172 sync lz32 winetest to wine 1.1.11
svn path=/trunk/; revision=38414
2008-12-28 11:24:41 +00:00
Christoph von Wittich 8fccb16c05 sync mstask winetest to wine 1.1.11
svn path=/trunk/; revision=38413
2008-12-28 11:22:23 +00:00
Christoph von Wittich bcf598695c sync comdlg32 winetest to wine 1.1.11
svn path=/trunk/; revision=38411
2008-12-28 10:42:08 +00:00
Christoph von Wittich fa9df3812d sync advpack winetest to wine 1.1.11
svn path=/trunk/; revision=38409
2008-12-28 10:36:50 +00:00
Christoph von Wittich 90081c908c sync comcat winetest to wine 1.1.11
svn path=/trunk/; revision=38408
2008-12-28 10:35:04 +00:00
Christoph von Wittich 785e3fd869 sync cabinet winetest to wine 1.1.11
svn path=/trunk/; revision=38407
2008-12-28 10:32:41 +00:00
Christoph von Wittich 4e0fcb2fa5 sync msi winetest to wine 1.1.11
svn path=/trunk/; revision=38406
2008-12-28 10:25:32 +00:00
KJK::Hyperion 456b1c9e58 Now a single test suite with 89 tests, instead of 89 test suites with 1 test each
Added dummy implementations of sanity checks for compilers/architectures I didn't write them for yet. Long story short: now compiles and runs with Visual C++, both x86 and x64
Added copyright/license header

svn path=/trunk/; revision=38339
2008-12-24 23:22:04 +00:00