Chutzpah - A JavaScript Test Runner

New Post: Coverage report filename

mmanela — Fri, 24 May 2013 15:08:35 GMT

Sure, I will look into adding this for a future release. I can add it to both places for more flexibility. Would you mind filing an work item on the issues page with this suggestion. This way I can track it better and let you know when its done.

New Post: Code Coverage for AMD Modules

mmanela — Fri, 24 May 2013 15:07:14 GMT

This is currently a limitation of Chutzpah where it doesn't run code coverage on the html file. There are also known issues with running AMD using the .js file.

I plan to work on making AMD work better for the .js files and for an overall more robust solution I plan to add the ability to define HTML templates. The way this will work is you will not use your own HTML file but create an HTML template which Chutzpah will instantiate and use. This should give you the flexibility to configure your AMD code fully and till get the benefits of running on a .js file and get code coverage.

I plan to add this feature for the next major release. Does that make sense?

New Post: Code Coverage for AMD Modules

rasane — Fri, 24 May 2013 13:52:27 GMT

Hi,

I have trouble getting Chutzpah report code coverage for 'require.js' AMD modules..

To demonstrate the problem here is a simple test project: https://bitbucket.org/rasane/chutzpahamdcoveragetest/ and help..

I can: run the command, from the tests folder:
....\packages\Chutzpah.2.4.1\tools\chutzpah.console.exe AMDTests.html /coverage
and get success/failure of tests.. but i cannot get coverage reports..

IF I try using the js file to get coverage, it reports an error..
....\packages\Chutzpah.2.4.1\tools\chutzpah.console.exe AMDTests.js /coverage
reported error:
JS Error: Timeout occured when executing test file

But If I try a non AMD Module in the solution, it works
....\packages\Chutzpah.2.4.1\tools\chutzpah.console.exe nonAMDSample.js /coverage

Tests complete: 1
Code Coverage Results Average Coverage: 100%

 100% for C:\Temp\deleteme\vs2012\testRest\Chutz

I would like the html to report a similar report or the js file with AMD module in it, to report coverage..

Any ideas?
Thanks for your time...
rasane

New Post: Coverage report filename

andyd70 — Fri, 24 May 2013 13:43:22 GMT

Being able to set the output folder would be good, being able to set both the output folder and the output filename would be better :)

Personally I'd prefer it (or them) set via the command line switches as my build uses nAnt so I don't rely on a .json config file but having the option any way would be good, having it both ways would be better :)

New Post: Coverage report filename

mmanela — Fri, 24 May 2013 13:29:02 GMT

That is a good suggestion and I will look to add it in a future release.

Would it work if I let you set the CoverageOutputFolder in the chutzpah.json file?

Commented Unassigned: I can't seem to test any AMD (RequireJS) modules with QUnit [127]

mmanela — Fri, 24 May 2013 13:21:10 GMT

New Post: Would love to see that write up on RequireJs running in Chutzpah for VS2012

DotNetWise — Fri, 24 May 2013 11:47:49 GMT

I still can't this working.
VS2012/Chutzpah will still not discover my tests if they are in a define/require statements.
It seems that requireJS will not even try to download the scripts from visual studio for some reason.

Commented Unassigned: I can't seem to test any AMD (RequireJS) modules with QUnit [127]

DotNetWise — Fri, 24 May 2013 10:14:42 GMT

Is there any How tos ?
I have tried all bunch of combinations but none of them work.
The tests are running way too early before the async modules have even been loaded.

Without AMD you can't test Durandal or other modules that are loaded with RequireJS.
Comments: Yes, been there, checked that. There is no way of getting it working really. If you do ``` define("someting", ["module"], function(module) { test("abcd", function() { }); }); ``` The test is not even "discoverable" on test explorer. If you do ``` asyncTest("abcd", 1, function () { setTimeout(function () { QUnit.start(); ok(true, "always fine"); }, 10); }); ``` Then the test is both descoverable in test explorer and passes! However if you do ``` asyncTest("abcd", 1, function () { require(["config"], function (register) { QUnit.start(); ok(true, "always fine"); }); }); ``` The test will be discoverable but will simply timeout! :( I think the problem in any case is that chutzpah is really not aware of requirejs in any way. It should detect when this is loaded and react accordingly e.g. wait for the module to be loaded and then executed.

New Post: Coverage report filename

andyd70 — Fri, 24 May 2013 07:51:35 GMT

Currently (v2.4.1.266) writes the coverage report files to the current directory.

Would it be possible to give either a fully-qualified or partial path (and filename) to dictate where these files are written?

Commented Unassigned: Support AMD loading using TypeScript [122]

mmanela — Fri, 24 May 2013 02:57:25 GMT

Support AMD loading (like with Require.js) using TypeScript
Comments: Currently AMD loading with TypeScript probably isn't possible with Chutzpah since it doesn't compile TypeScript in AMD mode. I had initially added that support but I ran into other issues with the output TypeScript generated. I will revisit this support in a future release.

Commented Unassigned: I can't seem to test any AMD (RequireJS) modules with QUnit [127]

mmanela — Fri, 24 May 2013 02:54:10 GMT

Created Unassigned: I can't seem to test any AMD (RequireJS) modules with QUnit [127]

DotNetWise — Thu, 23 May 2013 16:07:36 GMT

Commented Unassigned: Support AMD loading using TypeScript [122]

DotNetWise — Thu, 23 May 2013 15:45:11 GMT

Support AMD loading (like with Require.js) using TypeScript
Comments: I can't seem to get AMD working outside TypeScript either

Commented Unassigned: Chutzpah.json is ignored by both test runner / unit test adapter [126]

mmanela — Thu, 23 May 2013 15:35:18 GMT

For some strange reason Chutzpah.json doesn't seem to be loaded/parsed at all

```
{
"RootReferencePathMode":"SettingsFileDirectory",
"TestFileTimeout": "1",
"CodeCoverageIncludes": [],
"CodeCoverageExcludes": ["jquery-2.0.0.js"]
}
```

I have tried a lot of options but none worked to exclude jquery from code coverage
Also SettingsFileDirectory is not picked up at all and you can't define it in Tools->Options of VS2012
Comments: Could you please provide me a sample zip which contains a repro of your issue? This way I can effectively validate your issue and either figure out what is wrong and/or fix a possible bug in chutzpah

Created Unassigned: Chutzpah.json is ignored by both test runner / unit test adapter [126]

DotNetWise — Thu, 23 May 2013 15:04:03 GMT

New Post: TFS 2012 build server error

qoolqat — Thu, 23 May 2013 14:29:27 GMT

user error! did not include new Chutzpah files into source control, only the changed ones.

My apologies.

New Post: TFS 2012 build server error

qoolqat — Thu, 23 May 2013 13:53:54 GMT

So the build server works (moof.spec.js passes) when I roll the Chutzpah version back to 2.3. I guess I can just leave it there for now.

New Post: TeamCity Integration Example

jmwolfe1008 — Wed, 22 May 2013 15:14:18 GMT

Thanks, jrummell, I studied that famous link quite a bit. Do you remember what kind of package you had that linked to Chutzpah? It seems Chutzpah only lives in the top level packages.config, and the VS package restore via CI (msbuild) doesn't restore that package. Visual Studio's package manager only lets me uninstall the package; no manage option. I believe this is why the solution build itself won't update it... because it doesn't find it in any project packages.config.

I am working around it by using a separate TeamCity build step (a Nuget Install runner) which DOES update chutzpah. This wastes build time because it's trying to update twice... once from the solution and then once in this step. I hope to continue to get support here and work through the issue so I can have it build with the solution itself.

And by VSS I didn't mean Visual Source Safe :). I mean source code control (generic). We are using SVN and moving to GIT in the next year.

New Post: TeamCity Integration Example

jrummell — Wed, 22 May 2013 14:16:04 GMT

I enabled package restore on build, and then referenced the executable in the packages directory. See Using NuGet without committing packages to source control.

And for crying out loud, why are you still using VSS? If you care about your code, try SVN, Git, Mercurial, TFS, etc :)

New Post: TFS 2012 build server error

qoolqat — Wed, 22 May 2013 12:23:31 GMT

I can't send a .zip, because I don't have access to the build machine, and it doesn't happen on my machine. Based on the error, it's happening when "moof.spec.js" is run, but as indicated above, "moof.spec.js" doesn't reference any other files... it just checks for a string ('moof') not to be null. So I was wondering if there might be some other file that Chutzpah needs in the build environment as a matter of it's normal course that it's not got?

Since it only recently started happening, I was wondering if it had to do with code coverage... since we wouldn't want to be popping up browsers with results on the build machine... but the .json settings file doesn't seem to have a switch for turning it off (I don't currently use a chutzpah.json settings file).