Each testcase should also recompile to be recompiled. So backed out for now.
Rerun supported for Python, PHP, Perl, Ruby, and Java modules.