PHPUnit always output “No tests executed!” on MacOS Big Sur

Question

When trying to run any PHPUnit tests, I always get a No tests executed! message on my MacOS machine. A simple way to reproduce, on this specific machine, is to install a fresh instance of Laravel and running the default tests : The expected output would be OK (2 tests, 2 assertions). As far as I know, this is not

Accepted Answer

tl;dr Apple broke version_compare by naming PHP 7.3.22-(to be removed in future macOS) in Big Sur. Installing another version of PHP fix this.I found the answer to my issue. It is indeed a MacOS issue, related to the built in version of PHP in MacOS Big Sur.After quite some debugging (on another project using PHPUnit 8), I endend up here :https://github.com/sebastianbergmann/phpunit/blob/ccbf3962a948112056b0eded6e4c880af4ee3695/src/Util/Configuration.php#L1041-L1055 private function satisfiesPhpVersion(DOMElement $node): bool { $phpVersion = PHP_VERSION; $phpVersionOperator = '>='; if ($node->hasAttribute('phpVersion')) { $phpVersion = (string) $node->getAttribute('phpVersion'); } if ($node->hasAttribute('phpVersionOperator')) { $phpVersionOperator = (string) $node->getAttribute('phpVersionOperator'); } return version_compare(PHP_VERSION, $phpVersion, (new VersionComparisonOperator($phpVersionOperator))->asString()); }When looking at the last line of PHPUnit code above (and since both $node->hasAttribute('phpVersion') and $node->hasAttribute('phpVersionOperator') return false), the return statement can be simplified to:version_compare(PHP_VERSION, PHP_VERSION, '>=')Now, because the version of PHP that ships with MacOS got deprecated in Big Sur, Apple renamed the version to 7.3.22-(to be removed in future macOS). This is what caused the issue, as the above code now become :version_compare("7.3.22-(to be removed in future macOS)", "7.3.22-(to be removed in future macOS)", '>=')Which return false instead of true.A simple way to test :$foo = version_compare("7.3.22-(to be removed in future macOS)", "7.3.22-(to be removed in future macOS)", '>=');var_dump($foo); // bool(false)$bar = version_compare("7.3.22", "7.3.22", '>=');var_dump($bar); // bool(true)That is probably because, as explained in the official PHP Documentation…The function first replaces _, – and + with a dot . in the version strings and also inserts dots . before and after any non number so that for example ‘4.3.2RC1’ becomes ‘4.3.2.RC.1’. Then it compares the parts starting from left to right. If a part contains special version strings these are handled in the following order: any string not found in this list < dev < alpha = a < beta = b < RC = rc < # < pl = p. This way not only versions with different levels like ‘4.1’ and ‘4.1.2’ can be compared but also any PHP specific version containing development state.Note that pre-release versions, such as 5.3.0-dev, are considered lower than their final release counterparts (like 5.3.0).…the naming scheme of Apple is probably treated as a pre-release version inferior to itself instead of being equal to itself.So the fix would to overwrite the php version, which can’t be done globally as far as I know. Installing another version of PHP using Homebrew seems the easiest solution

PHPUnit always output “No tests executed!” on MacOS Big Sur

EDIT – Dec. 1st 2020

Edit #2 – Dec 1st 2020

Edit – Dec 2nd 2020

Advertisement

Answer