Two points that @hakre didn't touch upon:
Code coverage
Doing pretty reporting on code coverage (visualizing how much code got executed) is not all that easy even so xDebug enables you do get going rather quickly there are a couple of edge cases and annoyances that take up quite some time to build.
PHPUnit helps you out with a nice report.
Reporting
The most important thing when testing is the ability to quickly figure out what went wrong.
Building a nice diff
yourself for all the stuff in PHP (exceptions, objects, strings, xml, json, etc.) is quite time consuming
Also at some point you will want to move to a continous Integration server like Jenkins
and a testing framework like PHPUnit will already produce all the needed artifacts (junit.xml, clover.xml) that enables you to set up CI for your projects in half an hour
.
So all in all even if you don't use all the advanced features and helpers (like mocking, process isolation to test legacy code, outputBuffering, exception helpers) you get a base setup that will be able to grow with you when your project grows and get more mature.
CLI only
Btw. there is a web interface to phpunit
called Visual PHPUnit
that runs in a browser. Even so, to be honest, I don't have any clue as to why anyone would want that. Maybe with out refresh but I'd rather a script loop on a cli terminal than. But to each their own :)