After setup.py is adjusted you first have to start the test server using bin/testserver and after that running the tests using bin/test This will be later refactored to be more automatic.