Do I have to have a default browser?

No there is not any option to set no default web browser. if you didn’t set any web browser and having windows operating system then Internet Explorer will be the default web browser.