How do I get rid of my default browser?

Switch it out by opening the Charms bar and clicking the Settings icon. At the Settings pane, click Change PC Settings > Search and apps > Defaults. From here, the process is similar to Windows 10; click the current default for Web browser and change it to the browser of your choice.