Hello friend,
My opinion, leave it in. You determine the size of the hit, not the restrictor disc. The disc makes the whole process less of a hassle, which means a more enjoyable experience. Whatever you choose to do, stick with one setup for an entire torch-full so you can get a feel for it...