Yes. Provided it's at least warm so there's pressure in the lighter. Guys up there light cigarettes with 'em (even though they shouldn't), right?
The Hammer guys took their unit up with some skydivers (basically the same deal, but the lighter is built in), IIRC they took it to 16,000 feet...