This is usually caused by not holding the torch or lighter perfectly straight, so take a moment to readjust your grip before you continue. Let The Lighter Reset For A Moment And Readjust The Flame ...

The Arm of Beowulf KCD2 perk will allow you to use a longsword while holding a torch but know that you'll use up much more stamina fighting this way.