What sort of torch are you using @Ramahs ? I had a confusing experience like that when I was using the smallish ronxs dual. As soon as I used a more penetrative flame from my big buddy I got much more consistent results. If you've got a large torch, have a go with that.
I have the gandalf...