Remove from heat and add 1 piece of butter about the size of a walnut and a ... from heat and add the peanut butter, butter and vanilla. Stir to combine and mix until fudge begins to thicken.