I stitch over the end of the removed boo boo and use tiny stitches to anchor the lose ends. Then quilt as normal.

Well heck, I always take it all out for fear it will continue to come out. Fray Check, I used to use that all the time....