I've Been There, Don't You Think?

This happened probably around 2002. I'm with a friend called Dave, we're looking for my sister and we go around the corner from my house down where they're building a bunch of houses. A guy randomly shows up out of the blue behind us and grabs hold of me. upstairs there's like this constant tapping sound and it can't be a builder by himself at like 11 p.m. surely. So that entire night I was just looking at my window hoping no cops would come. They didn't in the end and he obviously did all of that just to scare me but why? The situation is scary because a guy randomly grabbing a hold of you in the street in pitch black darkness