The Lower East Side and New York City

When did you first land in kind of the Lower East Side and start to have a kind of like cultural experience of New York? I got a scholarship to an old boys Catholic school on the Upper East Side. I commuted every day from New Jersey two hours each way. And it led to my being kicked out of high school in the middle of junior year because, well, I didn't understand algebra at all.