The Problem With Worthiness in LDS Culture

In researching for this topic, I pretty much ran against two trains of thought throughout our scriptures about worthiness. Either grace makes us all worthy, just like the scriptures you just read in Romans. Or second, nobody is worthy except Jesus himself, which is kind of what King Benjamin was talking about. So either way, it becomes problematic to think that we can decide who is worthy based on what someone is doing or not doing. It seems to go against scripture to me anyway.