The key to swami Vivekananda's apparent contractariness is that we are not all the same. We have various mental constitutions, some devotional by nature and others philosophical or meditative. So there is something or the other which will work for you. The truth will point out the same truth within us but since we are trapped in different ways, the methods of freeing us also must be a little different.
Shiva Mahimna Stotra is a Sanskrit composition in the devotion to Shiva that is believed to have been composed by a Gandharva named Pushpadanta. It lists Shiva's various achievements and qualities. Swami Sarvapriyananda speaks on these verses on the auspicious occasion of Shivaratri.