Salesforce's XGen 7B Language Model

Salesforce released an 8K sequence link with up to 1.5 trillion tokens. The size is like the size of input it can take and also the size of output, as well. Salesforce claims that it's LLM achieves comparable or better results than current state-of-the-art language models for a similar size.