The Impact of Adding New Modalities to AI Models

Adding new modalities like video can enhance the model's capabilities and access to knowledge/nFine-tuning the models can lead to mode collapse and reduction in variety of outputs/nFine-tuning may result in degradation of the model's capabilities due to smaller data set and noise