Zeroing LSTM input

Question

I have a trained LSTM network with 128 channels and 500 data point in each channel. After training and testing, I am interested in testing the model again with the same test data with specific channel zeroed. Would a huge drop in F1-Score show that the most important features are in these channels or am I doing something wrong ?