ValueHead's dropout

[prabhuteja12]

Hi,

What is the rationale behind summary_dropout_prob = kwargs.pop("summary_dropout_prob", 0.1) in the ValueHead class. I would assume not specifying dropout wouldn't use dropout, but here it uses it.

Thank you!