forked from lucidrains/perceiver-pytorch
-
-
Couldn't load subscription status.
- Fork 0
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Detailed Description
AS @JackKelly pointed out, the PerceiverIO paper uses a learnt embedding for the modality, while this uses a one-hot vector instead. Switching to a learnt embedding might be better?
Context
Possible Implementation
A torch.nn.Embedding with a vocab size set to the number of data sources
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request