Merge pull request #1381 from ChristophReich1996/master

Fix typo in PositionalEncodingFourier
pull/1498/head
Ross Wightman 2 years ago committed by GitHub
commit 0e6023f032
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

@ -104,7 +104,7 @@ default_cfgs = {
@register_notrace_module # reason: FX can't symbolically trace torch.arange in forward method
class PositionalEncodingFourier(nn.Module):
"""
Positional encoding relying on a fourier kernel matching the one used in the "Attention is all of Need" paper.
Positional encoding relying on a fourier kernel matching the one used in the "Attention is all you Need" paper.
Based on the official XCiT code
- https://github.com/facebookresearch/xcit/blob/master/xcit.py
"""

Loading…
Cancel
Save