Reference for ultralytics/models/sam/modules/tiny_encoder.py
Note
Full source code for this file is available at https://github.com/ultralytics/ultralytics/blob/main/ultralytics/models/sam/modules/tiny_encoder.py. Help us fix any issues you see by submitting a Pull Request 🛠️. Thank you 🙏!
ultralytics.models.sam.modules.tiny_encoder.Conv2d_BN
Bases: Sequential
Source code in ultralytics/models/sam/modules/tiny_encoder.py
ultralytics.models.sam.modules.tiny_encoder.PatchEmbed
Bases: Module
Source code in ultralytics/models/sam/modules/tiny_encoder.py
ultralytics.models.sam.modules.tiny_encoder.MBConv
Bases: Module
Source code in ultralytics/models/sam/modules/tiny_encoder.py
ultralytics.models.sam.modules.tiny_encoder.PatchMerging
Bases: Module
Source code in ultralytics/models/sam/modules/tiny_encoder.py
ultralytics.models.sam.modules.tiny_encoder.ConvLayer
Bases: Module
Source code in ultralytics/models/sam/modules/tiny_encoder.py
ultralytics.models.sam.modules.tiny_encoder.Mlp
Bases: Module
Source code in ultralytics/models/sam/modules/tiny_encoder.py
ultralytics.models.sam.modules.tiny_encoder.Attention
Bases: Module
Source code in ultralytics/models/sam/modules/tiny_encoder.py
ultralytics.models.sam.modules.tiny_encoder.TinyViTBlock
Bases: Module
TinyViT Block.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
dim |
int
|
Number of input channels. |
required |
input_resolution |
tuple[int, int]
|
Input resolution. |
required |
num_heads |
int
|
Number of attention heads. |
required |
window_size |
int
|
Window size. |
7
|
mlp_ratio |
float
|
Ratio of mlp hidden dim to embedding dim. |
4.0
|
drop |
float
|
Dropout rate. Default: 0.0 |
0.0
|
drop_path |
float
|
Stochastic depth rate. Default: 0.0 |
0.0
|
local_conv_size |
int
|
the kernel size of the convolution between Attention and MLP. Default: 3 |
3
|
activation |
nn
|
the activation function. Default: nn.GELU |
GELU
|
Source code in ultralytics/models/sam/modules/tiny_encoder.py
247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 |
|
ultralytics.models.sam.modules.tiny_encoder.BasicLayer
Bases: Module
A basic TinyViT layer for one stage.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
dim |
int
|
Number of input channels. |
required |
input_resolution |
tuple[int]
|
Input resolution. |
required |
depth |
int
|
Number of blocks. |
required |
num_heads |
int
|
Number of attention heads. |
required |
window_size |
int
|
Local window size. |
required |
mlp_ratio |
float
|
Ratio of mlp hidden dim to embedding dim. |
4.0
|
drop |
float
|
Dropout rate. Default: 0.0 |
0.0
|
drop_path |
float | tuple[float]
|
Stochastic depth rate. Default: 0.0 |
0.0
|
downsample |
Module | None
|
Downsample layer at the end of the layer. Default: None |
None
|
use_checkpoint |
bool
|
Whether to use checkpointing to save memory. Default: False. |
False
|
local_conv_size |
int
|
the kernel size of the depthwise convolution between attention and MLP. Default: 3 |
3
|
activation |
nn
|
the activation function. Default: nn.GELU |
GELU
|
out_dim |
int | optional
|
the output dimension of the layer. Default: None |
None
|
Source code in ultralytics/models/sam/modules/tiny_encoder.py
ultralytics.models.sam.modules.tiny_encoder.LayerNorm2d
Bases: Module
Source code in ultralytics/models/sam/modules/tiny_encoder.py
ultralytics.models.sam.modules.tiny_encoder.TinyViT
Bases: Module
Source code in ultralytics/models/sam/modules/tiny_encoder.py
428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 |
|