Skip to content
This repository was archived by the owner on Sep 10, 2025. It is now read-only.

Conversation

@swolchok
Copy link
Contributor

No description provided.

@pytorch-bot
Copy link

pytorch-bot bot commented Nov 11, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/torchchat/1364

Note: Links to docs will display an error until the docs builds have been completed.

❌ 17 New Failures, 3 Cancelled Jobs

As of commit 2e01d01 with merge base e30aaa0 (image):

NEW FAILURES - The following jobs have failed:

  • pull / runner-aoti (16-core-ubuntu) (gh)
    ERROR: Could not find a version that satisfies the requirement torchvision==0.20.0.dev20241109 (from versions: 0.12.0, 0.13.0, 0.13.1, 0.14.0, 0.14.1, 0.15.1, 0.15.2, 0.16.0, 0.16.1, 0.16.2, 0.17.0, 0.17.1, 0.17.2, 0.18.0, 0.18.1, 0.19.0, 0.19.1, 0.20.0.dev20240913+cpu, 0.20.0.dev20240914+cpu, 0.20.0.dev20240915+cpu, 0.20.0.dev20240916+cpu, 0.20.0.dev20240917+cpu, 0.20.0.dev20240918+cpu, 0.20.0.dev20240919+cpu, 0.20.0.dev20240920+cpu, 0.20.0.dev20240921+cpu, 0.20.0.dev20240922+cpu, 0.20.0.dev20240923+cpu, 0.20.0.dev20240924+cpu, 0.20.0.dev20240925+cpu, 0.20.0.dev20240926+cpu, 0.20.0.dev20240927+cpu, 0.20.0.dev20240928+cpu, 0.20.0.dev20240929+cpu, 0.20.0.dev20240930+cpu, 0.20.0.dev20241001+cpu, 0.20.0.dev20241002+cpu, 0.20.0.dev20241003+cpu, 0.20.0.dev20241004+cpu, 0.20.0.dev20241005+cpu, 0.20.0.dev20241006+cpu, 0.20.0.dev20241007+cpu, 0.20.0.dev20241008+cpu, 0.20.0.dev20241009+cpu, 0.20.0.dev20241010+cpu, 0.20.0.dev20241011+cpu, 0.20.0.dev20241012+cpu, 0.20.0.dev20241013+cpu, 0.20.0.dev20241014+cpu, 0.20.0.dev20241015+cpu, 0.20.0.dev20241016+cpu, 0.20.0.dev20241017+cpu, 0.20.0.dev20241018+cpu, 0.20.0.dev20241019+cpu, 0.20.0.dev20241020+cpu, 0.20.0.dev20241021+cpu, 0.20.0.dev20241022+cpu, 0.20.0.dev20241023+cpu, 0.20.0.dev20241024+cpu, 0.20.0.dev20241025+cpu, 0.20.0.dev20241026+cpu, 0.20.0.dev20241027+cpu, 0.20.0.dev20241028+cpu, 0.20.0.dev20241029+cpu, 0.20.0.dev20241030+cpu, 0.20.0.dev20241031+cpu, 0.20.0.dev20241101+cpu, 0.20.0.dev20241102+cpu, 0.20.0.dev20241103+cpu, 0.20.0.dev20241104+cpu, 0.20.0.dev20241105+cpu, 0.20.0.dev20241106+cpu, 0.20.0.dev20241107+cpu, 0.20.0, 0.20.1)
  • pull / runner-et (16-core-ubuntu) (gh)
    ERROR: Could not find a version that satisfies the requirement torchvision==0.20.0.dev20241109 (from versions: 0.12.0, 0.13.0, 0.13.1, 0.14.0, 0.14.1, 0.15.1, 0.15.2, 0.16.0, 0.16.1, 0.16.2, 0.17.0, 0.17.1, 0.17.2, 0.18.0, 0.18.1, 0.19.0, 0.19.1, 0.20.0.dev20240913+cpu, 0.20.0.dev20240914+cpu, 0.20.0.dev20240915+cpu, 0.20.0.dev20240916+cpu, 0.20.0.dev20240917+cpu, 0.20.0.dev20240918+cpu, 0.20.0.dev20240919+cpu, 0.20.0.dev20240920+cpu, 0.20.0.dev20240921+cpu, 0.20.0.dev20240922+cpu, 0.20.0.dev20240923+cpu, 0.20.0.dev20240924+cpu, 0.20.0.dev20240925+cpu, 0.20.0.dev20240926+cpu, 0.20.0.dev20240927+cpu, 0.20.0.dev20240928+cpu, 0.20.0.dev20240929+cpu, 0.20.0.dev20240930+cpu, 0.20.0.dev20241001+cpu, 0.20.0.dev20241002+cpu, 0.20.0.dev20241003+cpu, 0.20.0.dev20241004+cpu, 0.20.0.dev20241005+cpu, 0.20.0.dev20241006+cpu, 0.20.0.dev20241007+cpu, 0.20.0.dev20241008+cpu, 0.20.0.dev20241009+cpu, 0.20.0.dev20241010+cpu, 0.20.0.dev20241011+cpu, 0.20.0.dev20241012+cpu, 0.20.0.dev20241013+cpu, 0.20.0.dev20241014+cpu, 0.20.0.dev20241015+cpu, 0.20.0.dev20241016+cpu, 0.20.0.dev20241017+cpu, 0.20.0.dev20241018+cpu, 0.20.0.dev20241019+cpu, 0.20.0.dev20241020+cpu, 0.20.0.dev20241021+cpu, 0.20.0.dev20241022+cpu, 0.20.0.dev20241023+cpu, 0.20.0.dev20241024+cpu, 0.20.0.dev20241025+cpu, 0.20.0.dev20241026+cpu, 0.20.0.dev20241027+cpu, 0.20.0.dev20241028+cpu, 0.20.0.dev20241029+cpu, 0.20.0.dev20241030+cpu, 0.20.0.dev20241031+cpu, 0.20.0.dev20241101+cpu, 0.20.0.dev20241102+cpu, 0.20.0.dev20241103+cpu, 0.20.0.dev20241104+cpu, 0.20.0.dev20241105+cpu, 0.20.0.dev20241106+cpu, 0.20.0.dev20241107+cpu, 0.20.0, 0.20.1)
  • pull / test-build-runner-et-android / linux-job (gh)
    RuntimeError: Command docker exec -t 659720e7bc36df80c5dfdd3892a918d748b874224757f347a057ec8e0199d28e /exec failed with exit code 1
  • pull / test-cpu-aoti (aarch64, stories15M) (gh)
    .ci/scripts/validate.sh: line 130: 3061 Segmentation fault: 11 python3 -W ignore torchchat.py generate --dtype ${DTYPE} --checkpoint-path "$CHECKPOINT_PATH" --temperature 0 --aoti-package-path ${MODEL_DIR}/${MODEL_NAME}.pt2 --device "$TARGET_DEVICE" > "$MODEL_DIR/output_aoti"
  • pull / test-cpu-aoti (x86_64, stories15M) (gh)
    ERROR: Could not find a version that satisfies the requirement torchvision==0.20.0.dev20241109 (from versions: 0.12.0, 0.13.0, 0.13.1, 0.14.0, 0.14.1, 0.15.1, 0.15.2, 0.16.0, 0.16.1, 0.16.2, 0.17.0, 0.17.1, 0.17.2, 0.18.0, 0.18.1, 0.19.0, 0.19.1, 0.20.0.dev20240913+cpu, 0.20.0.dev20240914+cpu, 0.20.0.dev20240915+cpu, 0.20.0.dev20240916+cpu, 0.20.0.dev20240917+cpu, 0.20.0.dev20240918+cpu, 0.20.0.dev20240919+cpu, 0.20.0.dev20240920+cpu, 0.20.0.dev20240921+cpu, 0.20.0.dev20240922+cpu, 0.20.0.dev20240923+cpu, 0.20.0.dev20240924+cpu, 0.20.0.dev20240925+cpu, 0.20.0.dev20240926+cpu, 0.20.0.dev20240927+cpu, 0.20.0.dev20240928+cpu, 0.20.0.dev20240929+cpu, 0.20.0.dev20240930+cpu, 0.20.0.dev20241001+cpu, 0.20.0.dev20241002+cpu, 0.20.0.dev20241003+cpu, 0.20.0.dev20241004+cpu, 0.20.0.dev20241005+cpu, 0.20.0.dev20241006+cpu, 0.20.0.dev20241007+cpu, 0.20.0.dev20241008+cpu, 0.20.0.dev20241009+cpu, 0.20.0.dev20241010+cpu, 0.20.0.dev20241011+cpu, 0.20.0.dev20241012+cpu, 0.20.0.dev20241013+cpu, 0.20.0.dev20241014+cpu, 0.20.0.dev20241015+cpu, 0.20.0.dev20241016+cpu, 0.20.0.dev20241017+cpu, 0.20.0.dev20241018+cpu, 0.20.0.dev20241019+cpu, 0.20.0.dev20241020+cpu, 0.20.0.dev20241021+cpu, 0.20.0.dev20241022+cpu, 0.20.0.dev20241023+cpu, 0.20.0.dev20241024+cpu, 0.20.0.dev20241025+cpu, 0.20.0.dev20241026+cpu, 0.20.0.dev20241027+cpu, 0.20.0.dev20241028+cpu, 0.20.0.dev20241029+cpu, 0.20.0.dev20241030+cpu, 0.20.0.dev20241031+cpu, 0.20.0.dev20241101+cpu, 0.20.0.dev20241102+cpu, 0.20.0.dev20241103+cpu, 0.20.0.dev20241104+cpu, 0.20.0.dev20241105+cpu, 0.20.0.dev20241106+cpu, 0.20.0.dev20241107+cpu, 0.20.0, 0.20.1)
  • pull / test-cpu-compile (x86_64, stories15M) (gh)
    ERROR: Could not find a version that satisfies the requirement torchvision==0.20.0.dev20241109 (from versions: 0.12.0, 0.13.0, 0.13.1, 0.14.0, 0.14.1, 0.15.1, 0.15.2, 0.16.0, 0.16.1, 0.16.2, 0.17.0, 0.17.1, 0.17.2, 0.18.0, 0.18.1, 0.19.0, 0.19.1, 0.20.0.dev20240913+cpu, 0.20.0.dev20240914+cpu, 0.20.0.dev20240915+cpu, 0.20.0.dev20240916+cpu, 0.20.0.dev20240917+cpu, 0.20.0.dev20240918+cpu, 0.20.0.dev20240919+cpu, 0.20.0.dev20240920+cpu, 0.20.0.dev20240921+cpu, 0.20.0.dev20240922+cpu, 0.20.0.dev20240923+cpu, 0.20.0.dev20240924+cpu, 0.20.0.dev20240925+cpu, 0.20.0.dev20240926+cpu, 0.20.0.dev20240927+cpu, 0.20.0.dev20240928+cpu, 0.20.0.dev20240929+cpu, 0.20.0.dev20240930+cpu, 0.20.0.dev20241001+cpu, 0.20.0.dev20241002+cpu, 0.20.0.dev20241003+cpu, 0.20.0.dev20241004+cpu, 0.20.0.dev20241005+cpu, 0.20.0.dev20241006+cpu, 0.20.0.dev20241007+cpu, 0.20.0.dev20241008+cpu, 0.20.0.dev20241009+cpu, 0.20.0.dev20241010+cpu, 0.20.0.dev20241011+cpu, 0.20.0.dev20241012+cpu, 0.20.0.dev20241013+cpu, 0.20.0.dev20241014+cpu, 0.20.0.dev20241015+cpu, 0.20.0.dev20241016+cpu, 0.20.0.dev20241017+cpu, 0.20.0.dev20241018+cpu, 0.20.0.dev20241019+cpu, 0.20.0.dev20241020+cpu, 0.20.0.dev20241021+cpu, 0.20.0.dev20241022+cpu, 0.20.0.dev20241023+cpu, 0.20.0.dev20241024+cpu, 0.20.0.dev20241025+cpu, 0.20.0.dev20241026+cpu, 0.20.0.dev20241027+cpu, 0.20.0.dev20241028+cpu, 0.20.0.dev20241029+cpu, 0.20.0.dev20241030+cpu, 0.20.0.dev20241031+cpu, 0.20.0.dev20241101+cpu, 0.20.0.dev20241102+cpu, 0.20.0.dev20241103+cpu, 0.20.0.dev20241104+cpu, 0.20.0.dev20241105+cpu, 0.20.0.dev20241106+cpu, 0.20.0.dev20241107+cpu, 0.20.0, 0.20.1)
  • pull / test-cpu-eval-sanity-check (x86_64, stories15M) (gh)
    ERROR: Ignored the following yanked versions: 0.1.6, 0.1.7, 0.1.8, 0.1.9, 0.2.0, 0.2.1, 0.2.2, 0.2.2.post2, 0.2.2.post3, 0.15.0
  • pull / test-cpu-eval-sanity-check-float16 (x86_64, stories15M) (gh)
    ERROR: Could not find a version that satisfies the requirement torchvision==0.20.0.dev20241109 (from versions: 0.12.0, 0.13.0, 0.13.1, 0.14.0, 0.14.1, 0.15.1, 0.15.2, 0.16.0, 0.16.1, 0.16.2, 0.17.0, 0.17.1, 0.17.2, 0.18.0, 0.18.1, 0.19.0, 0.19.1, 0.20.0.dev20240913+cpu, 0.20.0.dev20240914+cpu, 0.20.0.dev20240915+cpu, 0.20.0.dev20240916+cpu, 0.20.0.dev20240917+cpu, 0.20.0.dev20240918+cpu, 0.20.0.dev20240919+cpu, 0.20.0.dev20240920+cpu, 0.20.0.dev20240921+cpu, 0.20.0.dev20240922+cpu, 0.20.0.dev20240923+cpu, 0.20.0.dev20240924+cpu, 0.20.0.dev20240925+cpu, 0.20.0.dev20240926+cpu, 0.20.0.dev20240927+cpu, 0.20.0.dev20240928+cpu, 0.20.0.dev20240929+cpu, 0.20.0.dev20240930+cpu, 0.20.0.dev20241001+cpu, 0.20.0.dev20241002+cpu, 0.20.0.dev20241003+cpu, 0.20.0.dev20241004+cpu, 0.20.0.dev20241005+cpu, 0.20.0.dev20241006+cpu, 0.20.0.dev20241007+cpu, 0.20.0.dev20241008+cpu, 0.20.0.dev20241009+cpu, 0.20.0.dev20241010+cpu, 0.20.0.dev20241011+cpu, 0.20.0.dev20241012+cpu, 0.20.0.dev20241013+cpu, 0.20.0.dev20241014+cpu, 0.20.0.dev20241015+cpu, 0.20.0.dev20241016+cpu, 0.20.0.dev20241017+cpu, 0.20.0.dev20241018+cpu, 0.20.0.dev20241019+cpu, 0.20.0.dev20241020+cpu, 0.20.0.dev20241021+cpu, 0.20.0.dev20241022+cpu, 0.20.0.dev20241023+cpu, 0.20.0.dev20241024+cpu, 0.20.0.dev20241025+cpu, 0.20.0.dev20241026+cpu, 0.20.0.dev20241027+cpu, 0.20.0.dev20241028+cpu, 0.20.0.dev20241029+cpu, 0.20.0.dev20241030+cpu, 0.20.0.dev20241031+cpu, 0.20.0.dev20241101+cpu, 0.20.0.dev20241102+cpu, 0.20.0.dev20241103+cpu, 0.20.0.dev20241104+cpu, 0.20.0.dev20241105+cpu, 0.20.0.dev20241106+cpu, 0.20.0.dev20241107+cpu, 0.20.0, 0.20.1)
  • pull / test-cpu-eval-sanity-check-float32 (x86_64, stories15M) (gh)
    ERROR: Could not find a version that satisfies the requirement torchvision==0.20.0.dev20241109 (from versions: 0.12.0, 0.13.0, 0.13.1, 0.14.0, 0.14.1, 0.15.1, 0.15.2, 0.16.0, 0.16.1, 0.16.2, 0.17.0, 0.17.1, 0.17.2, 0.18.0, 0.18.1, 0.19.0, 0.19.1, 0.20.0.dev20240913+cpu, 0.20.0.dev20240914+cpu, 0.20.0.dev20240915+cpu, 0.20.0.dev20240916+cpu, 0.20.0.dev20240917+cpu, 0.20.0.dev20240918+cpu, 0.20.0.dev20240919+cpu, 0.20.0.dev20240920+cpu, 0.20.0.dev20240921+cpu, 0.20.0.dev20240922+cpu, 0.20.0.dev20240923+cpu, 0.20.0.dev20240924+cpu, 0.20.0.dev20240925+cpu, 0.20.0.dev20240926+cpu, 0.20.0.dev20240927+cpu, 0.20.0.dev20240928+cpu, 0.20.0.dev20240929+cpu, 0.20.0.dev20240930+cpu, 0.20.0.dev20241001+cpu, 0.20.0.dev20241002+cpu, 0.20.0.dev20241003+cpu, 0.20.0.dev20241004+cpu, 0.20.0.dev20241005+cpu, 0.20.0.dev20241006+cpu, 0.20.0.dev20241007+cpu, 0.20.0.dev20241008+cpu, 0.20.0.dev20241009+cpu, 0.20.0.dev20241010+cpu, 0.20.0.dev20241011+cpu, 0.20.0.dev20241012+cpu, 0.20.0.dev20241013+cpu, 0.20.0.dev20241014+cpu, 0.20.0.dev20241015+cpu, 0.20.0.dev20241016+cpu, 0.20.0.dev20241017+cpu, 0.20.0.dev20241018+cpu, 0.20.0.dev20241019+cpu, 0.20.0.dev20241020+cpu, 0.20.0.dev20241021+cpu, 0.20.0.dev20241022+cpu, 0.20.0.dev20241023+cpu, 0.20.0.dev20241024+cpu, 0.20.0.dev20241025+cpu, 0.20.0.dev20241026+cpu, 0.20.0.dev20241027+cpu, 0.20.0.dev20241028+cpu, 0.20.0.dev20241029+cpu, 0.20.0.dev20241030+cpu, 0.20.0.dev20241031+cpu, 0.20.0.dev20241101+cpu, 0.20.0.dev20241102+cpu, 0.20.0.dev20241103+cpu, 0.20.0.dev20241104+cpu, 0.20.0.dev20241105+cpu, 0.20.0.dev20241106+cpu, 0.20.0.dev20241107+cpu, 0.20.0, 0.20.1)
  • pull / test-gpu-aoti-bfloat16 (cuda, stories15M) / linux-job (gh)
    RuntimeError: Command docker exec -t 6c6d1117e37f0f55b9d755260fc90a49f2434da3b96f252d2aca35e0ea2fd4ff /exec failed with exit code 1
  • pull / test-gpu-aoti-float16 (cuda, stories15M) / linux-job (gh)
    RuntimeError: Command docker exec -t 5d89e604ecf4cbe46d32e8686347149dfd063e4663ed4f8ee4f97c5639b2318f /exec failed with exit code 1
  • pull / test-gpu-aoti-float32 (cuda, stories15M) / linux-job (gh)
    RuntimeError: Command docker exec -t c7bd9035740e688290037f4e7767ae83e0d076d4d20dd4a52713b14faaafa019 /exec failed with exit code 1
  • pull / test-gpu-compile (cuda, stories15M) / linux-job (gh)
    RuntimeError: Command docker exec -t 2d5ae1bc3747f7e1b4089408fb088eb671c25563fb064f0a47f2bfd555277b67 /exec failed with exit code 1
  • pull / test-gpu-eval-sanity-check (cuda, stories15M) / linux-job (gh)
    RuntimeError: Command docker exec -t d4ca92ea9a13176bba58b44858216d1e2bd17b5fc74cfba34345681dc03c29b6 /exec failed with exit code 1
  • pull / test-tinystories-executorch (16-core-ubuntu) (gh)
    ERROR: No matching distribution found for torchvision==0.20.0.dev20241109
  • Run parallel prefill / test-cuda / linux-job (gh)
    RuntimeError: Command docker exec -t 9018846e6635ce9b355dc87971bbc4d34ff3ab475efc68289ecd96724ed0b57e /exec failed with exit code 1
  • Run the aoti runner with CUDA using stories / test-runner-aot-cuda / linux-job (gh)
    RuntimeError: Command docker exec -t dcb3354d9c44ade1a7852adee1907694698d53adfe1e07fb63a3a4aeffd2e7e7 /exec failed with exit code 1

CANCELLED JOBS - The following jobs were cancelled. Please retry:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Nov 11, 2024
@swolchok
Copy link
Contributor Author

looks like we need to wait until there's a torchvision nightly newer than 1108, and also there's an AOTI segfault

@Jack-Khuu
Copy link
Contributor

This might play a part to the aoti bug: #1356

@swolchok
Copy link
Contributor Author

wait until there's a torchvision nightly newer than 1108

hmm, there are several days of newer nightlies. trying again to see if those errors go away.

@Jack-Khuu
Copy link
Contributor

closing stale in favor of #1367

@Jack-Khuu Jack-Khuu closed this Dec 6, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants