-
Notifications
You must be signed in to change notification settings - Fork 1.8k
Closed
Labels
bugSomething isn't workingSomething isn't workingtriagedIssue has been triaged by maintainersIssue has been triaged by maintainers
Description
I want to build a bert model with tensorrt 0.13
python3 /app/src/convert/build.py --model BertForSequenceClassification --model_dir /app/data/model --output_dir /app/data/tllm_checkpoint --dtype float16
response:
[TensorRT-LLM] TensorRT-LLM version: 0.13.0
[10/24/2024-21:38:25] [TRT] [I] [MemUsageChange] Init CUDA: CPU +14, GPU +0, now: CPU 151, GPU 432 (MiB)
[10/24/2024-21:38:27] [TRT] [I] [MemUsageChange] Init builder kernel library: CPU +1995, GPU +366, now: CPU 2302, GPU 798 (MiB)
[10/24/2024-21:38:27] [TRT-LLM] [W] Invalid timing cache, using freshly created one
Traceback (most recent call last):
File "/app/src/convert/tookabert/build.py", line 279, in <module>
if args.model_dir is not None and os.path.exist(
AttributeError: module 'posixpath' has no attribute 'exist'. Did you mean: 'exists'?
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't workingtriagedIssue has been triaged by maintainersIssue has been triaged by maintainers