Skip to content
This repository was archived by the owner on Jun 3, 2025. It is now read-only.

Conversation

bfineran
Copy link
Contributor

@bfineran bfineran commented Oct 12, 2023

to land with neuralmagic/sparsezoo#373

updates deployment directory downloads to target the compressed directory instead of loose files

simple test:

from deepsparse import Pipeline

pipeline = Pipeline.create(
    "text-generation",
    model_path="zoo:nlg/text_generation/mpt-7b/pytorch/huggingface/mpt_chat/base-none",
    engine_type="onnxruntime"
)

pipeline("test", generation_config=dict(max_new_tokens=10))

@bfineran bfineran merged commit 697752f into main Oct 17, 2023
@bfineran bfineran deleted the deployment-tar branch October 17, 2023 18:29
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants