tiktoken library issue

[dhruv20047228]

Bug description

in attached file tiktoken = tiktoken.get_encoding("gpt-2") is written, currently while trying to run that particular cell, error of allowed_special variable not defined is arising, it's working and running properly when get_encoding("cl100k_base") is used instead of above written in picture.

What operating system are you using?

Linux

Where do you run your code?

Google Colab

Environment

[ArkVex]

@dhruv20047228 is the issue open?

[rasbt]

Sorry for the late response, I missed the notification somehow.

I could not reproduce the issue in tiktoken 0.7:

or a more recent tiktoken version:

Could you post the code snippet you were using that caused this issue along with the error message?

[ArkVex]

So what is the status?
Is the issue open to pick?

[rasbt]

@ArkVex Thanks for your interest in this. I am not sure there's an issue at the moment as I couldn't reproduce the problem. Do you encounter a similar problem?