executeCommand() doesn't execute the checkpoint_paste() command

[mitkonikov]

Terminals: GitBash and Conda through Powershell and GitBash
Issue replicated on 2 different PCs both Windows 11 one Enterprise and one Education (Version 23H2)
IPython version: 8.21.0

I've downloaded the repository, npm installed, npm compiled everything and attached the debugger.

Simple Manim Scene:

from manimlib import *

class SubTensors(InteractiveScene):
    def construct(self):
        ## Interactions
        circle = Circle(radius = 2)
        self.play(DrawBorderThenFill(circle))

Detects the preview cell.
Run the command:

manimgl sub_tensor.py SubTensors -se 5

And when I click on the Preview Manim Cell, it clears the console, writes checkpoint_paste() but doesn't run it at all.

With the debugger, I can see that with both the executeCommand and terminal.sendText, the command is not executed.
If then I manually click ENTER in terminal, the command is executed, however it's now too late, the clipboard is already reset to the previous state and throws an error because it tries to run something that is not python code.

Since this happens with different terminals, I believe it's something due to the IPython console. Because if we just click Preview Manim Cell, without running the manimgl command, the command checkpoint_paste() is executed properly (even though, in this case, it's an error, since it's not recognized as a Powershell/Bash/Conda command).

What I have already tried:

• Adding \r\n or \n at the end of the PREVIEW_COMMAND string
• Adding spaces or other chars at the end of the PREVIEW_COMMAND string
• terminal.sendText actually has a second parameter that is used to execute the command, setting that to true
• Executing always sendText regardless if the terminal supports shellIntegration

Nothing worked. Any ideas as to why would this happen? I'm not familiar with the IPython console; it may have some weird interaction behaviour.

[VladimirFokow]

Hello!

@Splines , for info: the relevant code section

The problem is:
checkpoint_paste() is written in the terminal,
but is NOT executed.

@mitkonikov I really don't know the reason... Could you record a video?

Here are just some thoughts:

• I don't think the behavior of the IPython console is special. I mean it works for us..
• Maybe it's the terminal.shellIntegration which is broken... While experimenting - maybe the VSCode extension wasn't reloaded properly after you changed something? (I press F5, change something, then reload window, and test as described here)
• even if always just send_text - it doesn't execute in the IPython shell, but executes in the bash shell? That's weird

[bhoov]

I would also appreciate a video to understand. Right now, I have a suspicion that you are starting the manimgl ... -se ... command from a terminal other than the integrated VSCode terminal. Right now, our extension sends the checkpoint_paste() command only to the integrated, active VSCode terminal (i don't think we have tested multiple terminal windows open in the same vscode instance)

Can you try running the command in the integrated VSCode terminal and see if things work as expected?

This workflow will be much improved once #2 is solved, and @VladimirFokow is very close to getting that essential feature integrated

[mitkonikov]

Answers to the previous questions:

• I'm running the manimgl from the integrated terminal of course
• Even if I restart the extension it doesn't execute it

• even if always just send_text - it doesn't execute in the IPython shell, but executes in the bash shell? That's weird

this is true, it executes it everywhere, except the IPython shell. But notice that the IPython shell could be doing some string trimming or smth else itself. That is why my suspicion is in the IPython shell.

Here's a video I made going through everything, including the preparation, debugger, different terminals. I forgot to show you that it works if we are executing the command on a terminal without running the manimgl command at all. Sorry for the lengthy video, I just wanted to show you everything how it behaves.

https://youtu.be/ahBg4jx75Ds

[mitkonikov]

Here's an image. I wanted to see if it would execute the checkpoint_paste() even inside conda terminal/env, without running manimgl. It executes it immediately.

[mitkonikov]

OMG. I fixed it.. I think..

const PREVIEW_COMMAND = `\x0C checkpoint_paste()\x1b`; // \x0C is Ctrl + L

When VSCode is writing text in the command line, the cursor is not being updated to the end. So, IPython shell thinks that the cursor is in the beginning, thus not executing the command but rather adding a new line. This behaviour is explained in this issue. So, after adding an ESC symbol at the end of the PREVIEW_COMMAND, IPython then sees that \n character should execute the command.

[VladimirFokow]

omg, wow

[VladimirFokow]

for reference, here is the 3b1b's command -
there I didn't know what was the: "\x7F" * col if clear else "", # Bad hack
Maybe for this, maybe not..

[mitkonikov]

According to this, 7F is the Delete character. This could be the same fix. Because the Delete character is a special one, it could just reset the cursor to the end. Let me try it.

However, tell me if this works on your machines too. You can fix it or tell me to make a PR, it's just one line change.

[VladimirFokow]

Yes, I'll test and can push, or you can make a PR if you want to.
I feel your solution is better than with x7F

[mitkonikov]

For me, 7F doesn't work at the beginning or at the end of the PREVIEW_COMMAND.

If I put \x7f at the beginning of the PREVIEW_COMMAND nothing changes (same command, no execution), however at the end, for some reason, it deletes the last character. I suspect that the cursor is not at the end, but one character behind. That could be some VSCode issue, not updating the cursor for the last character properly. I'm not sure though.

This is after executing: \x0C checkpoint_paste()\x7f

[VladimirFokow]

your solution works for me 🚀

[RickLuiken]

Hi, I found this issue as well. I just tried the proposed solution by @mitkonikov. It seems to work most of the time, however when the window get a bit laggier (when you have a few updaters running), it stops working.

As for the \x7f in 3b1b's code, I guess it's there to clear whatever is in the terminal already. You see him getting the amount of chars in the terminal window, and adding \x7f that amount of times to clear the screen

[mitkonikov]

@RickLuiken Can you send some sample code, so I can try?

What do you mean a few updaters? What kind of updaters?

[mitkonikov]

As for the \x7f in 3b1b's code, I guess it's there to clear whatever is in the terminal already. You see him getting the amount of chars in the terminal window, and adding \x7f that amount of times to clear the screen

This is true. Maybe this functionally is going to be needed in this extension as well. If there has been some error, that made it so the IPython shell has stopped executing. The characters will maybe remain in the terminal window? This has to be tested as well.