It looks like this module is very close to working with openai's new realtime API https://platform.openai.com/docs/guides/realtime