-
Notifications
You must be signed in to change notification settings - Fork 964
feat(ai): add support for the Live API #9224
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
* Add WebSocket handler for Browser and Node * Add additional environment checks * Clarify usage of `window` * remove util websocket handler * Use platform/ convention * use built-in global ws * revert tsconfig module bump * cleanup * fix stub ws file * parse strings, and create error queue
* Live API v1 * update docs * Docs and naming changes * Skip problematic Google AI tests * Fix mediaChunks errors * Log warnings for 'close' event reasons * Add note about support to getLiveGenerativeModel docs * Review comments * add license header * docs review * remove candidateCount * Live Refactor WebSocket (#9212) * refactor websocket * remove test ws server
* Live API v2 * add audio response modality and fix voiceName * Use `Deffered` for stop promise and resolver * Remove dead comment * Fix response modalities type
🦋 Changeset detectedLatest commit: 5adbd54 The changes in this PR will be included in the next version bump. This PR includes changesets to release 2 packages
Not sure what this means? Click here to learn what changesets are. Click here if you're a maintainer who wants to add another changeset to this PR |
Changeset File Check ✅
|
Size Report 1Affected Products
Test Logs |
/** | ||
* Test configurations used for the Live API integration tests. | ||
*/ | ||
export const liveTestConfigs: readonly TestConfig[] = backends.flatMap( |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
On a second look, this isn't really a constant and should probably go in test-utils but I think it can be dealt with later.
Size Analysis Report 1Affected Products
Test Logs |
Adds support for the Live API:
LiveGenerativeModel
,LiveSession
, and methodsconnect()
,send()
,sendMediaStream()
,sendMediaChunks()
startAudioConversation()
(includes interruption handling)For more details, see: