ConversationId how to use correctly?

[flintlouis]

Hi,
I created a quick application to test ConversationId out with the OpenAIResponseClient. But it seems to only remember my first message. Am I using it wrong?
This is my code

IChatClient chatClient = ChatClientBuilder(new OpenAIResponseClient("gpt-4o", apiKey).AsIChatClient())
		.UseFunctionInvocation()
		.Build();
		
var systemMessage = new ChatMessage(ChatRole.System, "Your role is to be a friendly assistant");
var initialMessage = new ChatMessage(ChatRole.Assistant, "Hi, how can I help you today?");

List<ChatMessage> chatHistory =
[
	systemMessage,
	initialMessage,
];

var options = new ChatOptions();

while (true)
{
	string? prompt = Console.ReadLine();

	if (String.IsNullOrEmpty(prompt))
		break;

	var userChatMessage = new ChatMessage(ChatRole.User, prompt);
	chatHistory.Add(userChatMessage);
		
	List<ChatResponseUpdate> responseUpdates = [];
	
	IAsyncEnumerable<ChatResponseUpdate> responseStream = String.IsNullOrWhiteSpace(options.ConversationId)
		? chatClient.GetStreamingResponseAsync(chatHistory, options)
		: chatClient.GetStreamingResponseAsync(userChatMessage, options);
		
	await foreach (ChatResponseUpdate responseUpdate in responseStream)
	{
		Console.Write(responseUpdate.Text);;
		responseUpdates.Add(responseUpdate);
	}
	
	Console.WriteLine();
	
	ChatResponse response = responseUpdates.ToChatResponse();

	options.ConversationId ??= response.ConversationId;
	chatHistory.AddMessages(response);
}

See this transcript of a conversation I had:

System: Your role is to be a friendly assistant

Assistant: Hi, how can I help you today?

User: I like dinos

Assistant: That's great! Dinosaurs are fascinating creatures. Are you interested in learning more about dinosaurs? If so, let me know how I can assist you!

User: Tell us a joke

Assistant: Why can't you hear a pterodactyl using the bathroom?

Because the "P" is silent! ??

User: Tell me a joke about airplanes

Assistant: Why did the airplane get sent to its room?

Because it had a bad altitude! ????

User: How many jokes have you told me?

Assistant: I haven't told any jokes yet! Would you like to hear one?

User: What do I like?

Assistant: You like dinosaurs! Would you like to know any interesting facts about dinosaurs?

[stephentoub]

The problem is this line:

options.ConversationId ??= response.ConversationId;

That should be more like:

if (response.ConversationId is not null)
{
    options.ConversationId = response.ConversationId;
}

With responses, each response has its own unique ID, and you need to tell subsequent requests which conversation to continue.