Tools Calling in streamText UseChat error

[myudak]

i literally use the same thing as the docs https://sdk.vercel.ai/examples/next-pages/tools/call-tool
but its just resulting im ai message empty

how do i get the tool response to the ai message

code :

import { ToolInvocation, convertToCoreMessages, streamText } from 'ai';
import { openai } from '@ai-sdk/openai';
import { z } from 'zod';

interface Message {
  role: 'user' | 'assistant';
  content: string;
  toolInvocations?: ToolInvocation[];
}

export async function POST(req: Request) {
  const { messages }: { messages: Message[] } = await req.json();

  const result = await streamText({
    model: openai('gpt-4o'),
    system: 'You are a helpful assistant.',
    messages: convertToCoreMessages(messages),
    tools: {
      getWeather: {
        description: 'Get the weather for a location',
        parameters: z.object({
          city: z.string().describe('The city to get the weather for'),
          unit: z
            .enum(['C', 'F'])
            .describe('The unit to display the temperature in'),
        }),
        execute: async ({ city, unit }) => {
          const weather = {
            value: 24,
            description: 'Sunny',
          };

          return `It is currently 25°${weather.value}°${unit} and ${weather.description} in ${city}!`;
        },
      },
    },
  });

  return result.toAIStreamResponse();
}

[myudak]

why are the docs so weird? Some parts are good, some are just flat out wrong

[myudak]

ok i solved it by add thing code

    {m.toolInvocations?.map((toolInvocation) => {
                const toolCallId = toolInvocation.toolCallId;
                return (
                  <div key={toolCallId}>
                    Tool call {`${toolInvocation.toolName}: `}
                    {toolInvocation.result}
                  </div>
                );
              })}

still though, this is a criticism of some part of the documentation. The docs should be updated, it's frustrating when they give flat-out wrong code.

[myudak]

how to edit the ai response when the ai calling the tools? so it doesnt just empty ai response

[lgrammel]

Which guide are you looking at? What you need should be documented here: https://sdk.vercel.ai/docs/ai-sdk-ui/chatbot-with-tool-calling

If there are specific mistakes/omissions in this guide, please let me know.

[myudak]

yeah i just confused bcs there are so many ways to do the same thing in the documentation

[EstebanDalelR]

It'd be nice to have an example showing the user interacting with the tool, like selecting from a city dropdown.

[rbluethl]

@myudak had the same issue (empty message response). When I log the tool invocation, it is stuck in "state" = "call". How did you manage to get this working?

[rbluethl]

@myudak @lgrammel strangely enough this occurs only when my execute function does an actual API call using await.

✅ This works:

execute: async ({ roomType, occupancy, from, to }) => {
  console.log('EXECUTING FUNCTION', roomType, occupancy, from, to)

  // No async call => return message directly
  return 'There are no rooms available.'
}

❌ This does not (returned message is stuck in state "call", although the function is performed and I can see the logs):

execute: async ({ roomType, occupancy, from, to }) => {
  console.log('EXECUTING FUNCTION', roomType, occupancy, from, to)

  // Async call => stuck in state "call"
  const availableRoomTypes = await availabilitiesApi.getAvailableRoomTypes(
    occupancy,
    new Date(from),
    new Date(to),
    true
  )

  const matchingRoomType = availableRoomTypes.find((art) => art.code === roomType)
  const firstPrice = matchingRoomType?.prices?.[0]
  const available = matchingRoomType?.rooms?.length !== 0

  const message = available
    ? `There are rooms available. The price is ${(firstPrice?.grossAmount ?? 0) / 100}€.`
    : 'There are no rooms available.'

  console.log('MESSAGE', message)
  return message
}

[lgrammel]

In your 2nd example, does it log the final MESSAGE log stmt?

[rbluethl]

In your 2nd example, does it log the final MESSAGE log stmt?

Yup it does! That's why I don't get it.

[rbluethl]

@lgrammel it works now! Updating to "ai": "3.2.43" did the trick. Before was 3.2.38, just so that you know (maybe some bug in that version?). Thanks!