Streaming
Streaming is an important UX consideration for LLM apps, and agents are no exception. Streaming with agents is made more complicated by the fact that it’s not just tokens that you will want to stream, but you may also want to stream back the intermediate steps an agent takes.
Let’s take a look at how to do this.
Set up the agent
Let’s set up a simple agent for demonstration purposes. For our tool, we will use Tavily. Make sure that you’ve exported an API key with
export TAVILY_API_KEY="..."
from langchain_community.tools.tavily_search import TavilySearchResults
search = TavilySearchResults()
tools = [search]
We will use a prompt from the hub - you can inspect the prompt more at https://smith.langchain.com/hub/hwchase17/openai-functions-agent
from langchain import hub
from langchain.agents import AgentExecutor, create_openai_functions_agent
from langchain_openai import ChatOpenAI
# Get the prompt to use - you can modify this!
# If you want to see the prompt in full, you can at: https://smith.langchain.com/hub/hwchase17/openai-functions-agent
prompt = hub.pull("hwchase17/openai-functions-agent")
llm = ChatOpenAI(model="gpt-3.5-turbo", temperature=0)
agent = create_openai_functions_agent(llm, tools, prompt)
agent_executor = AgentExecutor(agent=agent, tools=tools)
Stream intermediate steps
Let’s look at how to stream intermediate steps. We can do this easily by
just using the .stream method on the AgentExecutor
for chunk in agent_executor.stream({"input": "what is the weather in SF and then LA"}):
print(chunk)
print("------")
{'actions': [AgentActionMessageLog(tool='tavily_search_results_json', tool_input={'query': 'weather in San Francisco'}, log="\nInvoking: `tavily_search_results_json` with `{'query': 'weather in San Francisco'}`\n\n\n", message_log=[AIMessage(content='', additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in San Francisco"\n}', 'name': 'tavily_search_results_json'}})])], 'messages': [AIMessage(content='', additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in San Francisco"\n}', 'name': 'tavily_search_results_json'}})]}
------
{'steps': [AgentStep(action=AgentActionMessageLog(tool='tavily_search_results_json', tool_input={'query': 'weather in San Francisco'}, log="\nInvoking: `tavily_search_results_json` with `{'query': 'weather in San Francisco'}`\n\n\n", message_log=[AIMessage(content='', additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in San Francisco"\n}', 'name': 'tavily_search_results_json'}})]), observation=[{'url': 'https://weather.com/weather/tenday/l/San Francisco CA USCA0987:1:US', 'content': 'recents Specialty Forecasts 10 Day Weather-San Francisco, CA Today Mon 18 | Day Fri 22 Fri 22 | Day Foggy early, then partly cloudy later in the day. High around 60F. Winds W at 10 to 15 mph. Considerable cloudiness with occasional rain showers. High 59F. Winds SSE at 5 to 10 mph. Chance of rain 50%. Thu 28 | Night Cloudy with showers. Low 46F. Winds S at 5 to 10 mph. Chance of rain 40%. Fri 29 Fri 29 | Day10 Day Weather-San Francisco, CA As of 5:52 pm PST alertLevel3 Coastal Flood Advisory+1 More Tonight Mostly Cloudy Night --/44° Rain 7% Arrow Up Sun 24| Night 44° Mostly Cloudy Night Rain 7%...'}])], 'messages': [FunctionMessage(content='[{"url": "https://weather.com/weather/tenday/l/San Francisco CA USCA0987:1:US", "content": "recents Specialty Forecasts 10 Day Weather-San Francisco, CA Today Mon 18 | Day Fri 22 Fri 22 | Day Foggy early, then partly cloudy later in the day. High around 60F. Winds W at 10 to 15 mph. Considerable cloudiness with occasional rain showers. High 59F. Winds SSE at 5 to 10 mph. Chance of rain 50%. Thu 28 | Night Cloudy with showers. Low 46F. Winds S at 5 to 10 mph. Chance of rain 40%. Fri 29 Fri 29 | Day10 Day Weather-San Francisco, CA As of 5:52 pm PST alertLevel3 Coastal Flood Advisory+1 More Tonight Mostly Cloudy Night --/44° Rain 7% Arrow Up Sun 24| Night 44° Mostly Cloudy Night Rain 7%..."}]', name='tavily_search_results_json')]}
------
{'actions': [AgentActionMessageLog(tool='tavily_search_results_json', tool_input={'query': 'weather in Los Angeles'}, log="\nInvoking: `tavily_search_results_json` with `{'query': 'weather in Los Angeles'}`\n\n\n", message_log=[AIMessage(content='', additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in Los Angeles"\n}', 'name': 'tavily_search_results_json'}})])], 'messages': [AIMessage(content='', additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in Los Angeles"\n}', 'name': 'tavily_search_results_json'}})]}
------
{'steps': [AgentStep(action=AgentActionMessageLog(tool='tavily_search_results_json', tool_input={'query': 'weather in Los Angeles'}, log="\nInvoking: `tavily_search_results_json` with `{'query': 'weather in Los Angeles'}`\n\n\n", message_log=[AIMessage(content='', additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in Los Angeles"\n}', 'name': 'tavily_search_results_json'}})]), observation=[{'url': 'https://weather.com/weather/tenday/l/Los+Angeles+CA?canonicalCityId=84c64154109916077c8d3c2352410aaae5f6eeff682000e3a7470e38976128c2', 'content': 'recents Specialty Forecasts 10 Day Weather-Los Angeles, CA Air Quality Alert Today Tue 26 | Day Considerable cloudiness with occasional rain showers. High 64F. Winds light and variable. Chance of rain 50%. Considerable cloudiness with occasional rain showers. High 62F. Winds light and variable. Chance of rain 60%. Wed 03 Wed 03 | Day Overcast with showers at times. High 66F. Winds light and variable. Chance of rain 40%.Today 66°/ 50° 6% Sun 24 | Day 66° 6% WSW 4 mph Partly cloudy skies. High 66F. Winds light and variable. Humidity 65% UV Index 3 of 11 Sunrise 6:56 am Sunset 4:49 pm Sun 24 | Night 50° 10% N 1 mph...'}, {'url': 'https://weather.com/weather/tenday/l/Los+Angeles+CA?canonicalCityId=d4a04df2f5cd7d6ef329c49238253e994619763fd5f77a424ca3f1af9957e717', 'content': 'recents Specialty Forecasts 10 Day Weather-Los Angeles, CA Air Quality Alert Today Tue 26 | Day Rain showers early with some sunshine later in the day. High 61F. Winds SSE at 5 to 10 mph. Chance of rain 60%. Thu 04 Thu 04 | Day Overcast with rain showers at times. High 63F. Winds S at 5 to 10 mph. Chance of rain 50%. Wed 03 Wed 03 | Day Cloudy with occasional showers. High 63F. Winds SE at 5 to 10 mph. Chance of rain 50%.10 Day Weather - Los Angeles, CA As of 12:06 am PST Tonight --/ 49° 5% Sat 23 | Night 49° 5% NNW 2 mph Partly cloudy this evening, then becoming foggy and damp after midnight. Low 49F. Winds...'}, {'url': 'https://weather.com/weather/hourbyhour/l/Los+Angeles+CA?canonicalCityId=84c64154109916077c8d3c2352410aaae5f6eeff682000e3a7470e38976128c2', 'content': 'recents Specialty Forecasts Hourly Weather-Los Angeles, CA Air Quality Alert Tuesday, December 26 10 am Partly Cloudy Cold & Flu Forecast Flu risk is low in your area 3 pm Partly Cloudy 4 pm Mostly Cloudy 5 pm Mostly Cloudy 6 pm Mostly Cloudy 7 pm Cloudy 8 pm Cloudy 9 pm Mostly Cloudy 10 am Cloudy 11 am Mostly Cloudy 12 pm Cloudy 1 pm Mostly Cloudy 2 pm Cloudy 3 pm Cloudy 4 pm Cloudy 5 pm Cloudy 6 pmHourly Weather Forecast for Los Angeles, CA - The Weather Channel | Weather.com - Los Angeles, CA As of 11:12 am PST Saturday, December 23 12 pm 64° 4% Mostly Cloudy Feels Like 64°...'}])], 'messages': [FunctionMessage(content='[{"url": "https://weather.com/weather/tenday/l/Los+Angeles+CA?canonicalCityId=84c64154109916077c8d3c2352410aaae5f6eeff682000e3a7470e38976128c2", "content": "recents Specialty Forecasts 10 Day Weather-Los Angeles, CA Air Quality Alert Today Tue 26 | Day Considerable cloudiness with occasional rain showers. High 64F. Winds light and variable. Chance of rain 50%. Considerable cloudiness with occasional rain showers. High 62F. Winds light and variable. Chance of rain 60%. Wed 03 Wed 03 | Day Overcast with showers at times. High 66F. Winds light and variable. Chance of rain 40%.Today 66°/ 50° 6% Sun 24 | Day 66° 6% WSW 4 mph Partly cloudy skies. High 66F. Winds light and variable. Humidity 65% UV Index 3 of 11 Sunrise 6:56 am Sunset 4:49 pm Sun 24 | Night 50° 10% N 1 mph..."}, {"url": "https://weather.com/weather/tenday/l/Los+Angeles+CA?canonicalCityId=d4a04df2f5cd7d6ef329c49238253e994619763fd5f77a424ca3f1af9957e717", "content": "recents Specialty Forecasts 10 Day Weather-Los Angeles, CA Air Quality Alert Today Tue 26 | Day Rain showers early with some sunshine later in the day. High 61F. Winds SSE at 5 to 10 mph. Chance of rain 60%. Thu 04 Thu 04 | Day Overcast with rain showers at times. High 63F. Winds S at 5 to 10 mph. Chance of rain 50%. Wed 03 Wed 03 | Day Cloudy with occasional showers. High 63F. Winds SE at 5 to 10 mph. Chance of rain 50%.10 Day Weather - Los Angeles, CA As of 12:06 am PST Tonight --/ 49° 5% Sat 23 | Night 49° 5% NNW 2 mph Partly cloudy this evening, then becoming foggy and damp after midnight. Low 49F. Winds..."}, {"url": "https://weather.com/weather/hourbyhour/l/Los+Angeles+CA?canonicalCityId=84c64154109916077c8d3c2352410aaae5f6eeff682000e3a7470e38976128c2", "content": "recents Specialty Forecasts Hourly Weather-Los Angeles, CA Air Quality Alert Tuesday, December 26 10 am Partly Cloudy Cold & Flu Forecast Flu risk is low in your area 3 pm Partly Cloudy 4 pm Mostly Cloudy 5 pm Mostly Cloudy 6 pm Mostly Cloudy 7 pm Cloudy 8 pm Cloudy 9 pm Mostly Cloudy 10 am Cloudy 11 am Mostly Cloudy 12 pm Cloudy 1 pm Mostly Cloudy 2 pm Cloudy 3 pm Cloudy 4 pm Cloudy 5 pm Cloudy 6 pmHourly Weather Forecast for Los Angeles, CA - The Weather Channel | Weather.com - Los Angeles, CA As of 11:12 am PST Saturday, December 23 12 pm 64° 4% Mostly Cloudy Feels Like 64°..."}]', name='tavily_search_results_json')]}
------
{'output': "The weather in San Francisco is currently foggy early, then partly cloudy later in the day with a high around 60°F. There is a chance of rain showers with a high of 59°F tomorrow. The temperature will drop to a low of 46°F on Thursday night with cloudy conditions and showers.\n\nIn Los Angeles, there is considerable cloudiness with occasional rain showers today. The high temperature is expected to be 64°F with light and variable winds. Tomorrow, there will be considerable cloudiness with occasional rain showers and a high of 62°F. The weather will be overcast with showers at times on Wednesday with a high of 66°F.\n\nPlease note that weather conditions can change rapidly, so it's always a good idea to check a reliable weather source for the most up-to-date information.", 'messages': [AIMessage(content="The weather in San Francisco is currently foggy early, then partly cloudy later in the day with a high around 60°F. There is a chance of rain showers with a high of 59°F tomorrow. The temperature will drop to a low of 46°F on Thursday night with cloudy conditions and showers.\n\nIn Los Angeles, there is considerable cloudiness with occasional rain showers today. The high temperature is expected to be 64°F with light and variable winds. Tomorrow, there will be considerable cloudiness with occasional rain showers and a high of 62°F. The weather will be overcast with showers at times on Wednesday with a high of 66°F.\n\nPlease note that weather conditions can change rapidly, so it's always a good idea to check a reliable weather source for the most up-to-date information.")]}
------
You can see that we get back a bunch of different information. There are two ways to work with this information:
- By using the AgentAction/observation/AgentFinish object
- By using the
messagesobject
You may prefer to use the messages object if you are working with a
chatbot - because these are chat messages and can be rendered directly.
If you don’t care about that, the AgentAction/observation/AgentFinish is
probably the easier one to inspect.
Using AgentAction/observation/AgentFinish
You can access these raw objects as part of the streamed payload. This gives you more low level information, but can be harder to parse.
for chunk in agent_executor.stream({"input": "what is the weather in SF and then LA"}):
# Agent Action
if "actions" in chunk:
for action in chunk["actions"]:
print(
f"Calling Tool ```{action.tool}``` with input ```{action.tool_input}```"
)
# Observation
elif "steps" in chunk:
for step in chunk["steps"]:
print(f"Got result: ```{step.observation}```")
# Final result
elif "output" in chunk:
print(chunk["output"])
else:
raise ValueError
print("------")
Calling Tool ```tavily_search_results_json``` with input ```{'query': 'weather in San Francisco'}```
------
Got result: ```[{'url': 'https://weather.com/weather/tenday/l/San Francisco CA USCA0987:1:US', 'content': 'recents Specialty Forecasts 10 Day Weather-San Francisco, CA Today Mon 18 | Day Fri 22 Fri 22 | Day Foggy early, then partly cloudy later in the day. High around 60F. Winds W at 10 to 15 mph. Considerable cloudiness with occasional rain showers. High 59F. Winds SSE at 5 to 10 mph. Chance of rain 50%. Thu 28 | Night Cloudy with showers. Low 46F. Winds S at 5 to 10 mph. Chance of rain 40%. Fri 29 Fri 29 | Day10 Day Weather-San Francisco, CA As of 5:52 pm PST alertLevel3 Coastal Flood Advisory+1 More Tonight Mostly Cloudy Night --/44° Rain 7% Arrow Up Sun 24| Night 44° Mostly Cloudy Night Rain 7%...'}]```
------
Calling Tool ```tavily_search_results_json``` with input ```{'query': 'weather in Los Angeles'}```
------
Got result: ```[{'url': 'https://hoodline.com/2023/12/los-angeles-hit-with-no-burn-order-during-cloudy-holiday-forecast-aqmd-urges-compliance-for-public-health/', 'content': 'skies and a chance of rain. According to the National Weather Service, today’s weather in Los Angeles is mostly sunny visiting the AQMD site or using its mobile app. While Los Angeles navigates through a cloudy and cooler weather Weather & Environment in ... Los Angeles Hit with No-Burn Order During Cloudy Holiday Forecast and cooler weather pattern, with temperatures fluctuating around the high 60 degrees and chances of rain by FridayPublished on December 26, 2023. Los Angeles residents face a restricted holiday season as the South Coast Air Quality Management District (AQMD) extends a mandatory no-burn order amid multiple ...'}, {'url': 'https://weather.com/weather/tenday/l/Los+Angeles+CA?canonicalCityId=84c64154109916077c8d3c2352410aaae5f6eeff682000e3a7470e38976128c2', 'content': 'recents Specialty Forecasts 10 Day Weather-Los Angeles, CA Tonight Sat 23 | Night Considerable cloudiness with occasional rain showers. Low 48F. Winds light and variable. Chance of rain 60%. Thu 04 Mon 01 | Day Considerable clouds early. Some decrease in clouds later in the day. High 66F. Winds light and variable. Thu 04 | Night Showers early becoming less numerous late. Low 48F. Winds light and variable. Chance of rain 40%. Fri 05Today 66°/ 50° 6% Sun 24 | Day 66° 6% WSW 4 mph Partly cloudy skies. High 66F. Winds light and variable. Humidity 65% UV Index 3 of 11 Sunrise 6:56 am Sunset 4:49 pm Sun 24 | Night 50° 10% N 1 mph...'}, {'url': 'https://weather.com/weather/tenday/l/Los+Angeles+CA?canonicalCityId=d4a04df2f5cd7d6ef329c49238253e994619763fd5f77a424ca3f1af9957e717', 'content': 'recents Specialty Forecasts 10 Day Weather-Los Angeles, CA Tonight Sat 23 | Night Considerable cloudiness with occasional rain showers. Low 48F. Winds light and variable. Chance of rain 60%. Thu 04 Mon 01 | Day Considerable clouds early. Some decrease in clouds later in the day. High 66F. Winds light and variable. Thu 04 | Night Showers early becoming less numerous late. Low 48F. Winds light and variable. Chance of rain 40%. Fri 0510 Day Weather - Los Angeles, CA As of 12:06 am PST Tonight --/ 49° 5% Sat 23 | Night 49° 5% NNW 2 mph Partly cloudy this evening, then becoming foggy and damp after midnight. Low 49F. Winds...'}]```
------
The weather in San Francisco is currently foggy early, then partly cloudy later in the day with a high around 60°F. There is a chance of rain showers with a high of 59°F tomorrow. The temperature will drop to a low of 46°F on Thursday night with cloudy skies and showers.
In Los Angeles, there is considerable cloudiness with occasional rain showers. The temperature will drop to a low of 48°F tonight with light and variable winds. Tomorrow, there will be considerable clouds early with some decrease in clouds later in the day and a high of 66°F. Showers are expected in the evening with a low of 48°F.
------
Using messages
Using messages can be nice when working with chat applications - because everything is a message!
for chunk in agent_executor.stream({"input": "what is the weather in SF and then LA"}):
print(chunk["messages"])
print("------")
[AIMessage(content='', additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in San Francisco"\n}', 'name': 'tavily_search_results_json'}})]
------
[FunctionMessage(content='[{"url": "https://www.cbsnews.com/sanfrancisco/news/next-round-of-rain-set-to-arrive-in-bay-area-wednesday-morning/", "content": "weather persists through Thursday morning. The second system is projected to get to the Bay Area early Friday, Watch CBS News Next round of rain set to arrive in Bay Area Wednesday morning December 26, 2023 / 8:17 AM PST to the Bay Area on Wednesday with the arrival of the first of two storm systems. Overnight lows should be mostly in the 40s in the region, with some areas around the bay dropping into the 50s.Watch CBS News Weather Next round of rain set to arrive in Bay Area Wednesday morning December 26, 2023 / 8:17 AM PST / CBS/Bay City News Service While the outlook on Tuesday is cloudy and..."}, {"url": "https://weather.com/weather/tenday/l/San Francisco CA USCA0987:1:US", "content": "recents Specialty Forecasts 10 Day Weather-San Francisco, CA Today Mon 18 | Day Fri 22 Fri 22 | Day Foggy early, then partly cloudy later in the day. High around 60F. Winds W at 10 to 15 mph. Considerable cloudiness with occasional rain showers. High 59F. Winds SSE at 5 to 10 mph. Chance of rain 50%. Thu 28 | Night Cloudy with showers. Low 46F. Winds S at 5 to 10 mph. Chance of rain 40%. Fri 29 Fri 29 | Day10 Day Weather-San Francisco, CA As of 5:52 pm PST alertLevel3 Coastal Flood Advisory+1 More Tonight Mostly Cloudy Night --/44° Rain 7% Arrow Up Sun 24| Night 44° Mostly Cloudy Night Rain 7%..."}]', name='tavily_search_results_json')]
------
[AIMessage(content='', additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in Los Angeles"\n}', 'name': 'tavily_search_results_json'}})]
------
[FunctionMessage(content='[{"url": "https://weather.com/weather/tenday/l/Los+Angeles+CA?canonicalCityId=d4a04df2f5cd7d6ef329c49238253e994619763fd5f77a424ca3f1af9957e717", "content": "recents Specialty Forecasts 10 Day Weather-Los Angeles, CA Tonight Sat 23 | Night Considerable cloudiness with occasional rain showers. Low 48F. Winds light and variable. Chance of rain 60%. Thu 04 Mon 01 | Day Considerable clouds early. Some decrease in clouds later in the day. High 66F. Winds light and variable. Thu 04 | Night Showers early becoming less numerous late. Low 48F. Winds light and variable. Chance of rain 40%. Fri 0510 Day Weather - Los Angeles, CA As of 12:06 am PST Tonight --/ 49° 5% Sat 23 | Night 49° 5% NNW 2 mph Partly cloudy this evening, then becoming foggy and damp after midnight. Low 49F. Winds..."}, {"url": "https://weather.com/weather/tenday/l/Los+Angeles+CA?canonicalCityId=84c64154109916077c8d3c2352410aaae5f6eeff682000e3a7470e38976128c2", "content": "recents Specialty Forecasts 10 Day Weather-Los Angeles, CA Tonight Sat 23 | Night Considerable cloudiness with occasional rain showers. Low 48F. Winds light and variable. Chance of rain 60%. Thu 04 Mon 01 | Day Considerable clouds early. Some decrease in clouds later in the day. High 66F. Winds light and variable. Thu 04 | Night Showers early becoming less numerous late. Low 48F. Winds light and variable. Chance of rain 40%. Fri 05Today 66°/ 50° 6% Sun 24 | Day 66° 6% WSW 4 mph Partly cloudy skies. High 66F. Winds light and variable. Humidity 65% UV Index 3 of 11 Sunrise 6:56 am Sunset 4:49 pm Sun 24 | Night 50° 10% N 1 mph..."}, {"url": "https://abc7.com/weather/", "content": "WATCH LIVE AccuWeather in the region are forecast to be high.More in the region are forecast to be high.More NOW IN EFFECT FROM 4 AM THURSDAY TO 10 PM PST SATURDAY...MoreToday\'s Weather Los Angeles, CA Current Today Tonight MOSTLY CLOUDY 65 ° Feels Like 65° Sunrise 6:55 AM Humidity 65% Sunset 4:48 PM Windspeed ESE 3 mph Moonrise 2:08 PM Pressure 30.0 in..."}]', name='tavily_search_results_json')]
------
[AIMessage(content='The weather in San Francisco is expected to have rain on Wednesday and Thursday. The temperature will range from the 40s to the 50s. You can find more information [here](https://www.cbsnews.com/sanfrancisco/news/next-round-of-rain-set-to-arrive-in-bay-area-wednesday-morning/) and [here](https://weather.com/weather/tenday/l/San Francisco CA USCA0987:1:US).\n\nThe weather in Los Angeles is expected to have occasional rain showers with temperatures ranging from the 40s to the 60s. You can find more information [here](https://weather.com/weather/tenday/l/Los+Angeles+CA?canonicalCityId=d4a04df2f5cd7d6ef329c49238253e994619763fd5f77a424ca3f1af9957e717) and [here](https://weather.com/weather/tenday/l/Los+Angeles+CA?canonicalCityId=84c64154109916077c8d3c2352410aaae5f6eeff682000e3a7470e38976128c2).')]
------
Stream tokens
In addition to streaming the final result, you can also stream tokens. This will require slightly more complicated parsing of the logs
You will also need to make sure you set the LLM to be streaming
llm = ChatOpenAI(model="gpt-3.5-turbo", temperature=0, streaming=True)
agent = create_openai_functions_agent(llm, tools, prompt)
agent_executor = AgentExecutor(agent=agent, tools=tools)
async for chunk in agent_executor.astream_log(
{"input": "what is the weather in sf", "chat_history": []},
include_names=["ChatOpenAI"],
):
print(chunk)
RunLogPatch({'op': 'replace',
'path': '',
'value': {'final_output': None,
'id': '32650ba8-8a53-4b76-8846-dbb6c3a65727',
'logs': {},
'streamed_output': []}})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI',
'value': {'end_time': None,
'final_output': None,
'id': 'ce3a507d-210d-40aa-8576-dd0aa97e6498',
'metadata': {},
'name': 'ChatOpenAI',
'start_time': '2023-12-26T17:55:56.653',
'streamed_output': [],
'streamed_output_str': [],
'tags': ['seq:step:3'],
'type': 'llm'}})
RunLogPatch({'op': 'add', 'path': '/logs/ChatOpenAI/streamed_output_str/-', 'value': ''},
{'op': 'add',
'path': '/logs/ChatOpenAI/streamed_output/-',
'value': AIMessageChunk(content='', additional_kwargs={'function_call': {'arguments': '', 'name': 'tavily_search_results_json'}})})
RunLogPatch({'op': 'add', 'path': '/logs/ChatOpenAI/streamed_output_str/-', 'value': ''},
{'op': 'add',
'path': '/logs/ChatOpenAI/streamed_output/-',
'value': AIMessageChunk(content='', additional_kwargs={'function_call': {'arguments': '{\n', 'name': ''}})})
RunLogPatch({'op': 'add', 'path': '/logs/ChatOpenAI/streamed_output_str/-', 'value': ''},
{'op': 'add',
'path': '/logs/ChatOpenAI/streamed_output/-',
'value': AIMessageChunk(content='', additional_kwargs={'function_call': {'arguments': ' ', 'name': ''}})})
RunLogPatch({'op': 'add', 'path': '/logs/ChatOpenAI/streamed_output_str/-', 'value': ''},
{'op': 'add',
'path': '/logs/ChatOpenAI/streamed_output/-',
'value': AIMessageChunk(content='', additional_kwargs={'function_call': {'arguments': ' "', 'name': ''}})})
RunLogPatch({'op': 'add', 'path': '/logs/ChatOpenAI/streamed_output_str/-', 'value': ''},
{'op': 'add',
'path': '/logs/ChatOpenAI/streamed_output/-',
'value': AIMessageChunk(content='', additional_kwargs={'function_call': {'arguments': 'query', 'name': ''}})})
RunLogPatch({'op': 'add', 'path': '/logs/ChatOpenAI/streamed_output_str/-', 'value': ''},
{'op': 'add',
'path': '/logs/ChatOpenAI/streamed_output/-',
'value': AIMessageChunk(content='', additional_kwargs={'function_call': {'arguments': '":', 'name': ''}})})
RunLogPatch({'op': 'add', 'path': '/logs/ChatOpenAI/streamed_output_str/-', 'value': ''},
{'op': 'add',
'path': '/logs/ChatOpenAI/streamed_output/-',
'value': AIMessageChunk(content='', additional_kwargs={'function_call': {'arguments': ' "', 'name': ''}})})
RunLogPatch({'op': 'add', 'path': '/logs/ChatOpenAI/streamed_output_str/-', 'value': ''},
{'op': 'add',
'path': '/logs/ChatOpenAI/streamed_output/-',
'value': AIMessageChunk(content='', additional_kwargs={'function_call': {'arguments': 'weather', 'name': ''}})})
RunLogPatch({'op': 'add', 'path': '/logs/ChatOpenAI/streamed_output_str/-', 'value': ''},
{'op': 'add',
'path': '/logs/ChatOpenAI/streamed_output/-',
'value': AIMessageChunk(content='', additional_kwargs={'function_call': {'arguments': ' in', 'name': ''}})})
RunLogPatch({'op': 'add', 'path': '/logs/ChatOpenAI/streamed_output_str/-', 'value': ''},
{'op': 'add',
'path': '/logs/ChatOpenAI/streamed_output/-',
'value': AIMessageChunk(content='', additional_kwargs={'function_call': {'arguments': ' San', 'name': ''}})})
RunLogPatch({'op': 'add', 'path': '/logs/ChatOpenAI/streamed_output_str/-', 'value': ''},
{'op': 'add',
'path': '/logs/ChatOpenAI/streamed_output/-',
'value': AIMessageChunk(content='', additional_kwargs={'function_call': {'arguments': ' Francisco', 'name': ''}})})
RunLogPatch({'op': 'add', 'path': '/logs/ChatOpenAI/streamed_output_str/-', 'value': ''},
{'op': 'add',
'path': '/logs/ChatOpenAI/streamed_output/-',
'value': AIMessageChunk(content='', additional_kwargs={'function_call': {'arguments': '"\n', 'name': ''}})})
RunLogPatch({'op': 'add', 'path': '/logs/ChatOpenAI/streamed_output_str/-', 'value': ''},
{'op': 'add',
'path': '/logs/ChatOpenAI/streamed_output/-',
'value': AIMessageChunk(content='', additional_kwargs={'function_call': {'arguments': '}', 'name': ''}})})
RunLogPatch({'op': 'add', 'path': '/logs/ChatOpenAI/streamed_output_str/-', 'value': ''},
{'op': 'add',
'path': '/logs/ChatOpenAI/streamed_output/-',
'value': AIMessageChunk(content='')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI/final_output',
'value': {'generations': [[{'generation_info': {'finish_reason': 'function_call'},
'message': AIMessage(content='', additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in San Francisco"\n}', 'name': 'tavily_search_results_json'}}),
'text': '',
'type': 'ChatGeneration'}]],
'llm_output': None,
'run': None}},
{'op': 'add',
'path': '/logs/ChatOpenAI/end_time',
'value': '2023-12-26T17:55:57.337'})
RunLogPatch({'op': 'add',
'path': '/streamed_output/-',
'value': {'actions': [AgentActionMessageLog(tool='tavily_search_results_json', tool_input={'query': 'weather in San Francisco'}, log="\nInvoking: `tavily_search_results_json` with `{'query': 'weather in San Francisco'}`\n\n\n", message_log=[AIMessage(content='', additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in San Francisco"\n}', 'name': 'tavily_search_results_json'}})])],
'messages': [AIMessage(content='', additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in San Francisco"\n}', 'name': 'tavily_search_results_json'}})]}},
{'op': 'replace',
'path': '/final_output',
'value': {'actions': [AgentActionMessageLog(tool='tavily_search_results_json', tool_input={'query': 'weather in San Francisco'}, log="\nInvoking: `tavily_search_results_json` with `{'query': 'weather in San Francisco'}`\n\n\n", message_log=[AIMessage(content='', additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in San Francisco"\n}', 'name': 'tavily_search_results_json'}})])],
'messages': [AIMessage(content='', additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in San Francisco"\n}', 'name': 'tavily_search_results_json'}})]}})
RunLogPatch({'op': 'add',
'path': '/streamed_output/-',
'value': {'messages': [FunctionMessage(content='[{"url": "https://www.cbsnews.com/sanfrancisco/news/next-round-of-rain-set-to-arrive-in-bay-area-wednesday-morning/", "content": "weather persists through Thursday morning. The second system is projected to get to the Bay Area early Friday, Watch CBS News Next round of rain set to arrive in Bay Area Wednesday morning December 26, 2023 / 8:17 AM PST to the Bay Area on Wednesday with the arrival of the first of two storm systems. Overnight lows should be mostly in the 40s in the region, with some areas around the bay dropping into the 50s.Watch CBS News Weather Next round of rain set to arrive in Bay Area Wednesday morning December 26, 2023 / 8:17 AM PST / CBS/Bay City News Service While the outlook on Tuesday is cloudy and..."}, {"url": "https://weather.com/weather/tenday/l/San Francisco CA USCA0987:1:US", "content": "recents Specialty Forecasts 10 Day Weather-San Francisco, CA Today Mon 18 | Day Fri 22 Fri 22 | Day Foggy early, then partly cloudy later in the day. High around 60F. Winds W at 10 to 15 mph. Considerable cloudiness with occasional rain showers. High 59F. Winds SSE at 5 to 10 mph. Chance of rain 50%. Thu 28 | Night Cloudy with showers. Low 46F. Winds S at 5 to 10 mph. Chance of rain 40%. Fri 29 Fri 29 | Day10 Day Weather-San Francisco, CA As of 5:52 pm PST alertLevel3 Coastal Flood Advisory+1 More Tonight Mostly Cloudy Night --/44° Rain 7% Arrow Up Sun 24| Night 44° Mostly Cloudy Night Rain 7%..."}]', name='tavily_search_results_json')],
'steps': [AgentStep(action=AgentActionMessageLog(tool='tavily_search_results_json', tool_input={'query': 'weather in San Francisco'}, log="\nInvoking: `tavily_search_results_json` with `{'query': 'weather in San Francisco'}`\n\n\n", message_log=[AIMessage(content='', additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in San Francisco"\n}', 'name': 'tavily_search_results_json'}})]), observation=[{'url': 'https://www.cbsnews.com/sanfrancisco/news/next-round-of-rain-set-to-arrive-in-bay-area-wednesday-morning/', 'content': 'weather persists through Thursday morning. The second system is projected to get to the Bay Area early Friday, Watch CBS News Next round of rain set to arrive in Bay Area Wednesday morning December 26, 2023 / 8:17 AM PST to the Bay Area on Wednesday with the arrival of the first of two storm systems. Overnight lows should be mostly in the 40s in the region, with some areas around the bay dropping into the 50s.Watch CBS News Weather Next round of rain set to arrive in Bay Area Wednesday morning December 26, 2023 / 8:17 AM PST / CBS/Bay City News Service While the outlook on Tuesday is cloudy and...'}, {'url': 'https://weather.com/weather/tenday/l/San Francisco CA USCA0987:1:US', 'content': 'recents Specialty Forecasts 10 Day Weather-San Francisco, CA Today Mon 18 | Day Fri 22 Fri 22 | Day Foggy early, then partly cloudy later in the day. High around 60F. Winds W at 10 to 15 mph. Considerable cloudiness with occasional rain showers. High 59F. Winds SSE at 5 to 10 mph. Chance of rain 50%. Thu 28 | Night Cloudy with showers. Low 46F. Winds S at 5 to 10 mph. Chance of rain 40%. Fri 29 Fri 29 | Day10 Day Weather-San Francisco, CA As of 5:52 pm PST alertLevel3 Coastal Flood Advisory+1 More Tonight Mostly Cloudy Night --/44° Rain 7% Arrow Up Sun 24| Night 44° Mostly Cloudy Night Rain 7%...'}])]}},
{'op': 'add',
'path': '/final_output/steps',
'value': [AgentStep(action=AgentActionMessageLog(tool='tavily_search_results_json', tool_input={'query': 'weather in San Francisco'}, log="\nInvoking: `tavily_search_results_json` with `{'query': 'weather in San Francisco'}`\n\n\n", message_log=[AIMessage(content='', additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in San Francisco"\n}', 'name': 'tavily_search_results_json'}})]), observation=[{'url': 'https://www.cbsnews.com/sanfrancisco/news/next-round-of-rain-set-to-arrive-in-bay-area-wednesday-morning/', 'content': 'weather persists through Thursday morning. The second system is projected to get to the Bay Area early Friday, Watch CBS News Next round of rain set to arrive in Bay Area Wednesday morning December 26, 2023 / 8:17 AM PST to the Bay Area on Wednesday with the arrival of the first of two storm systems. Overnight lows should be mostly in the 40s in the region, with some areas around the bay dropping into the 50s.Watch CBS News Weather Next round of rain set to arrive in Bay Area Wednesday morning December 26, 2023 / 8:17 AM PST / CBS/Bay City News Service While the outlook on Tuesday is cloudy and...'}, {'url': 'https://weather.com/weather/tenday/l/San Francisco CA USCA0987:1:US', 'content': 'recents Specialty Forecasts 10 Day Weather-San Francisco, CA Today Mon 18 | Day Fri 22 Fri 22 | Day Foggy early, then partly cloudy later in the day. High around 60F. Winds W at 10 to 15 mph. Considerable cloudiness with occasional rain showers. High 59F. Winds SSE at 5 to 10 mph. Chance of rain 50%. Thu 28 | Night Cloudy with showers. Low 46F. Winds S at 5 to 10 mph. Chance of rain 40%. Fri 29 Fri 29 | Day10 Day Weather-San Francisco, CA As of 5:52 pm PST alertLevel3 Coastal Flood Advisory+1 More Tonight Mostly Cloudy Night --/44° Rain 7% Arrow Up Sun 24| Night 44° Mostly Cloudy Night Rain 7%...'}])]},
{'op': 'add',
'path': '/final_output/messages/1',
'value': FunctionMessage(content='[{"url": "https://www.cbsnews.com/sanfrancisco/news/next-round-of-rain-set-to-arrive-in-bay-area-wednesday-morning/", "content": "weather persists through Thursday morning. The second system is projected to get to the Bay Area early Friday, Watch CBS News Next round of rain set to arrive in Bay Area Wednesday morning December 26, 2023 / 8:17 AM PST to the Bay Area on Wednesday with the arrival of the first of two storm systems. Overnight lows should be mostly in the 40s in the region, with some areas around the bay dropping into the 50s.Watch CBS News Weather Next round of rain set to arrive in Bay Area Wednesday morning December 26, 2023 / 8:17 AM PST / CBS/Bay City News Service While the outlook on Tuesday is cloudy and..."}, {"url": "https://weather.com/weather/tenday/l/San Francisco CA USCA0987:1:US", "content": "recents Specialty Forecasts 10 Day Weather-San Francisco, CA Today Mon 18 | Day Fri 22 Fri 22 | Day Foggy early, then partly cloudy later in the day. High around 60F. Winds W at 10 to 15 mph. Considerable cloudiness with occasional rain showers. High 59F. Winds SSE at 5 to 10 mph. Chance of rain 50%. Thu 28 | Night Cloudy with showers. Low 46F. Winds S at 5 to 10 mph. Chance of rain 40%. Fri 29 Fri 29 | Day10 Day Weather-San Francisco, CA As of 5:52 pm PST alertLevel3 Coastal Flood Advisory+1 More Tonight Mostly Cloudy Night --/44° Rain 7% Arrow Up Sun 24| Night 44° Mostly Cloudy Night Rain 7%..."}]', name='tavily_search_results_json')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2',
'value': {'end_time': None,
'final_output': None,
'id': '503b959e-b6c2-427b-b2e8-7d40497a2458',
'metadata': {},
'name': 'ChatOpenAI',
'start_time': '2023-12-26T17:56:00.983',
'streamed_output': [],
'streamed_output_str': [],
'tags': ['seq:step:3'],
'type': 'llm'}})
RunLogPatch({'op': 'add', 'path': '/logs/ChatOpenAI:2/streamed_output_str/-', 'value': ''},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content='')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': 'The'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content='The')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' weather'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' weather')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' in'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' in')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' San'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' San')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' Francisco'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' Francisco')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' is'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' is')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' currently'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' currently')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' cloudy'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' cloudy')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' with'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' with')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' occasional'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' occasional')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' rain'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' rain')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' showers'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' showers')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': '.'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content='.')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' The'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' The')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' temperature'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' temperature')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' is'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' is')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' around'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' around')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' '},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' ')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': '59'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content='59')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': '°F'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content='°F')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' ('},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' (')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': '15'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content='15')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': '°C'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content='°C')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ')'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=')')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' with'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' with')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' winds'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' winds')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' from'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' from')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' the'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' the')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' southeast'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' southeast')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' at'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' at')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' '},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' ')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': '5'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content='5')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' to'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' to')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' '},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' ')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': '10'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content='10')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' mph'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' mph')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': '.'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content='.')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' The'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' The')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' overnight'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' overnight')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' low'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' low')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' is'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' is')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' expected'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' expected')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' to'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' to')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' be'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' be')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' around'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' around')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' '},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' ')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': '46'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content='46')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': '°F'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content='°F')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' ('},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' (')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': '8'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content='8')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': '°C'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content='°C')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ')'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=')')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' with'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' with')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' a'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' a')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' chance'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' chance')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' of'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' of')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': ' showers'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content=' showers')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output_str/-',
'value': '.'},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content='.')})
RunLogPatch({'op': 'add', 'path': '/logs/ChatOpenAI:2/streamed_output_str/-', 'value': ''},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/streamed_output/-',
'value': AIMessageChunk(content='')})
RunLogPatch({'op': 'add',
'path': '/logs/ChatOpenAI:2/final_output',
'value': {'generations': [[{'generation_info': {'finish_reason': 'stop'},
'message': AIMessage(content='The weather in San Francisco is currently cloudy with occasional rain showers. The temperature is around 59°F (15°C) with winds from the southeast at 5 to 10 mph. The overnight low is expected to be around 46°F (8°C) with a chance of showers.'),
'text': 'The weather in San Francisco is '
'currently cloudy with occasional rain '
'showers. The temperature is around 59°F '
'(15°C) with winds from the southeast at '
'5 to 10 mph. The overnight low is '
'expected to be around 46°F (8°C) with a '
'chance of showers.',
'type': 'ChatGeneration'}]],
'llm_output': None,
'run': None}},
{'op': 'add',
'path': '/logs/ChatOpenAI:2/end_time',
'value': '2023-12-26T17:56:02.356'})
RunLogPatch({'op': 'add',
'path': '/streamed_output/-',
'value': {'messages': [AIMessage(content='The weather in San Francisco is currently cloudy with occasional rain showers. The temperature is around 59°F (15°C) with winds from the southeast at 5 to 10 mph. The overnight low is expected to be around 46°F (8°C) with a chance of showers.')],
'output': 'The weather in San Francisco is currently cloudy with '
'occasional rain showers. The temperature is around 59°F '
'(15°C) with winds from the southeast at 5 to 10 mph. '
'The overnight low is expected to be around 46°F (8°C) '
'with a chance of showers.'}},
{'op': 'add',
'path': '/final_output/output',
'value': 'The weather in San Francisco is currently cloudy with occasional '
'rain showers. The temperature is around 59°F (15°C) with winds '
'from the southeast at 5 to 10 mph. The overnight low is expected '
'to be around 46°F (8°C) with a chance of showers.'},
{'op': 'add',
'path': '/final_output/messages/2',
'value': AIMessage(content='The weather in San Francisco is currently cloudy with occasional rain showers. The temperature is around 59°F (15°C) with winds from the southeast at 5 to 10 mph. The overnight low is expected to be around 46°F (8°C) with a chance of showers.')})
This may require some logic to get in a workable format
path_status = {}
async for chunk in agent_executor.astream_log(
{"input": "what is the weather in sf", "chat_history": []},
include_names=["ChatOpenAI"],
):
for op in chunk.ops:
if op["op"] == "add":
if op["path"] not in path_status:
path_status[op["path"]] = op["value"]
else:
path_status[op["path"]] += op["value"]
print(op["path"])
print(path_status.get(op["path"]))
print("----")
None
----
/logs/ChatOpenAI
{'id': '3f6d3587-600f-419b-8225-8908a347b7d2', 'name': 'ChatOpenAI', 'type': 'llm', 'tags': ['seq:step:3'], 'metadata': {}, 'start_time': '2023-12-26T17:56:19.884', 'streamed_output': [], 'streamed_output_str': [], 'final_output': None, 'end_time': None}
----
/logs/ChatOpenAI/streamed_output/-
content='' additional_kwargs={'function_call': {'arguments': '', 'name': 'tavily_search_results_json'}}
----
/logs/ChatOpenAI/streamed_output/-
content='' additional_kwargs={'function_call': {'arguments': '{\n', 'name': 'tavily_search_results_json'}}
----
/logs/ChatOpenAI/streamed_output/-
content='' additional_kwargs={'function_call': {'arguments': '{\n ', 'name': 'tavily_search_results_json'}}
----
/logs/ChatOpenAI/streamed_output/-
content='' additional_kwargs={'function_call': {'arguments': '{\n "', 'name': 'tavily_search_results_json'}}
----
/logs/ChatOpenAI/streamed_output/-
content='' additional_kwargs={'function_call': {'arguments': '{\n "query', 'name': 'tavily_search_results_json'}}
----
/logs/ChatOpenAI/streamed_output/-
content='' additional_kwargs={'function_call': {'arguments': '{\n "query":', 'name': 'tavily_search_results_json'}}
----
/logs/ChatOpenAI/streamed_output/-
content='' additional_kwargs={'function_call': {'arguments': '{\n "query": "', 'name': 'tavily_search_results_json'}}
----
/logs/ChatOpenAI/streamed_output/-
content='' additional_kwargs={'function_call': {'arguments': '{\n "query": "weather', 'name': 'tavily_search_results_json'}}
----
/logs/ChatOpenAI/streamed_output/-
content='' additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in', 'name': 'tavily_search_results_json'}}
----
/logs/ChatOpenAI/streamed_output/-
content='' additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in San', 'name': 'tavily_search_results_json'}}
----
/logs/ChatOpenAI/streamed_output/-
content='' additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in San Francisco', 'name': 'tavily_search_results_json'}}
----
/logs/ChatOpenAI/streamed_output/-
content='' additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in San Francisco"\n', 'name': 'tavily_search_results_json'}}
----
/logs/ChatOpenAI/streamed_output/-
content='' additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in San Francisco"\n}', 'name': 'tavily_search_results_json'}}
----
/logs/ChatOpenAI/streamed_output/-
content='' additional_kwargs={'function_call': {'arguments': '{\n "query": "weather in San Francisco"\n}', 'name': 'tavily_search_results_json'}}
----
/logs/ChatOpenAI/end_time
2023-12-26T17:56:20.849
----
/final_output
None
----
/final_output/messages/1
content='[{"url": "https://weather.com/weather/tenday/l/San Francisco CA USCA0987:1:US", "content": "recents Specialty Forecasts 10 Day Weather-San Francisco, CA Today Mon 18 | Day Fri 22 Fri 22 | Day Foggy early, then partly cloudy later in the day. High around 60F. Winds W at 10 to 15 mph. Considerable cloudiness with occasional rain showers. High 59F. Winds SSE at 5 to 10 mph. Chance of rain 50%. Thu 28 | Night Cloudy with showers. Low 46F. Winds S at 5 to 10 mph. Chance of rain 40%. Fri 29 Fri 29 | Day10 Day Weather-San Francisco, CA As of 5:52 pm PST alertLevel3 Coastal Flood Advisory+1 More Tonight Mostly Cloudy Night --/44° Rain 7% Arrow Up Sun 24| Night 44° Mostly Cloudy Night Rain 7%..."}]' name='tavily_search_results_json'
----
/logs/ChatOpenAI:2
{'id': 'fc7ab413-6f59-4a9e-bae1-3140abdaff55', 'name': 'ChatOpenAI', 'type': 'llm', 'tags': ['seq:step:3'], 'metadata': {}, 'start_time': '2023-12-26T17:56:24.546', 'streamed_output': [], 'streamed_output_str': [], 'final_output': None, 'end_time': None}
----
/logs/ChatOpenAI:2/streamed_output/-
content=''
----
/logs/ChatOpenAI:2/streamed_output/-
content='The'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently fog'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around '
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F.'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day,'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy.'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at '
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to '
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph.'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow,'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will be'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will be considerable'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will be considerable cloud'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will be considerable cloudiness'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will be considerable cloudiness with'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will be considerable cloudiness with occasional'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will be considerable cloudiness with occasional rain'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will be considerable cloudiness with occasional rain showers'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will be considerable cloudiness with occasional rain showers and'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will be considerable cloudiness with occasional rain showers and a'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will be considerable cloudiness with occasional rain showers and a high'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will be considerable cloudiness with occasional rain showers and a high of'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will be considerable cloudiness with occasional rain showers and a high of '
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will be considerable cloudiness with occasional rain showers and a high of 59'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will be considerable cloudiness with occasional rain showers and a high of 59°F'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will be considerable cloudiness with occasional rain showers and a high of 59°F.'
----
/logs/ChatOpenAI:2/streamed_output/-
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will be considerable cloudiness with occasional rain showers and a high of 59°F.'
----
/logs/ChatOpenAI:2/end_time
2023-12-26T17:56:25.673
----
/final_output/messages/2
content='The weather in San Francisco is currently foggy with a high around 60°F. Later in the day, it will become partly cloudy. The wind is coming from the west at 10 to 15 mph. Tomorrow, there will be considerable cloudiness with occasional rain showers and a high of 59°F.'
----