Introduction
On this tutorial, we’ll construct a complicated AI-powered information agent that may search the online for the newest information on a given matter and summarize the outcomes. This agent follows a structured workflow:
- Searching: Generate related search queries and accumulate info from the online.
- Writing: Extracts and compiles information summaries from the collected info.
- Reflection: Critiques the summaries by checking for factual correctness and suggests enhancements.
- Refinement: Improves the summaries primarily based on the critique.
- Headline Technology: Generates acceptable headlines for every information abstract.
To boost usability, we will even create a easy GUI utilizing Streamlit. Just like earlier tutorials, we’ll use Groq for LLM-based processing and Tavily for net looking. You possibly can generate free API keys from their respective web sites.
Setting Up the Setting
We start by establishing setting variables, putting in the required libraries, and importing obligatory dependencies:
Set up Required Libraries
pip set up langgraph==0.2.53 langgraph-checkpoint==2.0.6 langgraph-sdk==0.1.36 langchain-groq langchain-community langgraph-checkpoint-sqlite==2.0.1 tavily-python streamlitImport Libraries and Set API Keys
import os
import sqlite3
from langgraph.graph import StateGraph
from langchain_core.messages import SystemMessage, HumanMessage
from langchain_groq import ChatGroq
from tavily import TavilyClient
from langgraph.checkpoint.sqlite import SqliteSaver
from typing import TypedDict, Checklist
from pydantic import BaseModel
import streamlit as st
# Set API Keys
os.environ['TAVILY_API_KEY'] = "your_tavily_key"
os.environ['GROQ_API_KEY'] = "your_groq_key"
# Initialize Database for Checkpointing
sqlite_conn = sqlite3.join("checkpoints.sqlite", check_same_thread=False)
reminiscence = SqliteSaver(sqlite_conn)
# Initialize Mannequin and Tavily Consumer
mannequin = ChatGroq(mannequin="Llama-3.1-8b-instant")
tavily = TavilyClient(api_key=os.environ["TAVILY_API_KEY"])Defining the Agent State
The agent maintains state info all through its workflow:
- Subject: The subject on which consumer needs the newest information Drafts: The primary drafts of the information summaries
- Content material: The analysis content material extracted from the search outcomes of the Tavily
- Critique: The critique and proposals generated for the draft within the reflection state.
- Refined Summaries: Up to date information summaries after incorporating suggesstions from Critique
Headings: Headlines generated for every information article class
class AgentState(TypedDict):
matter: str
drafts: Checklist[str]
content material: Checklist[str]
critiques: Checklist[str]
refined_summaries: Checklist[str]
headings: Checklist[str]Defining Prompts
We outline system prompts for every part of the agent’s workflow:
BROWSING_PROMPT = """You're an AI information researcher tasked with discovering the newest information articles on given subjects. Generate as much as 3 related search queries."""
WRITER_PROMPT = """You're an AI information summarizer. Write an in depth abstract (1 to 2 paragraphs) primarily based on the given content material, making certain factual correctness, readability, and coherence."""
CRITIQUE_PROMPT = """You're a trainer reviewing draft summaries towards the supply content material. Guarantee factual correctness, establish lacking or incorrect particulars, and recommend enhancements.
----------
Content material: {content material}
----------"""
REFINE_PROMPT = """You're an AI information editor. Given a abstract and critique, refine the abstract accordingly.
-----------
Abstract: {abstract}"""
HEADING_GENERATION_PROMPT = """You're an AI information summarizer. Generate a brief, descriptive headline for every information abstract."""Structuring Queries and Information
We use Pydantic to outline the construction of queries and Information articles. Pydantic permits us to outline the construction of the output of the LLM. That is essential as a result of we would like the queries to be an inventory of string and the extracted content material from net may have a number of information articles, therefore an inventory of strings.
from pydantic import BaseModel
class Queries(BaseModel):
queries: Checklist[str]
class Information(BaseModel):
information: Checklist[str]
Implementing the AI Brokers
1. Searching Node
This node generates search queries and retrieves related content material from the online.
def browsing_node(state: AgentState):
queries = mannequin.with_structured_output(Queries).invoke([
SystemMessage(content=BROWSING_PROMPT),
HumanMessage(content=state['topic'])
])
content material = state.get('content material', [])
for q in queries.queries:
response = tavily.search(question=q, max_results=2)
for r in response['results']:
content material.append(r['content'])
return {"content material": content material}2. Writing Node
Extracts information summaries from the retrieved content material.
def writing_node(state: AgentState):
content material = "nn".be part of(state['content'])
information = mannequin.with_structured_output(Information).invoke([
SystemMessage(content=WRITER_PROMPT),
HumanMessage(content=content)
])
return {"drafts": information.information}3. Reflection Node
Critiques the generated summaries towards the content material.
def reflection_node(state: AgentState):
content material = "nn".be part of(state['content'])
critiques = []
for draft in state['drafts']:
response = mannequin.invoke([
SystemMessage(content=CRITIQUE_PROMPT.format(content=content)),
HumanMessage(content="draft: " + draft)
])
critiques.append(response.content material)
return {"critiques": critiques}4. Refinement Node
Improves the summaries primarily based on critique.
def refine_node(state: AgentState):
refined_summaries = []
for abstract, critique in zip(state['drafts'], state['critiques']):
response = mannequin.invoke([
SystemMessage(content=REFINE_PROMPT.format(summary=summary)),
HumanMessage(content="Critique: " + critique)
])
refined_summaries.append(response.content material)
return {"refined_summaries": refined_summaries}5. Headlines Technology Node
Generates a brief headline for every information abstract.
def heading_node(state: AgentState):
headings = []
for abstract in state['refined_summaries']:
response = mannequin.invoke([
SystemMessage(content=HEADING_GENERATION_PROMPT),
HumanMessage(content=summary)
])
headings.append(response.content material)
return {"headings": headings}Constructing the UI with Streamlit
# Outline Streamlit app
st.title("Information Summarization Chatbot")
# Initialize session state
if "messages" not in st.session_state:
st.session_state["messages"] = []
# Show previous messages
for message in st.session_state["messages"]:
with st.chat_message(message["role"]):
st.markdown(message["content"])
# Enter subject for consumer
user_input = st.chat_input("Ask in regards to the newest information...")
thread = 1
if user_input:
st.session_state["messages"].append({"function": "consumer", "content material": user_input})
with st.chat_message("assistant"):
loading_text = st.empty()
loading_text.markdown("*Considering...*")
builder = StateGraph(AgentState)
builder.add_node("browser", browsing_node)
builder.add_node("author", writing_node)
builder.add_node("mirror", reflection_node)
builder.add_node("refine", refine_node)
builder.add_node("heading", heading_node)
builder.set_entry_point("browser")
builder.add_edge("browser", "author")
builder.add_edge("author", "mirror")
builder.add_edge("mirror", "refine")
builder.add_edge("refine", "heading")
graph = builder.compile(checkpointer=reminiscence)
config = {"configurable": {"thread_id": f"{thread}"}}
for s in graph.stream({"matter": user_input}, config):
# loading_text.markdown(f"*{st.session_state['loading_message']}*")
print(s)
s = graph.get_state(config).values
refined_summaries = s['refined_summaries']
headings = s['headings']
thread+=1
# Show closing response
loading_text.empty()
response_text = "nn".be part of([f"{h}n{s}" for h, s in zip(headings, refined_summaries)])
st.markdown(response_text)
st.session_state["messages"].append({"function": "assistant", "content material": response_text})Conclusion
This tutorial coated all the technique of constructing an AI-powered information summarization agent with a easy Streamlit UI. Now you possibly can mess around with this and make some additional enhancements like:
- A higher GUI for enhanced consumer interplay.
- Incorporating Iterative refinement to verify the summaries are correct and acceptable.
- Sustaining a context to proceed dialog about explicit information.
Blissful coding!
Additionally, be happy to observe us on Twitter and don’t overlook to affix our 75k+ ML SubReddit.
Vineet Kumar is a consulting intern at MarktechPost. He’s at the moment pursuing his BS from the Indian Institute of Know-how(IIT), Kanpur. He’s a Machine Studying fanatic. He’s captivated with analysis and the newest developments in Deep Studying, Laptop Imaginative and prescient, and associated fields.
