Goglides Dev 🌱

Cover image for A Step-by-Step Guide to Summarizing Lengthy Transcription Meetings with LLM
Mallikarjun for goglides

Posted on • Updated on

A Step-by-Step Guide to Summarizing Lengthy Transcription Meetings with LLM

Today we will deep dive into learning to summarize long transcription meetings.

Project Overview:

  1. Introduction
  2. Background
  3. Tools and Technologies
  4. Project Components
  5. How It Works
  6. Benefits
  7. Challenges and Considerations
  8. Future Directions
  9. Question asked
  10. Conclusion

For the complete code, visit our Github repository

1. Introduction:

In this project, We are focusing on summarization of long transcript meetings. We have developed a comprehensive solution that summarizes any transcription. HR professionals are the intended audience. who often grapple with the task of digesting lengthy meeting records.

2. Background:

No need to manually read all the transcriptions and remember the insights. This process takes a lot of time and human resources. Using this tool we can summarize transcriptions within a few seconds without having to worry about accuracy.

3. Tools and Technologies:

Python: The base programming language used across the project.
Gradio: is used to quickly build a web interface.
OpenAI models: Core LLMs to classify documents.
Langchian: is used to integrate all the services.

4. Project Components:

A) Web Interface: Gradio helps us to transform Python scripts into interactive data science/Machine learning web apps in minutes, instead of weeks with regular frontend tools. Build dashboards, generate reports, or create chat apps.

B) LLMs: We have utilized OpenAI models that are, like, super powerful and, efficient in generating and understanding natural language texts. it is based on GPT (Generative pre-trained transformers) architecture. We have used the Openai GPT-3.5-turbo model in our project.

C) Integration: Langchain is an open-source LLM framework that is widely used in various applications like RAG, Query database, web scraping, chatbots, etc. It is used to integrate any LLM with any service out there, We have utilized the load_summarize_chain from langchain.

5. How It Works:

Gradio interface takes input as text and outputs as text, as shown below.

summ = gr.Interface(summary,[gr.Textbox(label="MeetingsTranscription:", value="")], "textbox",)
Enter fullscreen mode Exit fullscreen mode

With this input, a document object is created and an LLM object is created using ChatOpenAI from langchain and is passed as a parameter to "load_summarize_chain". our input document object is run on top of "load_summarize_chain".

from langchain.chains.summarize import load_summarize_chain
from langchain_openai import ChatOpenAI
from langchain.schema.document import Document
llm = ChatOpenAI(temperature=0, model_name="gpt-3.5-turbo", api_key=api_key)
def summary(trans):
  # Create a document object with some text and metadata
  doc = Document(page_content=trans, metadata={"source": "local"})
  chain = load_summarize_chain(llm, chain_type="stuff")
  return chain.run([doc])
Enter fullscreen mode Exit fullscreen mode

6. Benefits:

Any individual who wants to summarize their long meeting transcripts can utilize this tool. We don't have to go through the entire transcription to know key things.

7. Challenges and Considerations:

The transcription token length should be less than the LLM context length. If we have a long transcription that is greater than the model context length, then we can use prompt compression to reduce the token length

8. Future Directions:

I have implemented this super exciting and fun project to take input as long transcriptions and produce an output as a summary, You can extend this whole thing with any input like PDF, text, HTML, etc.

9. Results:

Input:

Meeting of CTAS County Commission-Transcript of Dialogue

Chairman Wormsley (at the proper time and place, after taking the chair and striking the gavel on the table): This meeting of the CTAS County Commission will come to order. Clerk please call the role. (Ensure that a majority of the members are present.)

Chairman Wormsley: Each of you has received the agenda. I will entertain a motion that the agenda be approved.

Commissioner Brown: So moved.

Commissioner Hobbs: Seconded

Chairman Wormsley: It has been moved and seconded that the agenda be approved as received by the members. All those in favor signify by saying "Aye"?...Opposed by saying "No"?...The agenda is approved. You have received a copy of the minutes of the last meeting. Are there any corrections or additions to the meeting?

Commissioner McCroskey: Mister Chairman, my name has been omitted from the Special Committee on Indigent Care.

Chairman Wormsley: Thank you. If there are no objections, the minutes will be corrected to include the name of Commissioner McCroskey. Will the clerk please make this correction. Any further corrections? Seeing none, without objection the minutes will stand approved as read. (This is sort of a short cut way that is commonly used for approval of minutes and/or the agenda rather than requiring a motion and second.)

Chairman Wormsley: Commissioner Adkins, the first item on the agenda is yours.

Commissioner Adkins: Mister Chairman, I would like to make a motion to approve the resolution taking money from the Data Processing Reserve Account in the County Clerk's office and moving it to the equipment line to purchase a laptop computer.

Commissioner Carmical: I second the motion.

Chairman Wormsley: This resolution has a motion and second. Will the clerk please take the vote.

Chairman Wormsley: The resolution passes. We will now take up old business. At our last meeting, Commissioner McKee, your motion to sell property near the airport was deferred to this meeting. You are recognized.

Commissioner McKee: I move to withdraw that motion.

Chairman Wormsley: Commissioner McKee has moved to withdraw his motion to sell property near the airport. Seeing no objection, this motion is withdrawn. The next item on the agenda is Commissioner Rodgers'.

Commissioner Rodgers: I move adopton of the resolution previously provided to each of you to increase the state match local litigation tax in circuit, chancery, and criminal courts to the maximum amounts permissible. This resolution calls for the increases to go to the general fund.

Chairman Wormsley: Commissioner Duckett

Commissioner Duckett: The sheriff is opposed to this increase.

Chairman Wormsley: Commissioner, you are out of order because this motion has not been seconded as needed before the floor is open for discussion or debate. Discussion will begin after we have a second. Is there a second?

Commissioner Reinhart: For purposes of discussion, I second the motion.

Chairman Wormsley: Commissioner Rodgers is recognized.

Commissioner Rodgers: (Speaks about the data on collections, handing out all sorts of numerical figures regarding the litigation tax, and the county's need for additional revenue.)

Chairman Wormsley: Commissioner Duckett

Commissioner Duckett: I move an amendment to the motion to require 25 percent of the proceeds from the increase in the tax on criminal cases go to fund the sheriff's department.

Chairman Wormsley: Commissioner Malone

Commissioner Malone: I second the amendment.

Chairman Wormsley: A motion has been made and seconded to amend the motion to increase the state match local litigation taxes to the maximum amounts to require 25 percent of the proceeds from the increase in the tax on criminal cases in courts of record going to fund the sheriff's department. Any discussion? Will all those in favor please raise your hand? All those opposed please raise your hand. The amendment carries 17-2. We are now on the motion as amended. Any further discussion?

Commissioner Headrick: Does this require a two-thirds vote?

Chairman Wormsley: Will the county attorney answer that question?

County Attorney Fults: Since these are only courts of record, a majority vote will pass it. The two-thirds requirement is for the general sessions taxes.

Chairman Wormsley: Other questions or discussion? Commissioner Adams.

Commissioner Adams: Move for a roll call vote.

Commissioner Crenshaw: Second

Chairman Wormsley: The motion has been made and seconded that the state match local litigation taxes be increased to the maximum amounts allowed by law with 25 percent of the proceeds from the increase in the tax on criminal cases in courts of record going to fund the sheriff's department. Will all those in favor please vote as the clerk calls your name, those in favor vote "aye," those against vote "no." Nine votes for, nine votes against, one not voting. The increase fails. We are now on new business. Commissioner Adkins, the first item on the agenda is yours.

Commissioner Adkins: Each of you has previously received a copy of a resolution to increase the wheel tax by $10 to make up the state cut in education funding. I move adoption of this resolution.

Chairman Wormsley: Commissioner Thompson

Commissioner Thompson: I second.

Chairman Wormsley: It has been properly moved and seconded that a resolution increasing the wheel tax by $10 to make up the state cut in education funding be passed. Any discussion? (At this point numerous county commissioners speak for and against increasing the wheel tax and making up the education cuts. This is the first time this resolution is under consideration.) Commissioner Hayes is recognized.

Commissioner Hayes: I move previous question.

Commisioner Crenshaw: Second.

Chairman Wormsley: Previous question has been moved and seconded. As you know, a motion for previous question, if passed by a two-thirds vote, will cut off further debate and require us to vote yes or no on the resolution before us. You should vote for this motion if you wish to cut off further debate of the wheel tax increase at this point. Will all those in favor of previous question please raise your hand? Will all those against please raise your hand? The vote is 17-2. Previous question passes. We are now on the motion to increase the wheel tax by $10 to make up the state cut in education funding. Will all those in favor please raise your hand? Will all those against please raise your hand? The vote is 17-2. This increase passes on first passage. Is there any other new business? Since no member is seeking recognition, are there announcements? Commissioner Hailey.

Commissioner Hailey: There will be a meeting of the Budget Committee to look at solid waste funding recommendations on Tuesday, July 16 at noon here in this room.

Chairman Wormsley: Any other announcements? The next meeting of this body will be Monday, August 19 at 7 p.m., here in this room. Commissioner Carmical.

Commissioner Carmical: There will be a chili supper at County Elementary School on August 16 at 6:30 p.m. Everyone is invited.

Chairman Wormsley: Commissioner Austin.

Commissioner Austin: Move adjournment.

Commissioner Garland: Second.

Chairman Wormsley: Without objection, the meeting will stand adjourned.
Enter fullscreen mode Exit fullscreen mode

Output:

The CTAS County Commission meeting was called to order by Chairman Wormsley. The agenda and minutes were approved with minor corrections. Resolutions to move funds for a laptop and increase litigation taxes were discussed and voted on. The increase in litigation taxes failed. A resolution to increase the wheel tax to make up for education cuts was passed after a motion for the previous question. The meeting concluded with announcements and adjournment.
Enter fullscreen mode Exit fullscreen mode

10.Conclusion:

Our project provides a unique solution for any professionals who want to summarize their transcription. It is significant in saving a lot of time, they don't have to go through the entire transcription. we can further customize this solution to replace the input with documents like PDF, text, etc.

Top comments (0)