TextDistiller: AI-Driven Book Summarization Tool by John NgaiTextDistiller: AI-Driven Book Summarization Tool by John Ngai

TextDistiller: AI-Driven Book Summarization Tool

Portfolio project
John Ngai

🍞 TextDistiller: Effortless Document Summarization

TextDistiller is an advanced, AI-driven tool designed to summarize books chapter by chapter or as a whole, providing concise yet comprehensive overviews. With TextDistiller, you can quickly grasp the core ideas and key takeaways from any book, saving time while maintaining comprehension.

Key Features

Chapter-wise Summarization: TextDistiller offers detailed summaries for each chapter, allowing you to focus on specific sections of interest.
Entire Book Synopsis: For books without chapter divisions, TextDistiller condenses the entire text into a coherent summary.
Powered by NLP: Utilizing state-of-the-art Natural Language Processing (NLP) techniques, TextDistiller effectively captures and summarizes the most pertinent content.
User-Friendly Interface: TextDistiller features a clean and intuitive interface, making the summarization process accessible and straightforward for all users.

How TextDistiller Works

TextDistiller leverages the T5-small pretrained model from HuggingFace Transformers to generate accurate and readable summaries. The process includes:
Chunking: The book is divided into chunks, either by chapter or as a single unit.
Tokenization: These chunks are tokenized using the T5Tokenizer for compatibility with the T5 model.
Summary Generation: The tokenized text is processed by the T5ForConditionalGeneration model to generate summary token IDs.
Decoding: The summary token IDs are decoded into human-readable text using the T5Tokenizer's decode() function.

Getting Started

Clone the repository:
Install the required dependencies:
To run via CLI:
To run on a Flask server with frontend and mail:
Update the sender_address and sender_pass in mail.py.
Run views.py:

Contributing

We welcome contributions from the community! If you'd like to contribute to TextDistiller, please feel free to submit a pull request or open an issue. Your feedback and support are greatly appreciated!

License

TextDistiller is distributed under the MIT License.
Maintained by John Ngai

0 likes · 11 views · May 15, 2025

Developed TextDistiller, an AI tool for book summarization.

Tags