Skip to content

Readme.md

Latest commit

 

History

History
84 lines (70 loc) · 3.4 KB

Readme.md

File metadata and controls

84 lines (70 loc) · 3.4 KB

Text Preprocessing Project

Welcome to the Text Preprocessing Project! This project is designed to help you preprocess text data using various techniques like tokenization, lemmatization, stemming, and more. It includes a simple Tkinter GUI that allows users to input text and apply different preprocessing functions to it.

Project Structure

  • Functions/: This directory includes Python scripts for various text preprocessing functions:
    • voices_script.py: For handling different voice processing tasks.
    • clauses.py: For clause-based text processing.
    • tenses.py: For identifying and modifying tenses in text.
    • pos_tagging.py: For part-of-speech tagging.
    • lemmatize_script.py: For lemmatization.
    • stem_script.py: For stemming.
    • tokenize_script.py: For tokenization.
  • nltk_data/: Contains necessary NLTK data used for various text processing tasks:
    • corpora/: Includes corpora like stopwords and WordNet.
    • taggers/: Contains the averaged perceptron tagger.
    • tokenizers/: Includes the Punkt tokenizer.
  • .gitignore: Specifies files and directories to be ignored by Git.
  • Readme.md: This file.
  • requirements.txt: Lists the Python packages required to run the project.
  • run.py: The main script to run the Tkinter GUI.

Features

  • Tokenization: Breaks down text into words or sentences.
  • Lemmatization: Converts words to their base or dictionary form.
  • Stemming: Reduces words to their root form.
  • POS Tagging: Tags parts of speech for each word in the text.
  • Tense Handling: Identifies and modifies tenses in the text.
  • Clause Processing: Analyzes and processes clauses within the text.
  • Voice Processing: Handles different voice-related text transformations.

Installation

To get started with this project, follow these steps:

  1. Clone the Repository 
    git clone https://github.com/SumitRajam/Text_Preprocessor.git
cd Text_Preprocessor
  2. Install Dependencies
    Create a virtual environment and install the required packages 
     python -m venv venv
 source venv/bin/activate   # On Windows use `venv\Scripts\activate`
 pip install -r requirements.txt

Usage

  1. Run tkinter GUI
    Start the application by running:

    python run.py

    The Tkinter GUI will open, allowing you to input text and apply various preprocessing functions.

  2. Using the GUI

  • Input Text: Enter the text you want to preprocess.
  • Select a Function: Choose a preprocessing function from the available buttons.
  • View Output: Click the selected button to apply the function and view the results.

Contributing

We welcome contributions to enhance this project! If you'd like to contribute, please follow these steps:

  1. Fork the Repository: Click the "Fork" button on the top-right corner of this page.
  2. Create a Branch: Create a new branch for your feature or bug fix. 
    git checkout -b feature/your-feature-name
  3. Make Changes: Implement your changes and commit them. 
    git add .
git commit -m "Add your commit message"
  4. Push Changes: Push your changes to your forked repository. 
    git push origin feature/your-feature-name
  5. Create a Pull Request: Go to the original repository and create a pull request from your forked repository.

Happy preprocessing! ⚙️💬🧠🖥️