Sentiment analysis with classical text embedding for Tokopedia's product's reviews.
- Install PDM
curl -sSL https://pdm-project.org/install-pdm.py | python3 - - Install dependencies (sync environment)
pdm sync
- Create virtual environment
python -m venv .venv
- Activate the virtual environment
# .\.venv\Scripts\activate # windows ./.venv/bin/activate # linux
- Install dependencies
pip install -r requirements.txt
- Sign up for Zyte API (for scraping). Modify .env.example to .env and put your API key there. Also follow the guide in Zyte docs to install certificate.
cp .env.example .env
- Run scraping
pdm run scrape -o reviews.jsonl