SocialGirls is a web scraping tool that allows you to crawl and download images from various social media platforms.
SocialGirls is built with Deno, a secure runtime for JavaScript and TypeScript. It uses web scraping techniques to fetch web page content, extract images and text, and download the images to your local machine.
To use SocialGirls, you need to have Deno installed on your system. You can install Deno by following the instructions in the Deno documentation.
Once Deno is installed, you can clone the SocialGirls repository:
git clone https://github.com/InfoProspectors/socialgirls.git- Navigate to the project directory:
cd socialgirls- Install the project dependencies:
- Run the main script:
deno run --allow-net --allow-read --allow-write ./main.tsThe script will crawl the specified URLs, extract images and text, and download the images to the data/image directory.
You can customize the URLs to crawl by modifying the urls array in the main.ts file.
Contributions are welcome! If you have any suggestions, bug reports, or feature requests, please open an issue on the GitHub repository or submit a pull request.
Before contributing, please make sure to read the Contributing Guidelines of this project.
This project is licensed under the MIT License.
