Shantanu Blog: Explore Indian Language Websites
CommonCrawl creates and maintains an open repository of web crawling data that can be viewed and analyzed by anyone. https://commoncrawl.org/ Here are 3 easy steps to download the data in any language eg Marathi or Gujarati 1) Clone the git clone from the repo https://github.com/qburst/common-crawl-malayalam.git 2) Change the language code from mal to mar on ...










