Limits to SNH data harvesting
SNH has no general built-in limit as far as harvesting data is concerned. However, limits may arise for two reasons:
- Data limit by social networks
SNH only accesses the social networks’ webpages in general. Each social network determines the quality and quantity of the data provided independently.
Example: An account has 50,000+ friends/contacts. But the browser only shows 1,000. Since SNH only accesses the browser, only 1,000 contacts can be harvested.
- Technical limit
In general, social network sites are not designed for displaying large volumes of data. Depending on the quality of the website’s programming, displaying a contact or post can consume a significant amount of the browser’s resources (RAM, CPU time). If browser resources exceed computer performance, then the harvest will slow down significantly until it ultimately stops. SNH will only harvest data as long as the browser makes the data available. Another key factor is that only one CPU core is used to display a webpage in a browser.
While the technical limits depend directly on the hardware used, there is no such dependency in terms of the built-in data limits of the social networks. We have broken down the social network limitations we are aware of below. However, this list does not take into account the possibility of individual harvesting accounts also being limited on a case-by-case basis.
No Facebook data limits currently known.
Comments on one post limited to 2,000.
Limited to approx. 4,000 tweets per account.
No VK data limits currently known.
Friends and followers limited to 10,000 each.
No data limits imposed by ok.ru currently known. However, the ok.ru website is very buggy. This can make it difficult to perform an effective data harvest.