Login / Sign up
Frequently Asked Questions

Why is data mining bad?


First, what is data mining?
When someone writes a program that makes lots of web page requests (eg. for Magelo profiles) for subsequent data extraction, that's a data mining program.

Why is it bad?
These programs don't operate as you and I do. They have the capacity to make LOTS of requests very quickly. They drive the servers hard, slowing response times for us normal users. Their traffic takes up bandwidth, driving costs up. They typically operate on a recurring time basis which has nothing to do with when a profile changes, and so wasteful requests are made. Generally, the practice is frowned upon. There are better ways to do it. Be more creative. And please be mindful of bandwidth use here. We don't want to have to raise prices because of higher costs.
Written initially by Onetree