Web Crawler

[ashish verma]

have anyone ever tried working/ worked on web crawler can you help me please..??

[xander333]

What is web crawler supposed to do?

[Cheraphy]

I was going to sum it up but I'm incredibly lazy. SO! enjoy a nice, tasty wikipedia article :D http://en.wikipedia.org/wiki/Web_crawler

Ashish, judging from your other questions here I don't think you're ready to program something like that. Is there any reason in particular as to why you'd want to?

[R0mai]

@OP
I did.

[ashish verma]

yes I want to program this as I am a bit lazy and never programmed anything like this before...

[Computergeek01]

It took me about half an hour to find this quote again, but it was worth it for how much it influenced my programming style and how you should look at your being "lazy" (please excuse the source):

Generaloberst Kurt Von Hammerstein-Equord

I divide my officers into four groups. There are clever, diligent, stupid, and lazy officers. Usually two characteristics are combined. Some are clever and diligent -- their place is the General Staff. The next lot are stupid and lazy -- they make up 90 percent of every army and are suited to routine duties. Anyone who is both clever and lazy is qualified for the highest leadership duties, because he possesses the intellectual clarity and the composure necessary for difficult decisions. One must beware of anyone who is stupid and diligent -- he must not be entrusted with any responsibility because he will always cause only mischief.

EDIT: Also, source: http://en.wikipedia.org/wiki/Kurt_von_Hammerstein

[ashish verma]

Thanks Computergeek01 ,,
I like it.

but can you tell me what should i do as i find it diffcult to code my algos (being lazy)..??

[Computergeek01]

Early on there's very little you can do because if you keep reusing stuff that you barely understand then you'll never learn anything.

But save everything you do and when you get better at coding you'll slowley build up a collection of stuff that is worth reusing.