cloud

Hasss The cloud is ready now at Shivalink.com

Yes The Cloud shivalink.com is ready and waiting for first signup, Current capacity 26 User per 5GB, with nginx and owncloud. Hosting capacity upto 40 users with SSD and Link speed of 1Gbps Out speed and 5Gbps Incoming unmetered Bandwidth… 🙂 . It has mail server, apache with CGI for all kinds of web hosting, Proxy Server, Torrent Server blabla. Enjoyyyy

Projects

Crawler 2.0 multiprocess

Hi every one, How could I miss crawler 2.0 and posted 3.0 before this. Here I am posting 2.0 crawler with multiprocess facility.. 😉 Actually 3.0 thread based crawler was easy to develop, and now it is the time for release of final 2.0.

Why I am making crawler,  actually me and my friends Abhijeet and Zainab were thinking of making basic search engine. But we know there are already better than our’s. Then we thought we can do some better with this crawler thing, and now one more guy joined us, Mr Nirav quite high skilled person and work on highly critical projects.

Now I am more sure of finishing all this in time and make an automatic system that will post all new thing on bestindianwear.com. We can say it will be a basic AI (Artificial Intelligent) project. Abhijeet is working quite hard on it

Thanks Guys – I do not feel alone, and your efforts make our way enjoyable. Cheers to everyone we will be finishing this soon… 🙂

https://github.com/vishvendrasingh/crawler/blob/master/crawler_2.0_stable.py

Projects

Crawler 3.0 is here (Parallel Approach to crawling for Surface crawling)

Hi Guys,

Yes as you read above, one of my colleague asked me what would be the speed of parallel, thread based crawler, Now I am posting this to so that you all can check out the speed. Now how to use this, its very simple, it is written in the file itself. check it out….. 😉 enjoy and let me sleep now!

https://github.com/vishvendrasingh/crawler/blob/master/crawler_3.0_stable.py