1. Home
  2. Database Software
  3. Is There A Way/program To Automatically Copy The Info From A Website?

Discuss in my Forum

Is There A Way/program To Automatically Copy The Info From A Website?

By admin Posted in: Database Software

Let me explain better:
I want to know if there is a way i can copy the info from a action website. There are always actions happening and their final result ends some time after it’s end. What i do is collect the info of the final action. I do it manually and it is a hack of a job…
I know a website that does something like that:
example: Runescape has a lot of database information and there is another website that has info about runescape, (tip.it). this website is always updating according to the Runescape information. Is there a way i can do something like that?

«
»
  1. deonejua Says

    We called it screen scraping, and it is custom programming that cracks over time. Web pages are made of html and all we usually want is the text-data without all the hypertext markup. Spider programs are easy to code with very few lines using Java, perl, python or others. You don’t really need a browser to view a web page.
    Spyder programs are quick to dump the html of a web page and then your code has to scan through the hypertext until it finds that block of info you want. That’s the rub. Web pages are always getting better or trying a new technology, thus us programmers have to insert a test block into the spyder to stop downloading the page and to stop looking through the hypertext if things aren’t working.
    If what you are trying to do is text-based, then Perl is probably your answer.

  2. Nathan Says

    Many blogs and websites have RSS feeds, that way if you have an RSS reader you can get updates on new things and posts all in one place.
    Check out this link for more info:http://www.whatisrss.com/

Leave a Reply

You must be logged in to post a comment.

More Interesting Things

Database Software

©2011 Softwares Reviews, All rights reserved.