Author Topic: How do I write a script to scrape data from a website?  (Read 930 times)

0 Members and 1 Guest are viewing this topic.

Offline NObamaTopic starter

  • Everything I need to know, I learned from Miffy's Item Finder.
  • Elite
  • *
  • *
  • Posts: 3454
  • Activity:
    0%
  • Reputation Power: 43
  • NObama is a force to reckon with.NObama is a force to reckon with.NObama is a force to reckon with.NObama is a force to reckon with.NObama is a force to reckon with.NObama is a force to reckon with.NObama is a force to reckon with.NObama is a force to reckon with.
  • Respect: +161
  • Referrals: 2
    • View Profile
How do I write a script to scrape data from a website?
« on: February 24, 2016, 07:20:49 PM »
0
Looking for something very simple:

Would like to scrape price data from MTGgoldfish.com and dump it into a csv so I can run some pivot tables in excel. 

If you've never used the site, go here to see what I want to capture every day:

http://www.mtggoldfish.com/index/modern#online

Thanks!

Offline Crome969

  • RebirthUO - Developer
  • Elite
  • *
  • *
  • Posts: 2090
  • Activity:
    0%
  • Reputation Power: 24
  • Crome969 might someday be someone...Crome969 might someday be someone...Crome969 might someday be someone...Crome969 might someday be someone...
  • Gender: Male
  • StealthUO - Developer
  • Respect: +209
  • Referrals: 9
    • View Profile
    • RebirthUO - UO Freeshard
Re: How do I write a script to scrape data from a website?
« Reply #1 on: February 24, 2016, 11:47:22 PM »
0
If you look into the source code they call a java script http://assets1.mtggoldfish.com/assets/card-a6b4514e838532eb848e367ded342054.js to build the table.
You may could modify it and pipe the output. Enjoy my MTG Fellow!

Offline Teartmez

  • Restricted
  • *
  • Posts: 2
  • Activity:
    0%
  • Reputation Power: 1
  • Teartmez has no influence.
  • Respect: 0
  • Referrals: 0
    • View Profile
Re: How do I write a script to scrape data from a website?
« Reply #2 on: May 14, 2016, 01:08:42 AM »
0
It's so good

Tags: