Author Topic: How do I write a script to scrape data from a website?  (Read 3331 times)

0 Members and 1 Guest are viewing this topic.

Offline NObamaTopic starter

  • Everything I need to know, I learned from Miffy's Item Finder.
  • Elite
  • *
  • *
  • Posts: 3454
  • Activity:
    0%
  • Reputation Power: 43
  • NObama is a force to reckon with.NObama is a force to reckon with.NObama is a force to reckon with.NObama is a force to reckon with.NObama is a force to reckon with.NObama is a force to reckon with.NObama is a force to reckon with.NObama is a force to reckon with.
  • Respect: +161
  • Referrals: 2
    • View Profile
How do I write a script to scrape data from a website?
« on: February 24, 2016, 07:20:49 PM »
0
Looking for something very simple:

Would like to scrape price data from MTGgoldfish.com and dump it into a csv so I can run some pivot tables in excel. 

If you've never used the site, go here to see what I want to capture every day:

http://www.mtggoldfish.com/index/modern#online

Thanks!

Offline Crome969

  • Elite
  • *
  • *
  • Posts: 2098
  • Activity:
    0%
  • Reputation Power: 25
  • Crome969 is on the verge of being accepted.Crome969 is on the verge of being accepted.Crome969 is on the verge of being accepted.Crome969 is on the verge of being accepted.Crome969 is on the verge of being accepted.
  • Gender: Male
  • UO Enthusiast
  • Respect: +211
  • Referrals: 10
    • View Profile
    • ScriptSDK
Re: How do I write a script to scrape data from a website?
« Reply #1 on: February 24, 2016, 11:47:22 PM »
0
If you look into the source code they call a java script http://assets1.mtggoldfish.com/assets/card-a6b4514e838532eb848e367ded342054.js to build the table.
You may could modify it and pipe the output. Enjoy my MTG Fellow!

Offline Teartmez

  • Restricted
  • *
  • Posts: 2
  • Activity:
    0%
  • Reputation Power: 1
  • Teartmez has no influence.
  • Respect: 0
  • Referrals: 0
    • View Profile
Re: How do I write a script to scrape data from a website?
« Reply #2 on: May 14, 2016, 01:08:42 AM »
0
It's so good

Tags: