1. Welcome to Tacoma World!

    You are currently viewing as a guest! To get full-access, you need to register for a FREE account.

    As a registered member, you’ll be able to:
    • Participate in all Tacoma discussion topics
    • Communicate privately with other Tacoma owners from around the world
    • Post your own photos in our Members Gallery
    • Access all special features of the site

Am I allowed to scrape Tacoma World?

Discussion in 'Off-Topic Discussion' started by soggyBottom, May 1, 2022.

  1. May 1, 2022 at 6:23 AM
    #1
    soggyBottom

    soggyBottom [OP] Well-Known Member

    Joined:
    Sep 19, 2018
    Member:
    #266818
    Messages:
    1,938
    Am I allowed to scrape Tacoma World? A while back I asked if there was an API and was told, "no there isn't one". Can I scrape it? Am I somehow breaking the rules/terms of TW by doing it?

    Why? For science.

    I'm not doing this for commercial reasons. I want to brush up on some of my data science knowledge. I'll be happy to share any of my findings. Don't expect anything groundbreaking. There are some really interesting patterns that appear when you have so much text. For example Stanford published a project a few years ago on GloVectors (global vectors). They used something like 2 billion tweets to generate a glorified thesaurus complete with slang words.
     
  2. May 1, 2022 at 6:34 AM
    #2
    Hook78

    Hook78 Well-Known Member

    Joined:
    Dec 3, 2017
    Member:
    #237571
    Messages:
    6,816
    Gender:
    Male
    Eastern NC
    Vehicle:
    2015 DCSB TRD OR
    Bilstein 6112/5160 Icon RXT
  3. May 1, 2022 at 6:35 AM
    #3
    Hook78

    Hook78 Well-Known Member

    Joined:
    Dec 3, 2017
    Member:
    #237571
    Messages:
    6,816
    Gender:
    Male
    Eastern NC
    Vehicle:
    2015 DCSB TRD OR
    Bilstein 6112/5160 Icon RXT
    It’s a publicly available website, so I don’t know why you need permission…no one would even know if you never asked right?
     
  4. May 1, 2022 at 7:17 AM
    #4
    soggyBottom

    soggyBottom [OP] Well-Known Member

    Joined:
    Sep 19, 2018
    Member:
    #266818
    Messages:
    1,938
    Yeah but if there is a bunch of requests coming from from a specific ip, addresses can sometimes get blocked. I'd prefer to know what im getting into before I do any work.
     
  5. May 1, 2022 at 11:05 AM
    #5
    Hook78

    Hook78 Well-Known Member

    Joined:
    Dec 3, 2017
    Member:
    #237571
    Messages:
    6,816
    Gender:
    Male
    Eastern NC
    Vehicle:
    2015 DCSB TRD OR
    Bilstein 6112/5160 Icon RXT
    Shoot the mods a note on the thread I sent above.
     

Products Discussed in

To Top