Computer programmers, lend me your ear... (deal related)

Hopefully it's not too late. But awesome code you've got! I'm a network guy but I've always have interest in coding! Might do a Arduino BLE project on the truck eventually.

 

Wow, great pics!

 

I built the same functionality in a Google sheet using the IMPORTFROMWEB function and it works amazing. It’s fast as hell and updates over 100 dealer prices in no time. One huge bummer though, it’s not free. There is a free version but it only lets you do 150 calls a month for free, and scraping over 100 dealers means you burn through that in less than two uses. I’ll post the Google sheet with instructions to add the IMPORTFROMWEB function.

 

Below is a link to a google sheet I made that scrapes +90 Toyota dealers. It uses an add-on function called "IMPORTFROMWEB" that must be activated (instructions to do so are in the google sheet). A third party makes that function and charges money for it, but they do let you use it for free on a trial basis.

https://docs.google.com/spreadsheets/d/1nB4qU33u-9Q8qXMDfEHxSg4qM89YPuVomthtAHeKrqo/edit#gid=0

 

I put a version on github that can be run locally on your machine if you are into running python programs locally. It scrapes 142 dealers, takes 10 mins or so to finish running. Results are saved to a .csv file with prices sorted cheapest to most expensive:

https://github.com/alphabrew/toyota-scrape

 

I'd like to give this a try but I don't have the slightest clue how to use Python.

 

Perfect excuse to learn! I didn’t know chit about Python a year ago. Take an Udemy course and have some fun! It’s not hard, just take some consistent practice. Just be a little patient, you need to learn a few tools to make everything work (the command line, a text editor, GitHub).

 

Here’s a link to a FREE Udemy course on Python. Free for the next 2 days so grab it now.

https://www.udemy.com/course/automate/?couponCode=MAR2021FREE

 

Signed up!

Now to find some time to go through it...

 

Great thread and idea - Thanks for all the work everyone has put into it. I seem to be having issues with the web app. When I search for a link such as https://parts.toyota.com/p/69524316/PT39235120.html it's giving an application error. The spreadsheet is also giving some errors and the python script produces a blank CSV file. Just wondering if anyone has ran this utility lately on any of the available resources.

 

Strangely it's not working for me either. Yesterday the command line version worked great to retrieve the price of the TRD radiator cap for me (results attached), but with your link I couldn't even get a .csv to generate even after letting it run for a half a hour which should be more than enough time to return data.

The online version sometimes just acts wonky, I think it has to do with Heroku bandwidth at any given time. They're not charging me for hosting, so you get what you pay for I guess. One test is that if the buttons for the bed mat don't work, then that's a good indication that something external is wrong.

 

For the spreadsheet I found I was getting SSL/TLS errors and going to some of the dealer sites I was getting certificate errors in the browser which is on the dealers' side. So I thought changing the URL format to unsecured HTTP would do the trick but some of the other URLs 404'd so the pages were down or are no longer maintained which causes it to not function. Not sure if that would affect the Python script which I imagine the web app is using as a backend (and will work) but either way the web app loaded after some tries and got me the lowest price of the listing I was searching for. This is a really cool idea/implementation and I appreciate the execution and def can't beat free with the hosting for such an app, just gotta re-try I think and will eventually make it through. Thanks again for the work on this and thread!

 

Something is definitely wrong. Looks like maybe Toyota slightly changed some things under the hood of their website, so now the code is looking in the wrong place. I'll have to step through the code and re-map everything when I get some time.

 

Hi all, looking for a cheap, good, black, exhaust tip that would fit my 2021 trd sport stock tail pipe

thanks, Alex

 

Bump any update?