incorrect prices being returned
complete
Joseph Arcila
complete
Thank you Chris for your comments!
You should no longer get incorrect prices unless they make a drastic change to their website. Please, if you notice this error again, let us know.
Joseph Arcila
Merged in a post:
Improvements to the scraper
LeonBlade
Hello,
I don't fully know how your service works, so please excuse me if my request here won't work with your system.
I've been primarily buying off of Melonbooks and have noticed that the scraper used to pull in the data from the page almost always gets the information wrong. There's a 50/50 chance it pulls in the correct image, otherwise it just pulls a screengrab of the page. The price is almost always wrong.
I assume that you take a general approach for scraping data on any given site, which is why it is picking up wrong information.
My suggestion would be to develop into the scraper a way to match a specific site in order to look up this information based on specifics of the markup.
Melonbooks in particular has very easily queried sections on the page which would make pulling this information very easy.
I understand that this would mean needing to author specific queries for pages, and then how do you know when it's appropriate to do this, what happens when the site is updated... it could become a mess to maintain. This is why I would suggest that it could fallback to the normal search if it cannot find the elements it is expecting, which would prompt updating the queries to get this information.
I hope this isn't too much of an ask. I know it's a technical suggestion, and I'm speaking from a lot of ignorance here in regards to how you're pulling in this data.
I'm open to a discussion on this and will monitor this ticket.
Thank you!
Joseph Arcila
planned
J
Jessica
Note: This same issue has received 2 additional reports of the same struggles as of August 17th, 2022 through email.