Clever Geek Handbook

Copy data from cheerio and nodejs

I used the cheerio module to clear the product listing from the website. But you got a problem, website using "Infinite Scroll" to load data (load data when scrolling down). So cheerio cannot get all the food.

Can anyone suggest me solutions for this problem? Thank you.

+3


source to share


1 answer


You can check what requests the page is making when scrolling. Then just push these queries and get the data.

Alternatively, you can try using something like node-phantom-simple , cause scrolling through Phantom, and clean up.



I would go with the first option.

+1


source






More articles:


All Articles