Copy data from cheerio and nodejs

I used the cheerio module to clear the product listing from the website. But you got a problem, website using "Infinite Scroll" to load data (load data when scrolling down). So cheerio cannot get all the food.

Can anyone suggest me solutions for this problem? Thank you.


source to share

1 answer

You can check what requests the page is making when scrolling. Then just push these queries and get the data.

Alternatively, you can try using something like node-phantom-simple , cause scrolling through Phantom, and clean up.

I would go with the first option.



All Articles