Welcome, Guest: Register On Nairaland / LOGIN! / Trending / Recent / New
Stats: 3,205,003 members, 7,990,765 topics. Date: Friday, 01 November 2024 at 12:09 AM

Please Who Here Is Good With Web Scraping (octoparse) ? - Programming - Nairaland

Nairaland Forum / Science/Technology / Programming / Please Who Here Is Good With Web Scraping (octoparse) ? (277 Views)

In Need Of Someone Who Is Good With Excel / The Future Of Web Scraping / Jumia Black Friday Web Scraping Program (2) (3) (4)

(1) (Reply) (Go Down)

Please Who Here Is Good With Web Scraping (octoparse) ? by 99thEnemy(m): 1:02pm On Apr 18
I have been trying to scrape data off a dynamic web page the relies on AJAX to load modals.

The links are structured hierarchically.

Abeg who is good with it?
Re: Please Who Here Is Good With Web Scraping (octoparse) ? by VinCheckr: 1:23pm On Apr 18
I am him
Re: Please Who Here Is Good With Web Scraping (octoparse) ? by Acheems: 1:42pm On Apr 18
99thEnemy:
I have been trying to scrape data off a dynamic web page the relies on AJAX to load modals.

The links are structured hierarchically.

Abeg who is good with it?
Hi, I'm proficient in this kind of task using Selenium. How can I contact you? Here is my email: acheems01@gmail.com
Re: Please Who Here Is Good With Web Scraping (octoparse) ? by 99thEnemy(m): 1:46pm On Apr 18
Acheems:

Hi, I'm proficient in this kind of task using Selenium. How can I contact you? Here is my email: acheems01@gmail.com

I just need someone to describe to me how to fix an issue I stumble upon in octoparse.

I want to setup workflow to loop through a hierarchical data in octoparse but I am not getting the results as expected.

the modals load dynamically using AJAX.

VinCheckr:
I am him

You got the idea?
Re: Please Who Here Is Good With Web Scraping (octoparse) ? by 99thEnemy(m): 2:09pm On Apr 18
Acheems:

Hi, I'm proficient in this kind of task using Selenium. How can I contact you? Here is my email: acheems01@gmail.com

Check your mail
Re: Please Who Here Is Good With Web Scraping (octoparse) ? by 100millionGoal: 9:07pm On Apr 24
Whatever automator you're using just make it scroll infinitely below.

Puppeteer offers this with their infinite scroll package

(1) (Reply)

Website And App. Developers In Lagos / #ideas 0004 - Virtual "Administrative" assistance Service For Small Businesses / Can This App Help Solve Police Brutality, Domestic/sexual Violence In Nigeria?

(Go Up)

Sections: politics (1) business autos (1) jobs (1) career education (1) romance computers phones travel sports fashion health
religion celebs tv-movies music-radio literature webmasters programming techmarket

Links: (1) (2) (3) (4) (5) (6) (7) (8) (9) (10)

Nairaland - Copyright © 2005 - 2024 Oluwaseun Osewa. All rights reserved. See How To Advertise. 10
Disclaimer: Every Nairaland member is solely responsible for anything that he/she posts or uploads on Nairaland.