Man illustrationFlower illustration

Docy

Scrape data

Estimated reading: 3 minutes 83 views

Scrape data activity allows receiving data in bulk via browser or application.


*Application nameReference name of application which will be opened.
*Scraper nameIt is the name of the dataset where the retrieved data will be store. The data brought by the scrap method is actually kept in a dataset.
*TableThe areas to be scrapped on the web page or application are included in a table. Location (Xpath) information showing this field is written.
HeaderThe header part of XPath in the desired table. If there is no header for the Table, this field should be left blank.
First record headerIf you want to point out the first record to be scraped as a title, the Checkbox should be selected.
*RowThe row part where the Xpath showing the entire row. Scraper evaluates row part of Xpaths.
*ColumnThe column part of XPath where the XPath showing column.
AdvertisementThe location (XPath) information of the advertisement button or pop-up (If any) seen on the page.
Wait (ms)The time required to wait during the scrap is specified in milliseconds.
Next pageThe location (Xpath) information of the next button of the table (If any) to be scraped.
Initial popup clickInitial pop click locator Xpath.
PopupIf there is a pop-up on the page, the location (Xpath) information of the close button is written.
Max countMaximum count of data to be scrapped.
Note: * Fields selected with are required, others are optional.

You can use the Application as shown in the example.

robustaWebpage

You can use the Scraper as shown in the example.

scrapTable

You can use the Table as shown in the example.

(//table[@class=”unitTable”])[1]

You can use the Header as shown in the example.

thead//tr//th

You can use the Row as shown in the example.

tbody//tr

You can use the Column as shown in the example.

td

You can use the Advertisement as shown in the example.

//*[@value=”Adv”]/[text()]

You can use the Wait (ms) as shown in the example.

3000

You can use the Next page as shown in the example.

//*[@value=”Next”]/[text()]

You can use the Initial popup click as shown in the example.

@class=’siebui-popup-button’]/*[@title=’Pick Address:New’

You can use the Popup as shown in the example.

@class=’siebui-popup-button’]/*[@title=’Pick Address:New’

You can use the Max count as shown in the example.

10

CONTENTS