algoScraper as an Extension Tool for Chrome or Edge Users

Modified on Wed, 17 Apr 2024 at 12:12 PM

Overview

The algoScraper tool, available as a Chrome extension, serves the purpose of capturing all User Interface (UI) elements and XPaths present on a web page.


Prerequisite 


To integrate this tool into your Chrome or Edge browser, Click here.  Select the  icon corresponding to the extension to view it on your browser bar, as shown:


Understanding Scraper Tool Window


Click the extension to view the following window


         Select the page you wish to scrape  and click Scrape UI button to view the following window    


Tool Functional Summary


FieldDescription
Displays the Page name URL
Click this button to scrape all the UI elements at once displayed on the particular page.

Note that when you scrape all the UI elements using this button, reset the page by clicking the Reset button, scrape the same page again, navigate to a different page, or refresh the page, UI elements will be captured and displayed in the table.

Reset window secondary window
Click this button to reset all the scraped UI elements listed in the table. 
Click this button to access more actions menu.
Edit URL secondary window
Rescrape -

When there is a change in the application under test, upload the previously downloaded CSV file that contains the details of the scraped elements.Rescrape the elements using this option and capture in the same CSV file.Download the updated CSV file after rescraping the elements.Upload the updated CSV file while profiling the application and generate test cases.



Settings - This option displays sub options: 
  • Customize Table -Select this option if you wish to select or unselect the listed items in a table.
  • Customize Control Type -Select this option if you wish to scrape particular category of UI element. This option is applicable only when using the 'Scrape UI' option. For example, if a webpage contains various types of UI elements and you wish to scrape only input fields, then you might use the Customize Control Type option.

Use Back button to go back to main window.  

Use refresh button to refresh the customized settings.

Edit URL - Select this option to change the URL if needed.

This is the only method available to modify the URL.



Hover over a specific XPath to verify it. This action highlights the corresponding UI element and displays the XPath count.
Select this button to add a new row to a scraped element table.
Select this button to download the scraped UI elements table in a CSV format spreadsheet.
Select this button if you wish to delete a particular row in a scraped UI element table. 


Scraping the Application Using algoScraper Tool

Perform the following:

  1. Open the application  and if you wish to scrape the entire page at one go, click the extension on your application described in the prerequisite to view the algoScraper window and click Scrape UI button. all the UI element details with corresponding XPath expression of the scraped UI page details will be listed.
  2. If you wish to scrape individual UI element, perform the following: 
    1. Navigate to particular UI element, right-click to capture the XPath expression of that UI element. The captured details are added to the scraped element table list.

    2. Common XPath refers to frequently used XPath expressions that are used to locate elements.
      If you wish to capture Common XPath expression, perform the following:
      Navigate to the particular category on a webpage, right-click the category to view the following screen which displays the Common XPath.


      When do we use common XPath expression.
      Common XPaths can be used across different web pages or applications to locate similar types of elements, such as buttons, input fields, or links.

    3. After scraping UI elements, download the file in CSV format. Upon successful download, a "File downloaded successfully" message is displayed, and click  to the close Scraper window.



Related Articles 









Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select atleast one of the reasons
CAPTCHA verification is required.

Feedback sent

We appreciate your effort and will try to fix the article