How To Launch Scraper Using algoQA And Scrape the UI elements

Modified on Tue, 7 Oct at 4:16 PM

TABLE OF CONTENTS

1. Overview 

2. How to Launch Scraper for Web Automation

3. How to Launch Scraper for Mobile Automation

4. How to Launch Scraper in Upload Scraped Data and Re-Scrape for Web Automation

5. How to Launch Scraper in Upload Scraped Data and Re-Scrape for Mobile Automation


1. Overview 

This article provides detailed instructions on how to launch a scraper from the Create Project page, scrape UI elements, and navigate back to the Create Project page.
Note: This feature is currently available only for Web and Mobile automation.

2. How to Launch Scraper for Web Automation

Navigate to the Projects page and click the ‘+’ icon to create a new project. Select Web Automation as the automation type, enter the target URL in the Application URL field, and click Launch.



Note: If you don’t have the algoScraper extension installed, a pop-up will appear prompting you to download the scraper. 


The web page will open with the scraper enabled. You can use the scraper to capture UI elements. , click here to know more about Scarping Web applications. After scraping the UI elements, click the algoQA button to navigate back to the Create Project page, with the scraped file automatically attached.


Enter the project name and click on create, for the project to be created.



3. How to Launch Scraper for Mobile Automation

  • For M-Site

Navigate to the Projects page and click the ‘+’ icon to create a new project. Select Mobile Automation as the automation type, check the M-Site checkbox, enter the target URL in the Application URL field, and click Launch. 



Note: If the algoScraper extension is not installed or is not the latest version, a pop-up will appear prompting you to download or update the scraper.

Application of the provided URL will be opened with the popup saying how to scrape M-Site. , Click on this link to know more about scraping M-Site applications.

After scraping the UI elements click algoQA button to navigate back to Create Project Page, with the scraped file automatically attached.

Enter the project name and click on create, for the project to be created.



  • For M-App
  1. Navigate to the Projects page and click the ‘+’ icon to create a new project. Select Mobile Automation as the automation type, check the M-App checkbox, and click Launch.


    Note: The Real device/Emulator should be connected to the system before launch.




  2. When you launch the scraper, if a device is connected, the device name and UDID will be fetched automatically. You have to manually enter the App Package and App Activity, then click Launch Application to start the app. Once the application is launched, enter the Screen Name and click Load Page to make the screen available for scraping.

  3. You can either scrape UI elements individually or click Scrape UI to capture all UI elements at once.
  4. Click the algoQA button to navigate back to the Create Project page with scraped file. 
  5. You can also open the scraper directly from your local system. Copy the access token from the Create Project page and paste it into the Paste Your Token Here field to connect with algoQA. Then, repeat steps 2, 3, and 4. 




4. How to Launch Scraper in Upload Scraped Data and Re-Scrape for Web Automation

Navigate to the Projects and select a existing web project, you'll be directed to Canvas, click on more dropdown and Upload Scraped Data.
Enter the target URL in the Application URL field, and click Launch. 


Note: If you don’t have the algoScraper extension installed, a pop-up will appear prompting you to download the scraper. 

The web page will open with the scraper enabled. You can use the scraper to capture UI elements. , click here to know more about Scarping Web applications. After scraping the UI elements, click the algoQA button to navigate back to the Upload Scraped Data page, with the scraped file automatically attached, select Replace Existing Configuration checkbox if you want replace the configuration and click on Upload Now, the nodes will be created in canvas.

5. How to Launch Scraper in Upload Scraped Data and Re-Scrape for Mobile Automation



Navigate to the Projects and select a existing Mobile automation project, you'll be directed to Canvas, click on more dropdown and Upload Scraped Data.

  • For M-Site

Select M-Site Checkbox, Enter the target URL in the Application URL field, and click Launch.
Note: If the algoScraper extension is not installed or is not the latest version, a pop-up will appear prompting you to download or update the scraper.

Application of the provided URL will be opened with the popup saying how to scrape M-Site. , Click on this link to know more about scraping M-Site applications.

After scraping the UI elements click algoQA button to navigate back to Upload Scraped Data Page, with the scraped file automatically attached.


Select Replace Existing Configuration checkbox if you want replace the configuration and click on Upload Now, the nodes will be created in canvas.

  • For M-App

Select M-App Checkbox and click Launch
Note: The Real device/Emulator should be connected to the system before launch.

When you launch the scraper, if a device is connected, the device name and UDID will be fetched automatically. You have to manually enter the App Package and App Activity, then click Launch Application to start the app. Once the application is launched, enter the Screen Name and click Load Page to make the screen available for scraping.

You can either scrape UI elements individually or click Scrape UI to capture all UI elements at once.

Click the algoQA button to navigate back to the Upload Scraped Data page with scraped file. 

You can also open the scraper directly from your local system. Copy the access token from the Create Project page and paste it into the Paste Your Token Here field to connect with algoQA. Then, follow same process to scrape.
Select Replace Existing Configuration checkbox if you want replace the configuration and click on Upload Now, the nodes will be created in canvas.

Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select at least one of the reasons
CAPTCHA verification is required.

Feedback sent

We appreciate your effort and will try to fix the article