How to Set up a Proxy in Octoparse

Comments: 0

Octoparse is an easy-to-use web scraping tool allowing you to build your own scraper, no coding required.

Octoparse can assist by bypassing the majority of anti-scraping technologies. This is done by extending wait times, automatically switching the browser, and more. In some cases, an IP proxy network is still required.

If you've run into any of the issues below, you may want to try setting up IP proxies manually in Octoparse:

  • Unable to log into Octotoparse because your company or institution uses intranet and restricts external requests
  • The target website is very sensitive to web scraping and implements anti-scraping strategies such as IP blocking to stop scraping activities

In this tutorial, we are going to show you how to set up proxies to resolve the issues mentioned above.

There are 2 ways to do so -

  1. Use proxy to login Octoparse
  2. Rotate external proxy servers to counteract IP blocking
  1. Use proxy to login Octoparse

    • Click the settings icon on the login panel

    • Enter proxy information as required

    • You can Test to see if the connection is good, and then Confirm the setup
  2. Rotate external proxy servers to counteract IP blocking (Local only)

    If a website blocks your IP or our Cloud, you can set up an IP proxy in the task settings. The IP proxy will work for local extraction.

    • Open the task you would like to set up proxies for
    • Click the settings icon on the top left

    • Tick the Use IP Proxies box and go to Settings
    • Note that Octoparse only supports HTTP proxies - please separate the IP address of the proxy server and port number with a colon. e.g. 58.22.214.29:2318 then Confirm your setup
    • If you have a private proxy from Proxy-seller, then you automatically have a username and password for proxies. This data should go after the IP address and port separated by “:”. E.g. 58.22.214.29:2318:username:password.

Conclusion

Octoparse enables all people who are in need of massive data to meet their goals and get rid of the time-consuming copy-and-paste work. Using proxies from Proxy-Seller you will get the maximum potential of the powerful tool.

Was this article useful? Share it to your friends:

Comments:

0 Comments