The latest guides, research, and updates from the Proxidize team.
Zeid Abughazaleh on Oct 30, 2026Use a proxy in Node.js through an Undici `ProxyAgent`, an Axios `proxy` object, or `undici.request()` with a dispatcher. Keep credentials outside source code, set a timeout, and validate the returned data. Test the observed exit IP before running the client against its intended destination.
Stay in the loop
Subscribe for the latest news & updates.
Zeid Abughazaleh on Sep 13, 2024There are many languages and libraries available to perform a web scraping project however, if you wish to perform a large-scale project, then using Scrapy web scraping could be the best choice. It is a library designed specifically to handle large-scale scraping projects due to its easy accessibility and extendable framework. This article aims to explain what Scrapy is, and provide a breakdown of how to use it with a step-by-step Scrapy tutorial. Finally, it will include some advanced Scrapy techniques and offer tips and tricks on perfecting your techniques.
Read postZeid Abughazaleh on Aug 30, 2024If you have explored guides on web scraping, you have most likely come across the term headless browser. What does that mean exactly? In the simplest of terms, a headless browser is a browser without a graphical user interface (GUI). It is a tool that will act as a browser but does not give you access to view it. This article will explain what a headless browser is, the different types available, what it is used for, what is meant by headless browser testing, and the advantages and disadvantages of using one for your projects.
Read postZeid Abughazaleh on Aug 23, 2024Gaining an advantage over your competition can be tricky for businesses. However, there is a way to stay on top and it is by using pricing intelligence. Regardless of size, there are far too many factors to consider when trying to stay on top. Even if a company assumes it is unstoppable, it can never predict when a new competitor will jump in and rise above the ranks due to its advanced services or cheaper prices.
Read postZeid Abughazaleh on Aug 16, 2024Web scraping with JavaScript can be as small as one fetch() call and a Cheerio parser, or as involved as a browser crawler with queues, sessions, retries, and proxy routing. The correct method depends on where the data exists—not simply on whether the website uses JavaScript.
Read postZeid Abughazaleh on Aug 2, 2024TL;DR: Parsing HTML with Python and PyQuery uses lxml through a familiar jQuery-style interface.
Read postZeid Abughazaleh on Jul 26, 2024You cannot browse the public web without a network address somewhere in the connection. You can, however, route traffic through an intermediary so the destination sees that intermediary's public exit IP instead of the public IP assigned to your home, office, or mobile connection.
Read post
Yazan Sharawi on Jul 19, 2024Use Selenium for web scraping when required data appears after JavaScript, scrolling, clicking, or browser state changes. Launch WebDriver, wait for specific elements, extract validated fields, and save evidence when a page fails. Add a proxy when the workflow needs another location, route distribution, or a stable session.
Read postZeid Abughazaleh on Jul 12, 2024You should avoid an unfamiliar free virtual private network (VPN) when its owner, funding, logging, or security practices are unclear. A VPN handles selected traffic leaving your device, so leaks or intrusive data collection can undermine its purpose. A restricted free plan from an accountable provider may be acceptable after careful review.
Read post
Abed Elez on Jul 5, 2024Browser fingerprinting identifies a browser by combining device, browser, network, and behavior signals.
Read postZeid Abughazaleh on Jun 28, 2024CAPTCHA challenges are no longer limited to visible checkboxes or image grids. Many systems assess the browser, network, and session before deciding whether to present a task. Other CAPTCHA systems work in the background and return a risk score that the website uses when accepting a request or asking for further verification.
Read postReady to launch?
For teams that depend on stability, not luck.
