You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
That code is actually not from the SDK, it's from the generic scrapers. The SDK does not handle proxy rotation, its crawlee that does it, SDK only allows you to use the apify proxy (which is basically a proxy on top of our proxy providers).
Activity
janbuchar commentedon Apr 16, 2024
vdusek commentedon Apr 23, 2024
Check the ProxyRotation in the Apify JS SDK:
based on this setting we should operate with
SessionPoolfrom theBasicCrawler.Edit: Actor settings is mapped to the Crawler options (crawler_setup.ts#L37)
B4nan commentedon Apr 23, 2024
That code is actually not from the SDK, it's from the generic scrapers. The SDK does not handle proxy rotation, its crawlee that does it, SDK only allows you to use the apify proxy (which is basically a proxy on top of our proxy providers).
feat: use SessionPool in BasicCrawler (#128)