Here I study various aspects of existing evasion techniques to get around anti-bot systems. β-s are appreciated. Looking for help with bypassing one?
- Cap FPS for Chromium with software rendering --use-gl=swiftshader - Limit CPU usage from SwiftShader by redraw freq. of Chromium in AVD
- Unlike some public comments on that matter chrome devtools protocol actually works on AVD-s with puppeteer
βοΈ Win / β Fail / π Tie :
- π p0f - detect host OS from TCP struct - Not possible to fix via Puppeteer APIs. Used in Akamai Bot Manager to match against JS and browser headers (Client Hints and
User-Agent
). There is a detailed explaination of the issue. The most reliable evasion seems to be not spoofing host OS at all, or using OSfooler-ng. - π Browser dimensions - Although stealth plugin provides
window.outerdimensions
evasion, it won't work without correct config on non-default OS in headless mode; almost always fails whenviewport size >= screen resolution
(low screen resolution display on the host). - β core-estimator - This can detect mismatch between navigator.hardwareConcurrency and SW/WW execution profile. Not possible to limit/bump the
ServiceWorker
/WebWorker
thread limit via existng Puppeteer APIs. - β WebGL extensions profiling - desc. tbd
- β RTCPeerConnection when behind a proxy - Applies to both SOCKS and HTTP(S) proxies.
- β Performance.now - desc. tbd (red pill)
- β WebGL profiling - desc. tbd
- β Client Hints - desc. tbd
- β Behavior Detection - desc. tbd (events, params, ML+AI buzz)
- β Font fingerprinting - desc. tbd (list+version+renderer via HTML&canvas)
- β Network Latency - desc. tbd (integrity check: proxy det., JS networkinfo, dns resolv profiling&timing)
- β Battery API - desc. tbd
- β Gyroscope and other (mostly mobile) device sensors - desc. tbd
Multilogin, Kameleo, copycats and others
tbd (if you have an active subscription in any of these services and don't mind sharing an account drop me an email β€οΈ)
If you have problems with scraping specific website, write me a short email at [email protected]
. I can help you with any anti-bot detection issue (not only the ones from the list above) and have a dedicated tΓͺte-Γ -tΓͺte consultation via Skype π.
Leave β and a tip β‘οΈ Ethereum address 0x380a4b41fB5e0e1EB8c616eBD56f62f8F934Bab6