You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
crawlee-python is great but often lacks stealth against modern anti-bot measures when using vanilla playwright. Camoufox is fully compatible with playwright, only have to change browser initialization. It bypasses all currently available anti-bot measures. It would be a great opportunity to make crawlee-python playwright stealthy.
It will take me more time to polish it merge to master. Word of warning: When you run camoufox it will download latest release which is almost 700MB large!
Activity
janbuchar commentedon Nov 12, 2024
Hello @Ehsan-U, thank you for the suggestion, we will consider it!
[-]Camoufox Integration[/-][+]Integrate Camoufox into PlaywrightCrawler[/+]Pijukatel commentedon Dec 4, 2024
Hi, I looked into how much effort it will be and seems like it will work almost out of the box.
If you want to try it asap, then you can check this branch:
https://github.com/apify/crawlee-python/tree/camoufox
If you run this playwright_crawler_example from that branch, then it will use camoufox.
It will take me more time to polish it merge to master. Word of warning: When you run camoufox it will download latest release which is almost 700MB large!
Pijukatel commentedon Dec 6, 2024
I tried two approaches:
Tight integration into crawlee:
#782
Pros:
Cons:
No integration, but creating example code that shows how to do it with current codebase:
#789
Pros:
Cons
feat: Add example of how to integrate Camoufox into PlaywrightCrawler (…
MarhyCZ commentedon Jan 8, 2025
murilomulato commentedon Aug 22, 2025
Hey @Ehsan-U I wanted to look into scrapy-camoufox. Have you taken the repo offline?