Skip to content

add support for Parsel #335

Closed
Closed

Description

@Ehsan-U

BeautifulSoup lacks proper type hints, mostly Any type, hence not effective IDE autocompletion. A solid alternative is Parsel. It supports CSS selectors, XPath expressions for HTML and XML, JMESPath for JSON documents, and Regex expressions. Additionally, Parsel is the parser used by Scrapy.

Activity

  1. siddiqkaithodu commented on Jul 21, 2024

    @siddiqkaithodu
    Contributor

    I was thinking about selectolax

  2. Ehsan-U commented on Jul 21, 2024

    @Ehsan-U
    Author

    selectolax doesn't support XPATH selector nor JMESPath for JSON.

  3. added
    t-toolingIssues with this label are in the ownership of the tooling team.
    enhancementNew feature or request.
    on Jul 22, 2024
  4. janbuchar commented on Jul 22, 2024

    @janbuchar
    Collaborator

    We started out with BeautifulSoup because of its popularity, but you're right that it has its shortcomings. Adding support for either selectolax or parsel as a new crawler type should be fairly easy - we'll consider it.

  5. asymness commented on Jul 22, 2024

    @asymness
    Contributor

    +1 for Parsel

  6. asymness commented on Jul 22, 2024

    @asymness
    Contributor

    @janbuchar, I'd like to help out by adding Parsel support as a new crawler type. Would you be open to a PR from me for this?

  7. janbuchar commented on Jul 22, 2024

    @janbuchar
    Collaborator

    @janbuchar, I'd like to help out by adding Parsel support as a new crawler type. Would you be open to a PR from me for this?

    Absolutely 🙂

  8. added a commit that references this issue on Aug 7, 2024
    a3832e5
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request.t-toolingIssues with this label are in the ownership of the tooling team.

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions