Skip to content

Consider switching over the Regex calculations (or any other CPU intensive tasks) to worker threads #5

@JaneJeon

Description

@JaneJeon

https://nodejs.org/api/worker_threads.html

But first, we need to bench & profile our existing code to make sure we're not prematurely optimizing, and to figure out what other parts block the loop with intensive computation.

For now, the two obvious culprits look to be the numerous regex matches on strip-trackers, and the parsing & matching of HTML in cheerio in canonicization. Both are currently heavily cached.

Metadata

Metadata

Assignees

No one assigned

    Labels

    help wantedExtra attention is needed

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions