Replies: 2 comments
-
What crawler are you using? Have you tried v3.3.0? |
Beta Was this translation helpful? Give feedback.
0 replies
-
I haven't had time to try 3.3 yet. I'm using const links = catLinks.map((link) => {
return `${domain}${link}`;
}); And then added those links to |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Hello,
when adding a a list of relative urls to enqueueLinks, these urls aren't added and
crawlee
notifies that there is no longer any request pending and finishes:The list of relative urls looks like this:
In earlier versions of
crawlee 3.0
, this code worked, but now it doesn't. I noticed the changes inenqueueLinks
in later versions, specially those related tostrategy
, but those changes aren't related to the case when one passes a list of urls toenqueueLinks
, at least that's what I'm getting from reading the documentation/changelog.When i convert my list of relative urls to full urls, the code works as expected, but given that this wasn't necessary in previous versions, i was wondering if i should expect
crawlee
to convert these urls adding the domain by itself.I'm using
crawlee 3.2.2
Beta Was this translation helpful? Give feedback.
All reactions