You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+11-4Lines changed: 11 additions & 4 deletions
Original file line number
Diff line number
Diff line change
@@ -134,6 +134,7 @@ x-crawl is an open source project under the MIT license, completely free to use.
134
134
-[Community](#community)
135
135
-[Issues](#issues)
136
136
-[Sponsor](#sponsor-1)
137
+
-[Special Instructions](#special-instructions)
137
138
138
139
## Install
139
140
@@ -938,7 +939,7 @@ const myXCrawl = xCrawl()
938
939
myXCrawl
939
940
.crawlPage({
940
941
url:'https://www.example.com',
941
-
proxy:'xxx',
942
+
proxy:{ urls: ['xxx'] },
942
943
maxRetry:1
943
944
})
944
945
.then((res) => {})
@@ -1089,7 +1090,7 @@ const myXCrawl = xCrawl()
1089
1090
myXCrawl
1090
1091
.crawlHTML({
1091
1092
url:'https://www.example.com',
1092
-
proxy:'xxx',
1093
+
proxy:{ urls: ['xxx'] },
1093
1094
maxRetry:1
1094
1095
})
1095
1096
.then((res) => {})
@@ -1246,7 +1247,7 @@ const myXCrawl = xCrawl()
1246
1247
myXCrawl
1247
1248
.crawlData({
1248
1249
url:'https://www.example.com/api',
1249
-
proxy:'xxx',
1250
+
proxy:{ urls: ['xxx'] },
1250
1251
maxRetry:1
1251
1252
})
1252
1253
.then((res) => {})
@@ -1385,7 +1386,7 @@ const myXCrawl = xCrawl()
1385
1386
myXCrawl
1386
1387
.crawlFile({
1387
1388
url:'https://www.example.com/file',
1388
-
proxy:'xxx',
1389
+
proxy:{ urls: ['xxx'] },
1389
1390
maxRetry:1,
1390
1391
storeDir:'./upload',
1391
1392
fileName:'xxx'
@@ -2042,10 +2043,16 @@ The crawlPage API has built-in [puppeteer](https://github.com/puppeteer/puppetee
2042
2043
2043
2044
- **GitHub Discussions:** Use [GitHub Discussions](https://github.com/coder-hxl/x-crawl/discussions) for message board-style questions and discussions.
2044
2045
2046
+
Questions and discussions related to illegal activities may not be submitted. x-crawl is for legal use only. It is prohibited to use this tool to conduct any illegal activities, including but not limited to unauthorized data collection, cyber attacks, privacy invasion, etc.
2047
+
2045
2048
### Issues
2046
2049
2047
2050
If you have questions, needs, or good suggestions, you can raise them at [GitHub Issues](https://github.com/coder-hxl/x-crawl/issues).
2048
2051
2049
2052
### Sponsor
2050
2053
2051
2054
x-crawl is an open source project under the MIT license, completely free to use. If you benefit from the projects I develop and maintain at work, please consider supporting my work through the [Afdian](https://afdian.net/a/coderhxl) platform.
2055
+
2056
+
### Special Instructions
2057
+
2058
+
x-crawl is for legal use only. It is prohibited to use this tool to conduct any illegal activities, including but not limited to unauthorized data collection, cyber attacks, privacy invasion, etc.
0 commit comments