Skip to content

Commit cf1630c

Browse files
DevAloneDevAlone
committed
some refactoring of collectors, better regex for proxy validation, first test
1 parent ed104a3 commit cf1630c

33 files changed

+213
-157
lines changed

‎.gitignore

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,3 +10,4 @@ proxy_py.egg-info
1010
proxypy.egg-info/
1111
build/
1212
local/
13+
.pytest_cache

‎collectors/__init__.py

Whitespace-only changes.

‎collectors/checkerproxy_net/__init__.py

Whitespace-only changes.

‎collectors/checkerproxy_net/collector_checkerproxy_net_today.py

Lines changed: 0 additions & 22 deletions
This file was deleted.

‎collectors/collector.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9,6 +9,9 @@
99
class AbstractCollector:
1010
"""Base class for all types of collectors"""
1111

12+
__collector__ = False
13+
"""Set this variable to True in your collector's implementation"""
14+
1215
async def collect(self):
1316
"""
1417
This method should return proxies in any of the following formats:

‎collectors/free_proxy_list_net/__init__.py

Whitespace-only changes.

‎collectors/free_proxy_list_net/base_collector_free_proxy_list_net.py

Lines changed: 0 additions & 29 deletions
This file was deleted.

‎collectors/free_proxy_list_net/collector_free_proxy_list_net.py

Lines changed: 0 additions & 8 deletions
This file was deleted.

‎collectors/free_proxy_list_net/collector_free_proxy_list_net_anonymous_proxy.py

Lines changed: 0 additions & 8 deletions
This file was deleted.

‎collectors/free_proxy_list_net/collector_free_proxy_list_net_uk_proxy.py

Lines changed: 0 additions & 8 deletions
This file was deleted.

0 commit comments

Comments
 (0)