sCCraper IT is a Python-based tool designed to automate the download of all the available CTF challenges, including their metadata and attached files, via the platform APIs. It organizes the retrieved content into a structured, easy-to-navigate folder hierarchy.
This tool was designed to work with these platforms:
Note
Access to the above platforms is required. sCCraper IT uses your platform credentials to authenticate and retrieve challenge data.
- Login with API token via email/password
- Fetches all challenges in the selected platform
- Downloads all attached files
- Automatically downloads hints (if user is a
SUPERVISOR
) - Saves everything in a clean folder structure
Clone the repository with:
git clone https://github.com/CreepyMemes/sCCraper-IT.git && cd sCCraper-IT
Make a new .env
file in root directory, and enter your credentials there, follow the example at .env.example
:
# Switch Platform
BASE_URL=https://ctf.cyberchallenge.it
# BASE_URL=https://training.olicyber.it
# Credentials
EMAIL=your@email.com
PASSWORD=your-password
pip install -r requirements.txt
python -m src.main
After execution, you’ll find the output folder data/
generated in the root directory, with the following structure:
data/
├── challenges.json # Metadata of all challenges
├── challenges/
│ ├── event/
│ │ ├── section/
│ │ │ ├── challenge/
│ │ │ │ ├── challenge.json # Challenge description
│ │ │ │ └── files/
│ │ │ │ ├── file # Attached file
...
- CLI support (e.g.
--email
,--save-to
) - Caching to avoid re-downloading
- Logging (instead of
print()
)