Skip to content
This repository was archived by the owner on Oct 13, 2025. It is now read-only.
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
d907d53
chore: update .gitignore and add conda setup instructions
dermatologist Apr 30, 2025
3238e5d
feat: implement neural network model using PyTorch and update tests f…
dermatologist Apr 30, 2025
7ea669e
chore: update pyproject.toml and setup.cfg to organize dependencies a…
dermatologist Apr 30, 2025
0ada4d6
chore: update conda.md to simplify package installation command
dermatologist Apr 30, 2025
6f0fe38
feat: enhance ReadData class to support reading from URLs and folders…
dermatologist Apr 30, 2025
da92557
feat: update ReadData class to handle URL input by storing content an…
dermatologist Apr 30, 2025
9e2d7fb
feat: add ClusterDocs class for semantic clustering and update tests …
dermatologist Apr 30, 2025
829214c
feat: enhance ClusterDocs class with num_topics and passes properties…
dermatologist Apr 30, 2025
03def28
feat: add format_topics_sentences method to ClusterDocs for topic for…
dermatologist Apr 30, 2025
1fba657
feat: add most_representative_docs method to ClusterDocs for retrievi…
dermatologist Apr 30, 2025
8402717
feat: add seaborn to dependencies and create visualize.py for data vi…
dermatologist Apr 30, 2025
d3f41bf
feat: enhance QRVisualize class with frequency distribution plotting …
dermatologist Apr 30, 2025
38a8481
feat: update QRVisualize constructor to accept optional DataFrame and…
dermatologist Apr 30, 2025
60572ef
feat: add plot_distribution_by_topic method to QRVisualize for visual…
dermatologist Apr 30, 2025
4d30f7c
feat: add wordcloud to dependencies for enhanced visualization capabi…
dermatologist Apr 30, 2025
28ee69b
feat: refactor build_lda_model method to return topics and improve lo…
dermatologist Apr 30, 2025
643d469
feat: add plot_wordcloud method to QRVisualize for visualizing topics…
dermatologist Apr 30, 2025
bb56996
feat: update plot_wordcloud method parameters for improved visualizat…
dermatologist Apr 30, 2025
fc49b94
feat: add processed_docs property and topics_per_document method to C…
dermatologist Apr 30, 2025
ddc6b96
feat: add copyright notice and improve code formatting in cluster and…
dermatologist Apr 30, 2025
16c2af0
chore: update dependencies in requirements and dev-requirements files…
dermatologist Apr 30, 2025
bd7e454
Update pr.yml
dermatologist May 1, 2025
20d44cb
fix: specify exact torch version and remove deprecated setup.cfg; upd…
dermatologist May 1, 2025
2c6c174
Update pr.yml
dermatologist May 1, 2025
a551f36
fix: update python_requires and add missing entry point for qrmine
dermatologist May 1, 2025
3efce4f
fix: update entry point syntax for qrmine in pyproject.toml
dermatologist May 1, 2025
dd03622
fix: correct entry point syntax for console_scripts in pyproject.toml
dermatologist May 1, 2025
2081eea
fix: remove incorrect console_scripts entry from pyproject.toml
dermatologist May 1, 2025
d4f3553
fix: correct key name for Python version requirement in pyproject.toml
dermatologist May 1, 2025
b569231
Update pr.yml
dermatologist May 1, 2025
97c80d9
fix: add missing dependencies for build system in pyproject.toml
dermatologist May 1, 2025
8100027
Update pr.yml
dermatologist May 1, 2025
7eb9df2
Update pr.yml
dermatologist May 1, 2025
3965bb3
Update pr.yml
dermatologist May 1, 2025
b811c6a
refactor: remove unnecessary folder_path arguments from visualization…
dermatologist May 1, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
26 changes: 13 additions & 13 deletions .github/workflows/pr.yml
Original file line number Diff line number Diff line change
Expand Up @@ -13,27 +13,27 @@ jobs:
strategy:
max-parallel: 4
matrix:
python-version: ["3.11"]
os: [ubuntu-latest, macos-13, windows-latest]
runs-on: ${{ matrix.os }}
timeout-minutes: 20
steps:
- uses: actions/checkout@v4
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v4
- name: Install uv
uses: astral-sh/setup-uv@v5
with:
python-version: ${{ matrix.python-version }}
cache: 'pip' # caching pip dependencies
enable-cache: true
- name: "Set up Python"
uses: actions/setup-python@v5
with:
python-version-file: "pyproject.toml"
- name: run on mac
if: startsWith(matrix.os, 'mac')
run: |
brew install libomp
- name: Install dependencies
run: |
python -m pip install --upgrade pip
pip install -r requirements.txt
python -m spacy download en_core_web_sm
- name: Test with pytest
- name: Install the project
run: |
pip install pytest
pytest
uv sync --all-extras --dev
uv pip install pip
uv run python -m spacy download en_core_web_sm
- name: Run tests
run: uv run pytest tests
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,7 @@ __pycache__/*
.idea
.venv
conda
uv.lock

# Package files
*.egg
Expand Down
11 changes: 0 additions & 11 deletions dev-requirements.in

This file was deleted.

146 changes: 0 additions & 146 deletions dev-requirements.txt

This file was deleted.

12 changes: 12 additions & 0 deletions notes/conda.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
conda create --name qrmine python=3.11
conda activate qrmine

conda install conda-forge::uv
uv pip install ini2toml
ini2toml setup.cfg -o pyproject.toml
uv pip install -e .
python -m spacy download en_core_web_sm



pip3 install torch==2.3.1+cpu -f https://download.pytorch.org/whl/torch_stable.html
34 changes: 34 additions & 0 deletions notes/new-process.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
conda install conda-forge::uv
uv pip install ini2toml
ini2toml setup.cfg -o pyproject.toml

delete setup.cpg
delete requirements.txt, dev-requirements.txt, dev-requirements.in
remove deps from tox.ini

uv pip install -e .
see pr.yml for GitHub actions
see pyproject.toml for pytorch cpu install
uv pip install -e .

uv sync --all-extras --dev
uv pip install pip
uv run python -m spacy download en_core_web_sm

pyproject.toml
requires = ["setuptools>=61.2", "wheel", "pip"]

dev = [
"setuptools",
"setuptools_scm",
"pytest",
"pytest-cov",
"tox",
"black",
"recommonmark",
"sphinx",
"wheel",
"twine",
"tox",
]

5 changes: 4 additions & 1 deletion notes/pip-tools.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,4 +21,7 @@ OR

* pip install uv
* uv pip compile setup.cfg -o requirements.txt --universal
* uv pip compile dev-requirements.in -o dev-requirements.txt --universal
* uv pip compile dev-requirements.in -o dev-requirements.txt --universal

uv pip install ini2toml
ini2toml setup.cfg -o pyproject.toml
Loading
Loading