Skip to content

feat: add sitemap loader to admin frontend #21

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 31 commits into from
Jun 16, 2025

Conversation

a-klos
Copy link
Member

@a-klos a-klos commented Jun 5, 2025

This pull request introduces the ability to upload and process content from sitemaps in the admin application. It includes updates to the DocumentAPI, the Vuex store, and the frontend components to support sitemap configuration, error handling, and user interface changes.

Backend Changes:

  • Added SitemapConfig interface: Defined a new configuration interface for sitemaps, including fields for webPath, filterUrls, headerTemplate, and name. (frontend/libs/admin-app/data-access/document.api.ts, frontend/libs/admin-app/data-access/document.api.tsR19-R26)
  • Implemented loadSitemap method in DocumentAPI: Added logic to process sitemap configurations, validate inputs, and send a request to the backend. Includes error handling for invalid JSON and missing parameters. (frontend/libs/admin-app/data-access/document.api.ts, frontend/libs/admin-app/data-access/document.api.tsR73-R112)

Store Updates:

  • Updated useDocumentsStore: Added isLoadingSitemap state, loadSitemap method, and included loadSitemap in the returned store object. (frontend/libs/admin-app/data-access/+state/documents.store.ts, [1] [2] [3]

Frontend Enhancements:

Localization Updates:

  • Added sitemap-related translations: Included new keys for sitemap upload, error messages, and descriptions in the English localization file. (frontend/libs/i18n/admin/en.json, [1] [2]

Submodule Update:

  • Updated rag-core-library submodule: Advanced the submodule to a newer commit. (rag-core-library, rag-core-libraryL1-R1)

a-klos and others added 25 commits May 23, 2025 14:36
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
…nce configuration from DocumentUploadContainer, and update subproject reference in rag-core-library
- Added `fake-useragent` version 2.2.0 to `document-extractor/poetry.lock`.
- Introduced `googleapis-common-protos` version 1.70.0 and updated dependencies in `rag-backend/poetry.lock`.
- Added `importlib-metadata` version 8.7.0 with dependencies in `rag-backend/poetry.lock`.
- Updated `langfuse` to version 3.0.0 in `rag-backend/poetry.lock` and adjusted its dependencies.
- Added OpenTelemetry packages (`opentelemetry-api`, `opentelemetry-exporter-otlp`, `opentelemetry-sdk`, etc.) with version 1.34.1 in `rag-backend/poetry.lock`.
- Downgraded `protobuf` to version 5.29.5 in `rag-backend/poetry.lock`.
- Added `zipp` version 3.23.0 in `rag-backend/poetry.lock`.
- Updated submodules for `rag-core-library` and `rag-infrastructure`.
…itcloud/rag-template into chore/adminfrontend-sitemap-loader
@a-klos a-klos marked this pull request as ready for review June 13, 2025 09:53
@a-klos a-klos requested a review from Copilot June 13, 2025 09:55
Copilot

This comment was marked as outdated.

a-klos and others added 2 commits June 13, 2025 11:58
…er.vue

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
@a-klos a-klos requested a review from Copilot June 13, 2025 09:59
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This pull request introduces a sitemap loader feature into the admin frontend. The main changes include:

  • Backend support: Adding a new SitemapConfig interface and implementing a loadSitemap method in DocumentAPI.
  • Frontend enhancements: Extending DocumentUploadContainer.vue to handle sitemap uploads and updating error handling for sitemap operations.
  • Store updates: Adding isLoadingSitemap state and a loadSitemap method to the Vuex store for sitemap actions.

Reviewed Changes

Copilot reviewed 10 out of 10 changed files in this pull request and generated no comments.

Show a summary per file
File Description
rag-infrastructure Updated subproject commit for infrastructure.
rag-core-library Updated submodule commit for core library.
frontend/libs/i18n/admin/en.json Added new localization keys for sitemap.
frontend/libs/admin-app/feature-document/DocumentUploadContainer.vue Added sitemap-specific refs, UI tab, and upload handler.
frontend/libs/admin-app/data-access/document.api.ts Added SitemapConfig interface and loadSitemap method with JSON validation.
frontend/libs/admin-app/data-access/+state/documents.store.ts Added isLoadingSitemap state and loadSitemap store method.

huhn511
huhn511 previously approved these changes Jun 16, 2025
Copy link
Collaborator

@huhn511 huhn511 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 👍

@a-klos a-klos requested a review from huhn511 June 16, 2025 08:53
@a-klos a-klos merged commit 02036cf into main Jun 16, 2025
5 checks passed
@a-klos a-klos deleted the chore/adminfrontend-sitemap-loader branch June 16, 2025 09:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants