Search and sort by tags

[e-drazich-taylor]

Hi, I'm trying to implement to following:
Taking notes in zotero, with with nested tags (delimiter /) using betternotes and ethereal plugins.
Importing notes to obsidian with tags in the YAML headers
I would like to then have a nice dataview page that lets me filter by multiple tags (for example Disease/AD, Stage/Symptomatic), and then can also rank sort by different criteria (for example, sort by Modality/, then sort by Methods/, which would sort alphabetically by all the subtags within the Modality tag, then do the same for the Methods tag).
Here's what I have so far, but it just gives a blank dataview, despite there being data it should be able to utilise:

// Define the tags to filter for
const filterTags = ["Disease/AD", "Disease/Stage/Symptomatic"]; // Replace with your desired tags

// Fetch pages from the specified folder
const pages = dv.pages('"PhD Writing/LiteratureNotes/LitNotes"')
    // Filter pages that contain ALL the filterTags
    .where(p => {
        let content = p.file.content || "";
        let tagsMatch = content.match(/tags:\s*(\[[^\]]*?\]|((\n\s*- .*)+))/);
        let tags = [];

        if (tagsMatch) {
            if (tagsMatch[1].startsWith("[")) {
                // Inline tags format
                tags = tagsMatch[1]
                    .slice(1, -1) // Remove square brackets
                    .split(',')
                    .map(tag => tag.trim());
            } else {
                // Multi-line tags format
                tags = tagsMatch[1]
                    .split('\n')
                    .map(line => line.replace(/^-/, '').trim());
            }
        }

        // Check if the page contains ALL the filterTags
        return filterTags.every(filterTag => {
            return tags.some(tag => {
                // Match the full tag or nested parts
                return tag === filterTag || filterTag.startsWith(tag + "/");
            });
        });
    })
    // Sort pages by the first nested tag alphabetically
    .sort(p => {
        let content = p.file.content || "";
        let tagsMatch = content.match(/tags:\s*(\[[^\]]*?\]|((\n\s*- .*)+))/);
        let tags = [];

        if (tagsMatch) {
            if (tagsMatch[1].startsWith("[")) {
                // Inline tags format
                tags = tagsMatch[1]
                    .slice(1, -1) // Remove square brackets
                    .split(',')
                    .map(tag => tag.trim());
            } else {
                // Multi-line tags format
                tags = tagsMatch[1]
                    .split('\n')
                    .map(line => line.replace(/^-/, '').trim());
            }
        }

        // Sort by the first level of nested tags
        return tags.length > 0 ? tags[0].split("/")[0] : ""; // Use the top-level tag
    }, 'asc'); // Change 'asc' to 'desc' for descending order

// Prepare data for the table
let data = [];

for (let p of pages) {
    let content = await dv.io.load(p.file.path);

    // Extract "Prose:" and everything after it, while removing leading ** if present
    let proseMatch = content.match(/Prose:\s*\**([\s\S]*)/);
    let prose = proseMatch 
        ? proseMatch[1].trim()  // Remove leading/trailing whitespace
        : "No prose found";

    // Extract tags from the YAML metadata section
    let tagsMatch = content.match(/tags:\s*(\[[^\]]*?\]|((\n\s*- .*)+))/);
    let tags = "No tags found";

    if (tagsMatch) {
        if (tagsMatch[1].startsWith("[")) {
            // Inline tags format e.g., tags: [tag1, tag2]
            tags = tagsMatch[1]
                .slice(1, -1) // Remove the square brackets
                .split(',')
                .map(tag => tag.trim())
                .filter(tag => tag) // Remove empty tags
                .join(', ');
        } else {
            // Multi-line tags format e.g.,
            // tags:
            //   - tag1
            //   - tag2
            tags = tagsMatch[1]
                .split('\n')
                .map(line => line.replace(/^-/, '').trim()) // Remove leading dashes and trim
                .filter(tag => tag) // Remove empty lines
                .join(', ');
        }
    }

    // Add the data for the table
    data.push([p.file.name, prose, tags]);
}

// Render the table
dv.table(["Title", "Prose", "Tags"], data);

Any help would be really appreciated! Thanks in advance!

[ganesshkumar]

Have you looked into econtains?

TABLE file.name AS "Title", modality, methods
FROM "PhD Writing/LiteratureNotes/LitNotes"
WHERE
  econtains(file.etags, "Disease/AD") OR
  econtains(file.etags, "Stage/Symptomatic")
FLATTEN filter(file.etags, (t) => startswith(t, "Modality/")) AS modality
FLATTEN filter(file.etags, (t) => startswith(t, "Methods/")) AS methods
SORT modality ASC, methods ASC