collection specific fields size

[rere950303]

• milvus version: v2.4.20 cluster mode
• birdwatcher: v1.0.8

---

I would like to check the size of the vector field's HNSW index (dim 1024) and the text field (varchar 5000) for a specific collection.

• For the vector field HNSW index size, can I refer to the Serialized Size shown in the result of the show segment-index query from birdwatcher?

Milvus(by-dev) > show segment-index
SegmentID: 456451272045388116    State: Flushed
        IndexV2 build ID: 456451272045643782, states Finished    Index Type:HNSW on Field ID: 101       Serialized Size: 531042048
        Current Index Version: 5
         Index Files: [HNSW_27 HNSW_28 HNSW_33 SLICE_META HNSW_10 HNSW_0 HNSW_2 HNSW_25 HNSW_3 HNSW_32 HNSW_1 HNSW_13 HNSW_7 HNSW_11 HNSW_12 HNSW_15 HNSW_16 HNSW_5 HNSW_6 HNSW_17 HNSW_18 HNSW_21 HNSW_29 HNSW_4 HNSW_9 HNSW_23 HNSW_26 HNSW_30 HNSW_31 HNSW_8 HNSW_14 HNSW_19 HNSW_20 HNSW_22 HNSW_24 HNSW_34]

[Finished]: 1

• Also, is there a way to check the total size of the text field using birdwatcher or metrics? Or do I need to estimate it based on the number of entity rows?

[yhmo]

In birdwatcher, use "show collections" to show collections to get their ID.
"show segment-index --collection=ID" to show index of a collection. You will see the index of both vector field and scalar field.

[yhmo]

I just discussed with the birdwatcher owner, you can use this command to get more details:

show segment --collection=ID  --format=table --detail

It shows all the binlog files(and their size) for each field, and each segment.

[rere950303]

@yhmo
So, should I check the Field Log Size section of the corresponding field?

[rere950303]

For the size stored in S3 storage, should I check the Log Size? And for the size loaded into memory, should I check the Mem Size?

[yhmo]

"Log Size" is the size in storage in bytes.

[rere950303]

thank you its clear