单机milvus-2.5.1启动，数据盘7.1G，内存空闲59G，还是启动不起来，需要这么大内存麽，我用另外一个就1个G的数据就能启动

[jhyever]

@yhmo 麻烦大佬帮忙看下，感谢

[yhmo]

跟内存没关系，etcd的硬盘空间不够了。
volumes/milvus下面的三个文件夹 etcd, milvus, minio分别占了多少硬盘空间？

[jhyever]

分别占用如下

[xiaofan-luan]

分别占用如下

数据盘写满了，你需要增加数据盘，内存100G的话，磁盘至少给200G以上

[yhmo]

正常的docker-compose.yaml里etcd容器的配置有这几项，检查你的docker-compose.yaml是否有这几项，如果删掉了就加回来吧。

services:
  etcd:
    container_name: milvus-etcd
    image: quay.io/coreos/etcd:v3.5.18
    environment:
      - ETCD_AUTO_COMPACTION_MODE=revision
      - ETCD_AUTO_COMPACTION_RETENTION=1000
      - ETCD_QUOTA_BACKEND_BYTES=4294967296
      - ETCD_SNAPSHOT_COUNT=50000
    ......

相似问题：
#36748
#18763

[jhyever]

我们是standalone启动的呢

[yhmo]

如果是用standalone_embed.sh启动，会在同目录下自动产生一个embedEtcd.yaml文件。打开embedEtcd.yaml，会有以下内容：

listen-client-urls: http://0.0.0.0:2379
advertise-client-urls: http://0.0.0.0:2379
quota-backend-bytes: 4294967296
auto-compaction-mode: revision
auto-compaction-retention: '1000'

默认会给etcd设置4GB上限的存储空间，quota-backend-bytes最大可设置为8GB。你的etcd只用了2.1GB就报警，可能是这个设置被删了变成了默认的2GB上限。把quota-backend-bytes设置为8589934592。
auto-compaction-retention是etcd内部做compaction的间隔，1000表示1000小时，这个值你可以改为1，改完后重启试试。

[jhyever]

如果是8589934592的，后面也超了呢， 还是启动不了，这样怎么办呢

[yhmo]

volumes/etcd 这个文件夹的大小是否真的超过了8GB？ 进到volumes里面用 "sudo du -h -d 1" 查看。
如果真的超过了8GB，那说明etcd的数据在不断膨胀，除非有超大的数据量超多的表和partition或者密集地更新数据。不知你那边的使用场景是怎样的？

[jhyever]

就是正常的文档里面的片段生成向量入库啊，

而且配置是生效的
TotalMem: 1081825304576
UsedMem: 39337984

open pid file: /run/milvus/standalone.pid
lock pid file: /run/milvus/standalone.pid
[2025/05/23 08:04:11.213 +00:00] [INFO] [roles/roles.go:345] ["starting running Milvus components"]
[2025/05/23 08:04:11.213 +00:00] [INFO] [roles/roles.go:187] ["Enable Jemalloc"] ["Jemalloc Path"=/milvus/lib/:/milvus/lib/libjemalloc.so]
[2025/05/23 08:04:11.220 +00:00] [DEBUG] [runtime/asm_amd64.s:1695] ["start refreshing configurations"] [source=FileSource]
[2025/05/23 08:04:11.222 +00:00] [INFO] [paramtable/hook_config.go:21] ["hook config"] [hook={}]
[2025/05/23 08:04:11.222 +00:00] [DEBUG] [runtime/asm_amd64.s:1695] ["start refreshing configurations"] [source=FileSource]
{"level":"info","ts":"2025-05-23T08:04:11.223Z","caller":"embed/etcd.go:124","msg":"configuring peer listeners","listen-peer-urls":["http://localhost:2380"]}
{"level":"info","ts":"2025-05-23T08:04:11.223Z","caller":"embed/etcd.go:132","msg":"configuring client listeners","listen-client-urls":["http://0.0.0.0:2379"]}
{"level":"info","ts":"2025-05-23T08:04:11.223Z","caller":"embed/etcd.go:306","msg":"starting an etcd server","etcd-version":"3.5.5","git-sha":"Not provided (use ./build instead of go build)","go-version":"go1.22.0","go-os":"linux","go-arch":"amd64","max-cpu-set":128,"max-cpu-available":128,"member-initialized":true,"name":"default","data-dir":"/var/lib/milvus/etcd","wal-dir":"","wal-dir-dedicated":"","member-dir":"/var/lib/milvus/etcd/member","force-new-cluster":false,"heartbeat-interval":"100ms","election-timeout":"1s","initial-election-tick-advance":true,"snapshot-count":100000,"snapshot-catchup-entries":5000,"initial-advertise-peer-urls":["http://localhost:2380"],"listen-peer-urls":["http://localhost:2380"],"advertise-client-urls":["http://0.0.0.0:2379"],"listen-client-urls":["http://0.0.0.0:2379"],"listen-metrics-urls":[],"cors":[""],"host-whitelist":[""],"initial-cluster":"","initial-cluster-state":"new","initial-cluster-token":"","quota-backend-bytes":8589934592,"max-request-bytes":1572864,"max-concurrent-streams":4294967295,"pre-vote":true,"initial-corrupt-check":false,"corrupt-check-time-interval":"0s","compact-check-time-enabled":false,"compact-check-time-interval":"1m0s","auto-compaction-mode":"revision","auto-compaction-retention":"1ns","auto-compaction-interval":"1ns","discovery-url":"","discovery-proxy":"","downgrade-check-interval":"5s"}
{"level":"info","ts":"2025-05-23T08:04:18.114Z","caller":"etcdserver/backend.go:81","msg":"opened backend db","path":"/var/lib/milvus/etcd/member/snap/db","took":"6.890591518s"}
{"level":"info","ts":"2025-05-23T08:04:19.073Z","caller":"etcdserver/server.go:509","msg":"recovered v2 store from snapshot","snapshot-index":2100021,"snapshot-size":"8.1 kB"}
{"level":"info","ts":"2025-05-23T08:04:19.074Z","caller":"etcdserver/server.go:522","msg":"recovered v3 backend from snapshot","backend-size-bytes":2147487744,"backend-size":"2.1 GB","backend-size-in-use-bytes":2147450880,"backend-size-in-use":"2.1 GB"}
{"level":"info","ts":"2025-05-23T08:04:19.360Z","caller":"etcdserver/raft.go:529","msg":"restarting local member","cluster-id":"cdf818194e3a8c32","local-member-id":"8e9e05c52164694d","commit-index":2152649}
{"level":"info","ts":"2025-05-23T08:04:19.364Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d switched to configuration voters=(10276657743932975437)"}
{"level":"info","ts":"2025-05-23T08:04:19.364Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d became follower at term 8"}
{"level":"info","ts":"2025-05-23T08:04:19.364Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"newRaft 8e9e05c52164694d [peers: [8e9e05c52164694d], term: 8, commit: 2152649, applied: 2100021, lastindex: 2152649, lastterm: 8]"}
{"level":"info","ts":"2025-05-23T08:04:19.365Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2025-05-23T08:04:19.365Z","caller":"membership/cluster.go:278","msg":"recovered/added member from store","cluster-id":"cdf818194e3a8c32","local-member-id":"8e9e05c52164694d","recovered-remote-peer-id":"8e9e05c52164694d","recovered-remote-peer-urls":["http://localhost:2380"]}
{"level":"info","ts":"2025-05-23T08:04:19.365Z","caller":"membership/cluster.go:287","msg":"set cluster version from store","cluster-version":"3.5"}
{"level":"warn","ts":"2025-05-23T08:04:19.365Z","caller":"auth/store.go:1233","msg":"simple token is not cryptographically signed"}
{"level":"info","ts":"2025-05-23T08:04:27.746Z","caller":"mvcc/kvstore.go:393","msg":"kvstore restored","current-rev":2107209}
{"level":"info","ts":"2025-05-23T08:04:27.747Z","caller":"etcdserver/quota.go:117","msg":"enabled backend quota","quota-name":"v3-applier","quota-size-bytes":8589934592,"quota-size":"8.6 GB"}
{"level":"info","ts":"2025-05-23T08:04:27.747Z","caller":"etcdserver/server.go:845","msg":"starting etcd server","local-member-id":"8e9e05c52164694d","local-server-version":"3.5.5","cluster-id":"cdf818194e3a8c32","cluster-version":"3.5"}
{"level":"info","ts":"2025-05-23T08:04:27.747Z","caller":"etcdserver/server.go:738","msg":"started as single-node; fast-forwarding election ticks","local-member-id":"8e9e05c52164694d","forward-ticks":9,"forward-duration":"900ms","election-ticks":10,"election-timeout":"1s"}
{"level":"info","ts":"2025-05-23T08:04:27.749Z","caller":"embed/etcd.go:584","msg":"serving peer traffic","address":"127.0.0.1:2380"}
{"level":"info","ts":"2025-05-23T08:04:27.749Z","caller":"embed/etcd.go:275","msg":"now serving peer/client/metrics","local-member-id":"8e9e05c52164694d","initial-advertise-peer-urls":["http://localhost:2380"],"listen-peer-urls":["http://localhost:2380"],"advertise-client-urls":["http://0.0.0.0:2379"],"listen-client-urls":["http://0.0.0.0:2379"],"listen-metrics-urls":[]}
{"level":"info","ts":"2025-05-23T08:04:27.749Z","caller":"embed/etcd.go:556","msg":"cmux::serve","address":"127.0.0.1:2380"}
[2025/05/23 08:04:27.749 +00:00] [INFO] [etcd/etcd_server.go:58] ["finish init Etcd config"] [path=/milvus/configs/embedEtcd.yaml] [data=/var/lib/milvus/etcd]
[2025/05/23 08:04:27.750 +00:00] [INFO] [logutil/logutil.go:163] ["Log directory"] [configDir=]
[2025/05/23 08:04:27.750 +00:00] [INFO] [logutil/logutil.go:164] ["Set log file to "] [path=]
[2025/05/23 08:04:27.750 +00:00] [INFO] [roles/roles.go:294] [setupPrometheusHTTPServer]
[2025/05/23 08:04:27.750 +00:00] [INFO] [http/server.go:240] ["management listen"] [addr=:9091]
[2025/05/23 08:04:27.752 +00:00] [INFO] [gc/gc_tuner.go:138] ["GC Helper initialized."] ["Initial GoGC"=100] [minimumGOGC=30] [maximumGOGC=200] [memoryThreshold=973642774118]
[2025/05/23 08:04:27.752 +00:00] [INFO] [rootcoord/root_coord.go:160] ["update rootcoord state"] [state=Abnormal]
[2025/05/23 08:04:27.753 +00:00] [INFO] [rootcoord/service.go:154] ["RootCoord listen on"] [address="[::]:53100"] [port=53100]
[2025/05/23 08:04:27.753 +00:00] [INFO] [rootcoord/service.go:184] ["init params done.."]
[2025/05/23 08:04:27.753 +00:00] [INFO] [etcd/etcd_util.go:52] ["create etcd client"] [useEmbedEtcd=true] [useSSL=false] [endpoints="[localhost:2379]"] [minVersion=1.3]
[2025/05/23 08:04:27.753 +00:00] [INFO] [rootcoord/service.go:204] ["etcd connect done ..."]
[2025/05/23 08:04:27.753 +00:00] [INFO] [rootcoord/service.go:265] ["start grpc "] [port=53100]
[2025/05/23 08:04:27.753 +00:00] [INFO] [utils/util.go:60] ["Internal TLS Enabled"] [value=false]
[2025/05/23 08:04:27.754 +00:00] [INFO] [datacoord/service.go:99] ["DataCoord listen on"] [address="[::]:13333"] [port=13333]
[2025/05/23 08:04:27.755 +00:00] [INFO] [etcd/etcd_util.go:52] ["create etcd client"] [useEmbedEtcd=true] [useSSL=false] [endpoints="[localhost:2379]"] [minVersion=1.3]
[2025/05/23 08:04:27.755 +00:00] [INFO] [datacoord/server.go:1213] ["register metrics actions finished"]
[2025/05/23 08:04:27.755 +00:00] [INFO] [dependency/factory.go:86] ["try to init mq"] [standalone=true] [mqType=rocksmq]
[2025/05/23 08:04:27.756 +00:00] [INFO] [components/index_coord.go:42] ["IndexCoord running ..."]
[2025/05/23 08:04:27.756 +00:00] [INFO] [querycoord/service.go:104] ["QueryCoord listen on"] [address="[::]:19531"] [port=19531]
[2025/05/23 08:04:27.756 +00:00] [INFO] [etcd/etcd_util.go:52] ["create etcd client"] [useEmbedEtcd=true] [useSSL=false] [endpoints="[localhost:2379]"] [minVersion=1.3]
[2025/05/23 08:04:27.757 +00:00] [INFO] [utils/util.go:60] ["Internal TLS Enabled"] [value=false]
[2025/05/23 08:04:27.758 +00:00] [INFO] [querynode/service.go:102] ["QueryNode listen on"] [address="[::]:21123"] [port=21123]
[2025/05/23 08:04:27.758 +00:00] [INFO] [etcd/etcd_util.go:52] ["create etcd client"] [useEmbedEtcd=true] [useSSL=false] [endpoints="[localhost:2379]"] [minVersion=1.3]
[2025/05/23 08:04:27.758 +00:00] [INFO] [utils/util.go:60] ["Internal TLS Enabled"] [value=false]
[2025/05/23 08:04:27.760 +00:00] [INFO] [datanode/service.go:102] ["DataNode listen on"] [address="[::]:21124"] [port=21124]
[2025/05/23 08:04:27.760 +00:00] [INFO] [etcd/etcd_util.go:52] ["create etcd client"] [useEmbedEtcd=true] [useSSL=false] [endpoints="[localhost:2379]"] [minVersion=1.3]
[2025/05/23 08:04:27.760 +00:00] [INFO] [datanode/service.go:257] ["DataNode address"] [address=172.17.0.2:21124]
[2025/05/23 08:04:27.761 +00:00] [INFO] [utils/util.go:60] ["Internal TLS Enabled"] [value=false]
[2025/05/23 08:04:27.761 +00:00] [INFO] [indexnode/service.go:78] ["IndexNode listen on"] [address="[::]:21121"] [port=21121]
[2025/05/23 08:04:27.762 +00:00] [INFO] [utils/util.go:60] ["Internal TLS Enabled"] [value=false]
[2025/05/23 08:04:27.762 +00:00] [INFO] [proxy/look_aside_balancer.go:233] ["Start check query node health loop"]
[2025/05/23 08:04:27.763 +00:00] [INFO] [hookutil/hook.go:70] ["empty so path, skip to load plugin"]
[2025/05/23 08:04:27.763 +00:00] [INFO] [vecindexmgr/vector_index_mgr.go:124] ["init vector indexes with features : BINFLAT : 720897,BIN_FLAT : 720897,BIN_IVF_FLAT : 524289,DISKANN : 2097166,FLAT : 720910,HNSW : 1572910,HNSWLIB_DEPRECATED : 1572879,HNSW_PQ : 524334,HNSW_PRQ : 524334,HNSW_SQ : 524334,IVFBIN : 524289,IVFFLAT : 524302,IVFFLATCC : 14,IVFPQ : 524302,IVFSQ : 524302,IVF_FLAT : 524302,IVF_FLAT_CC : 14,IVF_PQ : 524302,IVF_SQ : 524302,IVF_SQ8 : 524302,IVF_SQ_CC : 14,SCANN : 524302,SPARSE_INVERTED_INDEX : 524304,SPARSE_INVERTED_INDEX_CC : 524304,SPARSE_WAND : 524304,SPARSE_WAND_CC : 524304,"]
[2025/05/23 08:04:27.765 +00:00] [INFO] [proxy/listener_manager.go:53] ["Proxy listen on external grpc listener"] [address=172.17.0.2:19530] [port=19530]
[2025/05/23 08:04:27.765 +00:00] [INFO] [proxy/listener_manager.go:63] ["Proxy listen on internal grpc listener"] [address=172.17.0.2:19529] [port=19529]
[2025/05/23 08:04:27.765 +00:00] [INFO] [proxy/listener_manager.go:98] ["Proxy server(http) and external grpc server share the same port"]
[2025/05/23 08:04:27.765 +00:00] [INFO] [proxy/service.go:411] ["init Proxy server"]
[2025/05/23 08:04:27.765 +00:00] [INFO] [proxy/service.go:431] ["Proxy init service's parameter table done"]
[2025/05/23 08:04:27.765 +00:00] [INFO] [proxy/service.go:433] ["Proxy init http server's parameter table done"]
[2025/05/23 08:04:27.765 +00:00] [INFO] [accesslog/global.go:146] ["Init access logger success"]
[2025/05/23 08:04:27.765 +00:00] [INFO] [proxy/service.go:437] ["init Proxy's tracer done"] ["service name"="Proxy ip: 172.17.0.2, port: 19530"]
[2025/05/23 08:04:27.765 +00:00] [INFO] [etcd/etcd_util.go:52] ["create etcd client"] [useEmbedEtcd=true] [useSSL=false] [endpoints="[localhost:2379]"] [minVersion=1.3]
[2025/05/23 08:04:27.766 +00:00] [INFO] [utils/util.go:60] ["Internal TLS Enabled"] [value=false]
[2025/05/23 08:04:27.766 +00:00] [INFO] [proxy/service.go:387] ["create Proxy internal grpc server"] ["enforcement policy"="{"MinTime":5000000000,"PermitWithoutStream":true}"] ["server parameters"="{"MaxConnectionIdle":0,"MaxConnectionAge":0,"MaxConnectionAgeGrace":0,"Time":60000000000,"Timeout":10000000000}"]
[2025/05/23 08:04:27.766 +00:00] [INFO] [etcd/etcd_util.go:52] ["create etcd client"] [useEmbedEtcd=true] [useSSL=false] [endpoints="[localhost:2379]"] [minVersion=1.3]
{"level":"info","ts":"2025-05-23T08:04:27.767Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d no leader at term 8; dropping index reading msg"}
[2025/05/23 08:04:27.854 +00:00] [INFO] [rootcoord/service.go:221] ["grpc init done ..."]
[2025/05/23 08:04:27.854 +00:00] [INFO] [rootcoord/service.go:224] ["RootCoord start to create DataCoord client"]
[2025/05/23 08:04:27.859 +00:00] [INFO] [querynodev2/server.go:294] ["register metrics actions finished"]
[2025/05/23 08:04:27.859 +00:00] [INFO] [querynodev2/server.go:304] ["QueryNode session info"] [metaPath=by-dev/meta]
[2025/05/23 08:04:27.861 +00:00] [INFO] [datanode/service.go:266] ["initializing RootCoord client for DataNode"]
[2025/05/23 08:04:27.862 +00:00] [INFO] [etcd/etcd_util.go:52] ["create etcd client"] [useEmbedEtcd=true] [useSSL=false] [endpoints="[localhost:2379]"] [minVersion=1.3]
[2025/05/23 08:04:27.862 +00:00] [INFO] [indexnode/indexnode.go:214] ["IndexNode init"] [state=Initializing]
{"level":"info","ts":"2025-05-23T08:04:27.921Z","caller":"etcdserver/v3_server.go:832","msg":"first commit in current term: resending ReadIndex request"}
{"level":"info","ts":"2025-05-23T08:04:27.921Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d no leader at term 8; dropping index reading msg"}
{"level":"info","ts":"2025-05-23T08:04:27.921Z","caller":"etcdserver/v3_server.go:832","msg":"first commit in current term: resending ReadIndex request"}
{"level":"info","ts":"2025-05-23T08:04:27.921Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d no leader at term 8; dropping index reading msg"}
{"level":"warn","ts":"2025-05-23T08:04:27.922Z","caller":"etcdserver/util.go:123","msg":"failed to apply request","took":"5.18µs","request":"header:<ID:7587886956732803077 > txn:<compare:<key:"by-dev/meta/session/id" version:0 > success:<request_put:<key:"by-dev/meta/session/id" value_size:1 >> failure:<>>","response":"","error":"etcdserver: no space"}
{"level":"warn","ts":"2025-05-23T08:04:27.922Z","caller":"etcdserver/util.go:123","msg":"failed to apply request","took":"3.047µs","request":"header:<ID:7587886956732803078 > txn:<compare:<key:"by-dev/meta/session/id" version:0 > success:<request_put:<key:"by-dev/meta/session/id" value_size:1 >> failure:<>>","response":"","error":"etcdserver: no space"}
{"level":"warn","ts":"2025-05-23T08:04:27.922Z","caller":"etcdserver/util.go:123","msg":"failed to apply request","took":"1.035µs","request":"header:<ID:7587886956732803081 > txn:<compare:<target:VALUE key:"by-dev/meta/session/id" value_size:1 > success:<request_put:<key:"by-dev/meta/session/id" value_size:1 >> failure:<>>","response":"","error":"etcdserver: no space"}
{"level":"warn","ts":"2025-05-23T08:04:27.922Z","caller":"etcdserver/util.go:123","msg":"failed to apply request","took":"1.483µs","request":"header:<ID:7587886956732803083 > txn:<compare:<key:"by-dev/meta/session/id" version:0 > success:<request_put:<key:"by-dev/meta/session/id" value_size:1 >> failure:<>>","response":"","error":"etcdserver: no space"}
{"level":"warn","ts":"2025-05-23T08:04:27.922Z","caller":"etcdserver/util.go:123","msg":"failed to apply request","took":"1.091µs","request":"header:<ID:7587886956872042501 > txn:<compare:<key:"by-dev/meta/session/id" version:0 > success:<request_put:<key:"by-dev/meta/session/id" value_size:1 >> failure:<>>","response":"","error":"etcdserver: no space"}
{"level":"warn","ts":"2025-05-23T08:04:27.922Z","caller":"etcdserver/util.go:123","msg":"failed to apply request","took":"941ns","request":"header:<ID:7587886956872042502 > txn:<compare:<key:"by-dev/meta/session/id" version:0 > success:<request_put:<key:"by-dev/meta/session/id" value_size:1 >> failure:<>>","response":"","error":"etcdserver: no space"}
{"level":"warn","ts":"2025-05-23T08:04:27.922Z","caller":"etcdserver/util.go:123","msg":"failed to apply request","took":"813ns","request":"header:<ID:7587886956872042506 > txn:<compare:<target:VALUE key:"by-dev/meta/session/id" value_size:1 > success:<request_put:<key:"by-dev/meta/session/id" value_size:1 >> failure:<>>","response":"","error":"etcdserver: no space"}
{"level":"info","ts":"2025-05-23T08:04:27.922Z","caller":"etcdserver/v3_server.go:832","msg":"first commit in current term: resending ReadIndex request"}
{"level":"info","ts":"2025-05-23T08:04:27.922Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"8e9e05c52164694d no leader at term 8; dropping index reading msg"}
{"level":"warn","ts":"2025-05-23T08:04:28.423Z","caller":"etcdserver/v3_server.go:840","msg":"waiting for ReadIndex response took too long, retrying","sent-request-id":7587886957002040