Improve handling of insufficient PSRAM

[caco3]

Issue

Until 13.0.5, the device did not continue starting if the PSRAM did not have 4 MBytes or more.

The 4 MBytes are needed, else it will not work!. How ever we want to try to improve the handling of it.

@hsantens, @RicoUwe, @Vaclar01, @sbesnard, @evilmumi, @seelenamt I created a new firmware which tries to give a better output. This will most likely not solve your issues with the device, but helps us to trace it down.

https://github.com/jomjol/AI-on-the-edge-device/actions/workflows/build.yaml?query=branch%3Acontinue-boot-on-bad-psram

As an extra help, if you load the webpage of it, an error message should be shown. I can't test it myself since I have no bad PSRAM, but it should show something like this:

Can you please try to run above firmware and show us the (complete) USB log?

@jomjol FYI

[caco3]

@Maddin4000

[caco3]

@mundi86

[Maddin4000]

@caco3 wie installiere ich es?

[caco3]

Du musst bei obigem Link auf den obersten Eintrag mit dem grünen Kreis klicken, dann nach unten scrollen und initial_esp32_setup__continue-boot-on-bad-psram_* herunterladen.

Danach installieren wie normal, siehe https://github.com/jomjol/AI-on-the-edge-device/wiki/Installation#flashing , Punkt 2 oder 3.

[mundi86]

hi, thx 4 the support.
i flashed the new firmeware

now the Seriel Monitor shows me more, but it its in boot loop.
here is the output from Seriell Monitor!
(Sorry its to long 4 the chat)

output.txt

[caco3]

Ok thanks, I seem to have to handle the spiram: SPI RAM not initialized error.

[caco3]

Can you try with the new build? (https://github.com/jomjol/AI-on-the-edge-device/actions/runs/3670394375)

i just added some log messages, to trace it down

[mundi86]

i change the output.txt, the sd-card folder was not set to firmeware version.
so i tried 3 diferent seller from Amazon and 6 ESP32-CAM Board.

https://www.amazon.de/dp/B0B56BDBMC?smid=AA4J0JCPY69MC&ref_=chk_typ_imgToDp&th=1
https://www.amazon.de/gp/product/B08P1NMPLL/ref=ppx_yo_dt_b_asin_title_o00_s00?ie=UTF8&psc=1
https://www.amazon.de/gp/product/B083NRY49S/ref=ppx_yo_dt_b_asin_title_o05_s00?ie=UTF8&psc=1
:(

sure give me a second, its Update main.cpp #840

[caco3]

no need to update the html files, the version mismatch can be ignored for this test

[mundi86]

Ok, flashed the new Version: bf200ba

output_bf200ba.txt

now we see a little bit more

[caco3]

is there more coming afterwards?

I expect to see a few lines after ================== Main Started =================

And you can copy the log directly into here, just wrap it into 3 following " ` ", see https://docs.github.com/de/get-started/writing-on-github/working-with-advanced-formatting/creating-and-highlighting-code-blocks

[mundi86]

Sorry, my first time on GitHub :D

ets Jul 29 2019 12:21:46

rst:0x1 (POWERON_RESET),boot:0x13 (SPI_FAST_FLASH_BOOT)
configsip: 0, SPIWP:0xee
clk_drv:0x00,q_drv:0x00,d_drv:0x00,cs0_drv:0x00,hd_drv:0x00,wp_drv:0x00
mode:DIO, clock div:2
load:0x3fff0030,len:6656
load:0x40078000,len:15300
ho 0 tail 12 room 4
load:0x40080400,len:3848
entry 0x40080694
�[0;32mI (29) boot: ESP-IDF 4.4.2 2nd stage bootloader�[0m
�[0;32mI (29) boot: compile time 19:14:27�[0m
�[0;32mI (29) boot: chip revision: 3�[0m
�[0;32mI (32) boot_comm: chip revision: 3, min. bootloader chip revision: 0�[0m
�[0;32mI (39) boot.esp32: SPI Speed      : 40MHz�[0m
�[0;32mI (44) boot.esp32: SPI Mode       : DIO�[0m
�[0;32mI (48) boot.esp32: SPI Flash Size : 4MB�[0m
�[0;32mI (53) boot: Enabling RNG early entropy source...�[0m
�[0;32mI (58) boot: Partition Table:�[0m
�[0;32mI (62) boot: ## Label            Usage          Type ST Offset   Length�[0m
�[0;32mI (69) boot:  0 nvs              WiFi data        01 02 00009000 00004000�[0m
�[0;32mI (76) boot:  1 otadata          OTA data         01 00 0000d000 00002000�[0m
�[0;32mI (84) boot:  2 phy_init         RF data          01 01 0000f000 00001000�[0m
�[0;32mI (91) boot:  3 ota_0            OTA app          00 10 00010000 001db000�[0m
�[0;32mI (99) boot:  4 ota_1            OTA app          00 11 001f0000 001db000�[0m
�[0;32mI (106) boot: End of partition table�[0m
�[0;32mI (111) boot: No factory image, trying OTA 0�[0m
�[0;32mI (115) boot_comm: chip revision: 3, min. application chip revision: 0�[0m
�[0;32mI (123) esp_image: segment 0: paddr=00010020 vaddr=3f400020 size=4bb4ch (310092) map�[0m
�[0;32mI (250) esp_image: segment 1: paddr=0005bb74 vaddr=3ffb0000 size=04288h ( 17032) load�[0m
�[0;32mI (257) esp_image: segment 2: paddr=0005fe04 vaddr=40080000 size=00214h (   532) load�[0m
�[0;32mI (258) esp_image: segment 3: paddr=00060020 vaddr=400d0020 size=166d54h (1469780) map�[0m
�[0;32mI (827) esp_image: segment 4: paddr=001c6d7c vaddr=40080214 size=1b48ch (111756) load�[0m
�[0;32mI (875) esp_image: segment 5: paddr=001e2210 vaddr=50000000 size=00010h (    16) load�[0m
�[0;32mI (889) boot: Loaded app from partition at offset 0x10000�[0m
�[0;32mI (917) boot: Set actual ota_seq=1 in otadata[0]�[0m
�[0;32mI (917) boot: Disabling RNG early entropy source...�[0m
�[0;32mI (928) psram: This chip is ESP32-D0WD�[0m
�[0;31mE (928) psram: PSRAM ID read error: 0xffffffff�[0m
�[0;31mE (928) spiram: SPI RAM enabled but initialization failed. Bailing out.�[0m
�[0;32mI (936) cpu_start: Failed to init external RAM; continuing without it.�[0m
�[0;32mI (943) cpu_start: Pro cpu up.�[0m
�[0;32mI (946) cpu_start: Starting app cpu, entry point is 0x40083b44�[0m
�[0;32mI (0) cpu_start: App cpu up.�[0m
�[0;32mI (968) cpu_start: Pro cpu start user code�[0m
�[0;32mI (968) cpu_start: cpu freq: 160000000�[0m
�[0;32mI (968) cpu_start: Application information:�[0m
�[0;32mI (973) cpu_start: Project name:     esp32cam-server-only�[0m
�[0;32mI (979) cpu_start: App version:      bf200ba�[0m
�[0;32mI (984) cpu_start: Compile time:     Dec 11 2022 19:08:52�[0m
�[0;32mI (990) cpu_start: ELF file SHA256:  e627d26d0b39228b...�[0m
�[0;32mI (996) cpu_start: ESP-IDF:          4.4.2�[0m
�[0;32mI (1001) heap_init: Initializing. RAM available for dynamic allocation:�[0m
�[0;32mI (1008) heap_init: At 3FFAE6E0 len 00001920 (6 KiB): DRAM�[0m
�[0;32mI (1014) heap_init: At 3FFC06E0 len 0001F920 (126 KiB): DRAM�[0m
�[0;32mI (1020) heap_init: At 3FFE0440 len 00003AE0 (14 KiB): D/IRAM�[0m
�[0;32mI (1027) heap_init: At 3FFE4350 len 0001BCB0 (111 KiB): D/IRAM�[0m
�[0;32mI (1033) heap_init: At 4009B6A0 len 00004960 (18 KiB): IRAM�[0m
�[0;32mI (1041) spi_flash: detected chip: generic�[0m
�[0;32mI (1045) spi_flash: flash io: dio�[0m
�[0;32mI (1055) cpu_start: Starting scheduler on PRO CPU.�[0m
�[0;32mI (0) cpu_start: Starting scheduler on APP CPU.�[0m
�[0;32mI (1059) MAIN: 



�[0m
�[0;32mI (1059) gpio: GPIO[32]| InputEn: 0| OutputEn: 1| OpenDrain: 0| Pullup: 0| Pulldown: 0| Intr:0 �[0m
�[0;32mI (3069) gpio: GPIO[25]| InputEn: 1| OutputEn: 0| OpenDrain: 0| Pullup: 1| Pulldown: 0| Intr:2 �[0m
�[0;32mI (3069) cam_hal: cam init ok�[0m
�[0;32mI (3069) sccb: pin_sda 26 pin_scl 27�[0m
�[0;32mI (3069) sccb: sccb_i2c_port=1
�[0m
�[0;32mI (3079) gpio: GPIO[32]| InputEn: 0| OutputEn: 1| OpenDrain: 0| Pullup: 0| Pulldown: 0| Intr:0 �[0m
�[0;32mI (3109) camera: Detected camera at address=0x30�[0m
�[0;32mI (3109) camera: Detected OV2640 camera�[0m
�[0;32mI (3109) camera: Camera PID=0x26 VER=0x42 MIDL=0x7f MIDH=0xa2�[0m
�[0;32mI (3189) cam_hal: buffer_size: 32768, half_buffer_size: 4096, node_buffer_size: 2048, node_cnt: 16, total_cnt: 15�[0m
�[0;32mI (3189) cam_hal: Allocating 61440 Byte frame buffer in PSRAM�[0m
�[0;31mE (3199) cam_hal: cam_dma_config(306): frame buffer malloc failed�[0m
�[0;31mE (3209) cam_hal: cam_config(390): cam_dma_config failed�[0m
�[0;31mE (3209) camera: Camera config failed with error 0xffffffff�[0m
�[0;31mE (3219) CAM: Camera Init Failed�[0m
�[0;32mI (5219) MAIN: Using SDMMC peripheral�[0m
Name: 00000
Type: SDHC/SDXC
Speed: 20 MHz
Size: 3812MB
�[0;32mI (5549) MAIN: =================================================�[0m
�[0;32mI (5639) MAIN: ==================== Startup ====================�[0m
�[0;32mI (5649) MAIN: =================================================�[0m
�[0;32mI (5669) MAIN: Branch: 'continue-boot-on-bad-psram', Revision: bf200ba, Date/Time: 2022-12-11 19:08, Web UI: Development-Branch: continue-boot-on-bad-psram (Commit: bf200ba) �[0m
�[0;32mI (5689) MAIN: Reset reason: Power-on event�[0m
�[0;32mI (5709) OTA: Start CheckOTAUpdateCheck...�[0m
�[0;32mI (5709) OTA: SHA-256 for the partition table: : 9d4a2809ae90fb20709a8ca3dd3ac3462e1e73286bcd31b689060c91de06fa3a�[0m
�[0;32mI (5719) OTA: SHA-256 for bootloader: : af56e9e56417064e3ea5c6a8068f03ce8430a44aed3858b4e944b26791090e86�[0m
�[0;32mI (6269) OTA: SHA-256 for current firmware: : 30c6f4eb590b915bdc2ecfad940536de4c03310811b2da3c960a47693bbfdbea�[0m
I (6299) wifi:wifi driver task: 3ffd2954, prio:23, stack:6656, core=0
�[0;32mI (6299) system_api: Base MAC address is not set�[0m
�[0;32mI (6299) system_api: read default base MAC address from EFUSE�[0m
I (6309) wifi:wifi firmware version: eeaa27d
I (6309) wifi:wifi certification version: v7.0
I (6309) wifi:config NVS flash: enabled
I (6309) wifi:config nano formating: disabled
I (6319) wifi:Init data frame dynamic rx buffer num: 16
I (6319) wifi:Init management frame dynamic rx buffer num: 16
I (6329) wifi:Init management short buffer num: 32
I (6329) wifi:Init static tx buffer num: 16
I (6339) wifi:Init tx cache buffer num: 16
I (6339) wifi:Init static rx buffer size: 1600
I (6349) wifi:Init static rx buffer num: 10
I (6349) wifi:Init dynamic rx buffer num: 16
�[0;32mI (6349) wifi_init: rx ba win: 6�[0m
�[0;32mI (6359) wifi_init: tcpip mbox: 32�[0m
�[0;32mI (6359) wifi_init: udp mbox: 6�[0m
�[0;32mI (6359) wifi_init: tcp mbox: 6�[0m
�[0;32mI (6369) wifi_init: tcp tx win: 5744�[0m
�[0;32mI (6369) wifi_init: tcp rx win: 5744�[0m
�[0;32mI (6379) wifi_init: tcp mss: 1440�[0m
�[0;32mI (6379) wifi_init: WiFi IRAM OP enabled�[0m
�[0;32mI (6389) wifi_init: WiFi RX IRAM OP enabled�[0m
�[0;32mI (6409) phy_init: phy_version 4670,719f9f6,Feb 18 2021,17:07:07�[0m
�[0;33mW (6409) phy_init: failed to load RF calibration data (0x1102), falling back to full calibration�[0m
I (6599) wifi:mode : sta (40:22:d8:76:0b:04)
I (6599) wifi:enable tsf
�[0;32mI (6599) BLINK: Flash - start�[0m
�[0;32mI (6599) WIFI: Set Hostname to:watermeter�[0m
�[0;32mI (6599) WIFI: wifi_init_sta finished.�[0m
I (6609) wifi:new:<1,0>, old:<1,0>, ap:<255,255>, sta:<1,0>, prof:1
�[0;32mI (6799) BLINK: Flash - done�[0m
I (7439) wifi:state: init -> auth (b0)
I (7449) wifi:state: auth -> assoc (0)
I (7459) wifi:state: assoc -> run (10)
I (7489) wifi:connected with SchmidHome, aid = 3, channel 1, BW20, bssid = 74:83:c2:3a:99:1f
I (7489) wifi:security: WPA2-PSK, phy: bgn, rssi: -68
I (7509) wifi:pm start, type: 1

I (7549) wifi:AP's beacon interval = 102400 us, DTIM period = 1
W (8579) wifi:<ba-add>idx:0 (ifx:0, 74:83:c2:3a:99:1f), tid:0, ssn:1, winSize:64
�[0;32mI (9279) esp_netif_handlers: sta ip: 192.168.1.200, mask: 255.255.255.0, gw: 192.168.1.1�[0m
�[0;32mI (9279) WIFI: got ip:192.168.1.200�[0m
�[0;32mI (9279) WIFI: connected to ap SSID: SchmidHome, password: XXXXXXX�[0m
�[0;32mI (9279) BLINK: Flash - start�[0m
�[0;32mI (11289) SNTP: Initializing SNTP�[0m
�[0;32mI (11289) SNTP: Time is not set yet. Getting time over NTP server pool.ntp.org�[0m
�[0;32mI (11299) SNTP: Waiting until we get a time from the NTP server pool.ntp.org�[0m
�[0;32mI (11319) SNTP: Status: Reset�[0m
�[0;32mI (13339) SNTP: Status: Reset�[0m
�[0;32mI (15349) SNTP: Status OK�[0m
�[0;32mI (15379) SNTP: Time is synced with NTP Server pool.ntp.org�[0m
�[0;32mI (15399) SNTP: Time zone set to CET-1CEST,M3.5.0,M10.5.0/3�[0m
�[0;32mI (15409) SNTP: The current date/time in Berlin is: 2022-12-11_20:23:10�[0m
�[0;32mI (15409) MAIN: =================================================�[0m
�[0;32mI (15429) MAIN: ================== Main Started =================�[0m
�[0;32mI (15449) MAIN: =================================================�[0m
�[0;32mI (15469) MAIN: A1�[0m
�[0;32mI (15479) MAIN: A3�[0m
�[0;32mI (15479) MAIN: A4�[0m
�[0;31mE (15479) spiram: SPI RAM not initialized�[0m

abort() was called at PC 0x400ea62c on core 0


Backtrace:0x40084509:0x3ffc37300x4008f085:0x3ffc3750 0x40096219:0x3ffc3770 0x400ea62c:0x3ffc37e0 0x400ea6c3:0x3ffc3800 0x400d3f13:0x3ffc3820 0x402355ca:0x3ffc3970 




ELF file SHA256: e627d26d0b39228b

Rebooting...

[Maddin4000]

sieht erstmal gut aus

[Maddin4000]

wie geht es jetzt weiter? komme nicht auf die Seite

[mundi86]

wie geht es jetzt weiter? komme nicht auf die Seite

weil er bei dir auch im boot loop hängt denk ich mal.
laut Monitor bekomm ich eine IP komme aber auch ned drauf weil vorher der reboot wieder eintritt.

[Maddin4000]

das solltet ihr besser kommunizieren, dann spart ihr euch einige Problem Anfragen

waren meine Screenshots hilfreich?

[caco3]

das solltet ihr besser kommunizieren, dann spart ihr euch einige Problem Anfragen

Ja, man kann es immer noch mehr verbessern :)
Grundsätzlich steht es schon hier: https://github.com/jomjol/AI-on-the-edge-device/wiki/Installation
Aber ich werde noch einen Hinweis zum Installer hinzufügen.

waren meine Screenshots hilfreich?

Hmm, das sind 2 untershciedliche Geräte, oder?

• Beim Ersten ist das PSRAM schlecht
• Beim anderen ist das PSRAM ok. Und mit einer SD-Karte würde es wohl auch funktionieren, oder?

[Maddin4000]

wenn die SD Karte im Cam Modul steckt kommt PASRAM Fehler, ohne SD Karte ist PSRAM ok

[Maddin4000]

mit dem Rolling hab ich eine SD Karte defekt bekommen

[Maddin4000]

Ja wenn ihr beschreibt web installer denken die Leute Cam an USB mit Sd Karte und läuft nicht, ohne Sd läuft es aber und man hat kein PSRAM Fehler.

ich musste verschiedene tool zum löschen des flash verwenden und die zweite Cam wieder zum laufen zu bringen

[caco3]

wenn die SD Karte im Cam Modul steckt kommt PASRAM Fehler, ohne SD Karte ist PSRAM ok

Hmm, das macht für mich jetzt so wenig Sinn! Kannst Du das nochmals überprüfen und deas Log als Text hier hinein kopieren?

mit dem Rolling hab ich eine SD Karte defekt bekommen

Eine Karte wurde zerstört? Das kann ich auch fast nicht glauben!

ich musste verschiedene tool zum löschen des flash verwenden

Ja, da hatte ich auch schon mühe. Ist jedoch nicht, was wir ändern können :(

[Maddin4000]

warte

[Maddin4000]

die zweite Camera ist defekt; erkennt keine SD Karte mehr

mit der ersten folgende Log:

mit SD Karte:
esp-web-tools-logs (19).txt

ohne SD:
esp-web-tools-logs (21).txt

es schein an dem defekten Cam Modul zu liegen. 2 bestellt eine defekt.

[Maddin4000]

wie füge ich logs hier ein? Ich kenne mich nicht so gut aus mit Foren

[mundi86]

@hsantens and @hsantens: i have some news for you guys.
First of all there is nothing we can do... i wrote with the support from diymore® and Heemol (https://www.amazon.de/gp/product/B0B56BDBMC?th=1) and they told me there is a charge of "bad" ESP32-CAM modul where sothing i wrong at producing stage.
......................................................
Hello Christian,
Sorry for this situation.
We have to explane for this:
There is a batch of goods that PSRAM can not be recognized,since the factory uses the wrong line board.
The products includes 8M PSRAM in fact.
.....................................................

so in fact they are all from the same china faktory, it is luck to get a "good" one or not.
I send all of my 8 esp32-cam back an order 4 new one from diymore® and Heemol because the support from the sellers was quick and nice and helpfully.

so i give you a feedback if the new ons's here and i flashed it.

br.

[caco3]

wie füge ich logs hier ein? Ich kenne mich nicht so gut aus mit Foren

einfach hier einfügen und auf eigenen Zeilen in dreifachen Backticks einfassen, siehe https://docs.github.com/de/get-started/writing-on-github/getting-started-with-writing-and-formatting-on-github/basic-writing-and-formatting-syntax#quoting-code

[Maddin4000]

Ok

THX

[nliaudat]

Perhaps linked to CONFIG_SPIRAM_MALLOC_RESERVE_INTERNAL=40960 in sdkconfig.defaults ?
If you have lower memory available, it may hurt

[ede-kowalski]

Hi,
tried to implment this great project, but i have ordered 3 devices now and no one is working due to PSRAM issue.
Two of them seems to be Heemol, so this seems to be a "known" error?
Any package that is known working?
Products linked at wiki are not available anymore.

[caco3]

Products linked at wiki are not available anymore.

I created a new discussion for this: #1732