Skip to content

persistent storage #138

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 70 commits into
base: develop
Choose a base branch
from
Draft

persistent storage #138

wants to merge 70 commits into from

Conversation

dhebbeker
Copy link
Member

@dhebbeker dhebbeker commented Mar 12, 2025 •
edited
Loading

  • try USB MSC with Windows
  • does JTAG work with USB MSC simultaneously?
  • does Wokwi still work
  • define an application-side interface

dhebbeker added 30 commits October 3, 2024 22:54
@dhebbeker
Try example from espressif/arduino-esp32
6fc557b 
https://github.com/espressif/arduino-esp32/blob/733373a049d8a06fab00628bcae585550fac6d07/libraries/USB/examples/USBMSC/USBMSC.ino
@dhebbeker
Try Adafruit USB device MSC example.
9a0b34c 
https://github.com/adafruit/Adafruit_TinyUSB_Arduino/blob/a529a74e4f5018ad95b0524807b5e508871c7831/examples/MassStorage/msc_esp32_file_browser/msc_esp32_file_browser.ino
@dhebbeker
Rearrange functions.
998cf8e
@dhebbeker
Specify FatFS partition.
ec83e90 
https://github.com/espressif/arduino-esp32/blob/8ce5f775fe928dc4541b0fecaf710de58aa3d198/tools/partitions/default_ffat_8MB.csv
https://docs.platformio.org/en/stable/platforms/espressif32.html#partition-tables
@dhebbeker
Set CPP flags to enable USB.
5baaa06 
https://docs.espressif.com/projects/arduino-esp32/en/latest/troubleshooting.html#id5
@dhebbeker
Use example code from installed framework version.
f1c6c5e 
Taken from framework-arduinoespressif32 version 3.20017.0.
@dhebbeker
Misc
f737f3e
@dhebbeker
Adjust flag un-definition.
2cfbed2 
This is probably without effect. But just to be clean.
@dhebbeker
Resolve conflicting definitions of TinyUSB library.
3bff418 
This should deactivate the use Arduino-ESP32 TinyUSB library.
This way only the Adafruit version of the TinyUSB library should be used.
@dhebbeker
Use v3.3.4 of Adafruit library in order to avoid conflicting definiti…
c5b310c 
…ons.

Apparently there are linkage problems with v.3.4.0 🤷

adafruit/Adafruit_TinyUSB_Arduino#473
https://community.platformio.org/t/new-tinyusb-doesnt-allow-compile/44281

Note: When using `@3.3.4` as version specification with platformio v3.4.0 is currently used.
@dhebbeker
Specify exception decoder for monitor
15175cd 
This helps debugging backtraces printed to UART
@dhebbeker
Add overview of USB options
8956a15 
Based on:

- https://raw.githubusercontent.com/espressif/arduino-esp32/refs/heads/idf-release/v5.3/platform.txt
- https://raw.githubusercontent.com/espressif/arduino-esp32/refs/heads/idf-release/v5.3/boards.txt
@dhebbeker
Apply USB options from example
12cd453 
See https://youtu.be/hJSBTFsOnoA?feature=shared&t=588
@dhebbeker
Pin the platform version.
9e011ed 
As this is the version the example code has been used from.
@dhebbeker
Generate empty Arduino project for ESP32-S3-DevKitC-1
214160a 
Automatically generated by PlatformIO Home.
@dhebbeker
Add test for FatFS
3aa20b0
@dhebbeker
WIP: Use partition instead of Array in RAM
26b4dcd
@dhebbeker
WIP: Add flag for "filesystem ready"
2801511
@dhebbeker
Merge branch 'feature/6-persistent-storage-for-configuration-and-task…
7602e1c 
…-information-6' into feature/6-persistent-storage-for-configuration-and-task-information-2
@dhebbeker
Merge branch 'feature/6-persistent-storage-for-configuration-and-task…
efdad5a 
…-information-4' into feature/6-persistent-storage-for-configuration-and-task-information-2
@dhebbeker
Substitute Adafruit_SPIFlash member functions with FFat member functions
8b1f0ed
@dhebbeker
WIP: replace fs_changed with mediaPresent() as we can not subscribe m…
8722fd9 
…sc_ready_callback
@dhebbeker
Remove unavailable callbacks
a5fe1ee 
Some callbacks are simply not available using only the Arduino-ESP32 framework
@dhebbeker
Omit usage of std::filesystem
9badb59 
Is apparently not included in the C++ Standard Library implementation
@dhebbeker
Auxiliary commit to revert individual files from efdad5a
aa08b54 
This reverts commit bcca8ab37f4f06f32c8158948956261fb9c79f93, reversing
changes made to 7602e1c.
@dhebbeker
Move switched between application and USB MSC to tasks
3801873
@dhebbeker
Add example file for file system
d589007
@dhebbeker
Fix incorrect offset calculation for USB MSC
e9036b5
@dhebbeker
Document the decisions made regarding USB MSC integration with FFat o…
b606d6f 
…n the ESP32-S3
@dhebbeker
Add minor details
56a495e
dhebbeker added 30 commits March 3, 2025 18:52
@dhebbeker
Remove USBSerial
6464a8b
@dhebbeker
Make MSC static
c07f405
@dhebbeker
blockSize
7b507b8
@dhebbeker
Replace commulated USB callback with individual callbacks
c530dbd
@dhebbeker
Rename partition
148ef20
@dhebbeker
Use logging macros and iostream
bf336e0
@dhebbeker
added more error checks
db09b41
@dhebbeker
Close files after usage
23c66d3
@dhebbeker
Adjust logging
d860377
@dhebbeker
Inline USB start/stop callback tasks
01ed893
@dhebbeker
Add wait for file system
175e464
@dhebbeker
Revert "Inline USB start/stop callback tasks"
e1b6c20 
This reverts commit 01ed893.

Because starting file system within event loop failed:

```
ESP_ERROR_CHECK failed: esp_err_t 0x1 (ERROR) at 0x4037ab88
  #0  0x4037ab88 in _esp_error_check_failed at /home/runner/work/esp32-arduino-lib-builder/esp32-arduino-lib-builder/esp-idf/components/esp_system/esp_err.c:42

file: "lib/storage/storage.cpp" line 117
func: void switchToApplicationMode()
expression: FFat.begin()

abort() was called at PC 0x4037ab8b on core 1

Backtrace: 0x403777ba:0x3fcf2100 0x4037ab95:0x3fcf2120 0x4038058d:0x3fcf2140 0x4037ab8b:0x3fcf21c0 0x42002afb:0x3fcf21e0 0x42002b15:0x3fcf2200 0x4205e6d5:0x3fcf2220 0x4205e754:0x3fcf2270
  #0  0x403777ba in panic_abort at /home/runner/work/esp32-arduino-lib-builder/esp32-arduino-lib-builder/esp-idf/components/esp_system/panic.c:408
  #1  0x4037ab95 in esp_system_abort at /home/runner/work/esp32-arduino-lib-builder/esp32-arduino-lib-builder/esp-idf/components/esp_system/esp_system.c:137
  #2  0x4038058d in abort at /home/runner/work/esp32-arduino-lib-builder/esp32-arduino-lib-builder/esp-idf/components/newlib/abort.c:46
  #3  0x4037ab8b in _esp_error_check_failed at /home/runner/work/esp32-arduino-lib-builder/esp32-arduino-lib-builder/esp-idf/components/esp_system/esp_err.c:43
  #4  0x42002afb in switchToApplicationMode() at lib/storage/storage.cpp:117 (discriminator 1)
  #5  0x42002b15 in usbStoppedCallback(void*, char const*, int, void*) at lib/storage/storage.cpp:139
  #6  0x4205e6d5 in handler_execute at /home/runner/work/esp32-arduino-lib-builder/esp32-arduino-lib-builder/esp-idf/components/esp_event/esp_event.c:145
      (inlined by) esp_event_loop_run at /home/runner/work/esp32-arduino-lib-builder/esp32-arduino-lib-builder/esp-idf/components/esp_event/esp_event.c:598
  #7  0x4205e754 in esp_event_loop_run_task at /home/runner/work/esp32-arduino-lib-builder/esp32-arduino-lib-builder/esp-idf/components/esp_event/esp_event.c:115 (discriminator 15)
```
@dhebbeker
Merge branch 'feature/6-persistent-storage-for-configuration-and-task…
1c3f434 
…-information-2' into feature/6-persistent-storage-for-configuration-and-task-information-7
@dhebbeker
Add error checking when re-mounting FFat
44b02fb
@dhebbeker
Corrected the error handling for FFat.begin()
9640072 
That function returns `true` on success.
@dhebbeker
Merge branch 'feature/6-persistent-storage-for-configuration-and-task…
7585737 
…-information-8' into feature/6-persistent-storage-for-configuration-and-task-information-7
@dhebbeker
Define fileSystemState separate for more clarity.
64cc314
@dhebbeker
Enable C++17
432cffe
@dhebbeker
WIP: Define manager for file system state
cea6d8b
@dhebbeker
WIP: Define manager for file system state
f22611a
@dhebbeker
WIP: Define manager for file system state
b39d476
@dhebbeker
Testing Storage: OK
3a2b088
@dhebbeker
Simplify interface; inline FileSystemSwitcher
b7a0efd
@dhebbeker
Merge remote-tracking branch 'github/develop' into feature/6-persiste…
d8879fa 
…nt-storage-for-configuration-and-task-information-7
@dhebbeker
Remove unnecessary dependency to header
ceaddb1
@dhebbeker
Create stub headers for tests
fe06ec8
@dhebbeker
Add missing header inclusion
62d6f19
@dhebbeker
Defined some stubs as test doubles
f55b602
@dhebbeker
Fix header
5b15047
@dhebbeker
Exclude test code from documentation
25f4c14 
This cleans up the dependency graph
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@dhebbeker