-
Notifications
You must be signed in to change notification settings - Fork 616
Commit 1c0b63b
committed
Update base for Update on "Backend data separation test"
Add backend data separation test with demo ExecutorBackend.
Note: ExecutorBackend is a wrapper around a portable PTE file. It doesn't support delegated program-data separation in the sense of tagging tensors as external and placing them into the named data store as such. Rather, this test:
1. Creates a linear PTE file with data removed, using the portable flow.
2. Packages (1) into preprocessed blob as a delegate, using ExecutorBackend. Note: this discards the PTD portion.
3. Re-create the PTD portion via export_program (portable flow again).
4. Runs the delegated ExecutorBackend linear with portable linear.ptd file.
Caveat: this means that LinearModule definition in export_program and export_delegated_program must stay in sync, as we get the PTE artifact from export_delegated_program (wrapped in ExecutorBackend), and the PTD artifact from export_program.
Differential Revision: [D73679733](https://our.internmc.facebook.com/intern/diff/D73679733/)
[ghstack-poisoned]1 parent 806dfe3 commit 1c0b63bCopy full SHA for 1c0b63b
File tree
Expand file treeCollapse file tree
0 file changed
+0
-0
lines changedFilter options
Expand file treeCollapse file tree
0 file changed
+0
-0
lines changed
0 commit comments