Readme say folder2knowledge si available at npmjs - which it is not

[vpavlin]

The readme says you can just do npx folder2knowledge but the package does not exist on npmjs. Would be great if you could release it, or fix the readme:)

[bsnappy]

+1

error:
npm error code E404
npm error 404 Not Found - GET https://registry.npmjs.org/folder2knowledge - Not found
npm error 404
npm error 404 'folder2knowledge@*' is not in this registry.
npm error 404
npm error 404 Note that you can also install from a
npm error 404 tarball, folder, http url, or git url.

[abcfy2]

Same

[unicornlaunching]

same - is there a workaround for adding a knowledge base?

[bsnappy]

same - is there a workaround for adding a knowledge base?

Yes.

you can install as described in the readme:

npm install node scripts/folder2knowledge.js path/to/folder # path to your folder

[Doolitt]

same - is there a workaround for adding a knowledge base?

Yes.

you can install as described in the readme:

npm install node scripts/folder2knowledge.js path/to/folder # path to your folder

gitpod /workspace/eliza ((v0.1.7-alpha.1)) $ npm install node characterfile/scripts/folder2knowledge.js "C:\Users\XXX\Documents
YYYY"
npm error code ENOTDIR
npm error syscall open
npm error path /workspace/eliza/characterfile/scripts/folder2knowledge.js/package.json
npm error errno -20
npm error Could not read package.json: Error: ENOTDIR: not a directory, open '/workspace/eliza/characterfile/scripts/folder2knowledge.js/package.json

Could you help with this error?

[MadeWithCodeXYZ]

Try to execute npm install after you cloned the repo and before you try running npx folder2knowledge <path/to/folder> :)

[trojanMcAfee]

+1

None of the workarounds written here worked for me. I'm trying to parse a PDF file into knowledge.

[trojanMcAfee]

As another workaround that worked for me:

1.- Put folder2knowledge.js into the scripts dir.
2.- Added this to my package.json:

{
  "type": "module",
  "dependencies": {
    "@opendocsg/pdf2md": "latest",
    "pdfjs-dist": "latest",
    "dotenv": "latest"
  }
}

3.- Ran pnpm install @opendocsg/pdf2md pdfjs-dist dotenv.
4- Ran node scripts/folder2knowledge.js <path-to-folder> (without the trailing / at the end).

[tombueng]

You need to clone the characterfile-repo and install from there.

git clone https://github.com/elizaos/characterfile.git
cd characterfile
npm install -g
npx folder2knowledge ./folder

[divydovy]

Hmm I followed those steps exactly @tombueng and get:

(node:10889) ExperimentalWarning: CommonJS module /Users/davidlockie/.nvm/versions/node/v23.3.0/lib/node_modules/npm/node_modules/debug/src/node.js is loading ES Module /Users/davidlockie/.nvm/versions/node/v23.3.0/lib/node_modules/npm/node_modules/supports-color/index.js using require().
Support for loading ES Module in require() is an experimental feature and might change at any time
(Use node --trace-warnings ... to show where the warning was created)
node:internal/modules/cjs/loader:1239
const err = new Error(message);
^

Error: Cannot find module 'pdfjs-dist/legacy/build/pdf'
Require stack:

• /Users/davidlockie/Documents/Projects/Eliza Characterfile/characterfile/node_modules/@opendocsg/pdf2md/lib/util/pdf.js
• /Users/davidlockie/Documents/Projects/Eliza Characterfile/characterfile/node_modules/@opendocsg/pdf2md/lib/pdf2md.js
  at Function._resolveFilename (node:internal/modules/cjs/loader:1239:15)
  at Function._load (node:internal/modules/cjs/loader:1064:27)
  at TracingChannel.traceSync (node:diagnostics_channel:322:14)
  at wrapModuleLoad (node:internal/modules/cjs/loader:218:24)
  at Module.require (node:internal/modules/cjs/loader:1325:12)
  at require (node:internal/modules/helpers:136:16)
  at Object. (/Users/davidlockie/Documents/Projects/Eliza Characterfile/characterfile/node_modules/@opendocsg/pdf2md/lib/util/pdf.js:2:15)
  at Module._compile (node:internal/modules/cjs/loader:1546:14)
  at Object..js (node:internal/modules/cjs/loader:1698:10)
  at Module.load (node:internal/modules/cjs/loader:1303:32) {
  code: 'MODULE_NOT_FOUND',
  requireStack: [
  '/Users/davidlockie/Documents/Projects/Eliza Characterfile/characterfile/node_modules/@opendocsg/pdf2md/lib/util/pdf.js',
  '/Users/davidlockie/Documents/Projects/Eliza Characterfile/characterfile/node_modules/@opendocsg/pdf2md/lib/pdf2md.js'
  ]
  }

Node.js v23.3.0

[divydovy]

Hmm I followed those steps exactly @tombueng and get:

(node:10889) ExperimentalWarning: CommonJS module /Users/davidlockie/.nvm/versions/node/v23.3.0/lib/node_modules/npm/node_modules/debug/src/node.js is loading ES Module /Users/davidlockie/.nvm/versions/node/v23.3.0/lib/node_modules/npm/node_modules/supports-color/index.js using require().
Support for loading ES Module in require() is an experimental feature and might change at any time
(Use node --trace-warnings ... to show where the warning was created)
node:internal/modules/cjs/loader:1239
const err = new Error(message);
^

Error: Cannot find module 'pdfjs-dist/legacy/build/pdf'
Require stack:

• /Users/davidlockie/Documents/Projects/Eliza Characterfile/characterfile/node_modules/@opendocsg/pdf2md/lib/util/pdf.js
• /Users/davidlockie/Documents/Projects/Eliza Characterfile/characterfile/node_modules/@opendocsg/pdf2md/lib/pdf2md.js
  at Function._resolveFilename (node:internal/modules/cjs/loader:1239:15)
  at Function._load (node:internal/modules/cjs/loader:1064:27)
  at TracingChannel.traceSync (node:diagnostics_channel:322:14)
  at wrapModuleLoad (node:internal/modules/cjs/loader:218:24)
  at Module.require (node:internal/modules/cjs/loader:1325:12)
  at require (node:internal/modules/helpers:136:16)
  at Object. (/Users/davidlockie/Documents/Projects/Eliza Characterfile/characterfile/node_modules/@opendocsg/pdf2md/lib/util/pdf.js:2:15)
  at Module._compile (node:internal/modules/cjs/loader:1546:14)
  at Object..js (node:internal/modules/cjs/loader:1698:10)
  at Module.load (node:internal/modules/cjs/loader:1303:32) {
  code: 'MODULE_NOT_FOUND',
  requireStack: [
  '/Users/davidlockie/Documents/Projects/Eliza Characterfile/characterfile/node_modules/@opendocsg/pdf2md/lib/util/pdf.js',
  '/Users/davidlockie/Documents/Projects/Eliza Characterfile/characterfile/node_modules/@opendocsg/pdf2md/lib/pdf2md.js'
  ]
  }

Node.js v23.3.0

[PioBOR]

guys, were you able to figure this out? nothing works for me

[PioBOR]

For anyone interested. I found this solution...
Had to first install this: npm install @opendocsg/pdf2md@1.3.0 pdfjs-dist@2.16.105 dotenv@16.3.1
and then run: node characterfile/scripts/folder2knowledge.js </path/to/your/documents>

[suryanshkushwaha]

@PioBOR I tried your solution but it didn't work out for me