Problems installing in sandbox mode, and migration to Python 3

[papoteur-mga]

I'm trying to launch Patzilla in sandbox mode.
However, when I connect the page http://localhost:6543/navigator/ I get a blank page. In debug console, I found:

Uncaught Error: Module build failed (from /home/yves/patzilla/patzilla/node_modules/sass-loader/lib/loader.js):
Error: Missing binding /home/yves/patzilla/patzilla/node_modules/node-sass/vendor/linux-x64-83/binding.node
Node Sass could not find a binding for your current environment: Linux 64-bit with Node.js 14.x

Found bindings for the following environments:
  - Linux 64-bit with Node.js 11.x

This usually happens because your environment has changed since running `npm install`.
Run `npm rebuild node-sass` to download the binding for your current environment.

However, the file /home/yves/patzilla/patzilla/node_modules/node-sass/vendor/linux-x64-83/binding.node exists.
On Internet, I found multiple answer to rebuild node-sass module, but after tenth rebuild, I convinced that something else is the cause.
I have system node at version 14.25.3, thus I don't understand why it says Found bindings for the following environments: - Linux 64-bit with Node.js 11.x

[amotl]

Dear Yves,

thank you for writing in. The current version of PatZilla is a bit old, still building upon Python 2 and Node.js 11 ¹. I think you will only be successful with the corresponding software versions in your environment. However, on the Node.js side, it is pretty easy by using Supernode, as suggested.

On the other hand, I think it will also be time to finally provide OCI images for consumption. Let me know if you are not successful, then I can work on this.

With kind regards,
Andreas.

Footnotes

1. https://github.com/ip-tools/patzilla/blob/main/docs/install/sandbox.rst#javascript-sandbox ↩

[papoteur-mga]

Thanks Andreas for your quick answer.
My problem was that I got a mix between Python2 and Python3, with 2 virtualenv spaces, .venv and .venv2
Now, I go further.
But:

http://localhost:6543/static/assets/commons.bundle.js
[HTTP/1.1 404 Not Found 19ms]

I have not yet looked for a solution.
My idea is to add the summary export. But the Python3 migration is probably the first step.

[amotl]

Hi again,

feel free to keep this issue open until we've resolved the JavaScript woes.

[I get] 404 Not Found for /static/assets/commons.bundle.js.

Does running yarn build make any difference for you?

The Python3 migration is probably the first step.

That is dearly needed, right. Because PatZilla also lacked a comprehensive test suite, which will tremendously help with the migration, I started to write test cases a few months ago.

Also, there are a few branches which already made progress on the Python migration: There is the python3 branch, which has a few things, but there is also the peds branch, which is already running on Python 3, but only covers a certain amount of functionality I needed for a recent project.

I will try to get back to working on this, and look forward to catch some time for that in April.

With kind regards,
Andreas.

[papoteur-mga]

[I get] 404 Not Found for /static/assets/commons.bundle.js.

Does running yarn build make any difference for you?

Yes, it did !

The Python3 migration is probably the first step.

That is dearly needed, right. Because PatZilla also lacked a comprehensive test suite, which will tremendously help with the migration, I started to write test cases a few months ago.

Also, there are a few branches which already made progress on the Python migration: There is the python3 branch, which has a few things, but there is also the peds branch, which is already running on Python 3, but only covers a certain amount of functionality I needed for a recent project.

Interesting. I will have a look to these branches. I know Python, but not really the Web technology.

[papoteur-mga]

I still have this error.
I presume that this is linked to the MongoDB version.

Reason: pymongo.errors.OperationFailure: Unsupported OP_QUERY command: delete. The client driver may require an upgrade. For more details see https://dochub.mongodb.org/core/legacy-opcode-removal

I have the latest, 6.0.5

[amotl]

Dear Yves,

I can confirm the error you are observing with MongoDB 6. I will update the documentation and sandbox tooling to use a lower version. Thanks s stack for the report!

With kind regards,
Andreas.

[amotl]

Hi again,

I've just added cca06a9, which will use Docker to run MongoDB 5 when invoking make mongodb. Let me know if this helps, or if you can observe further problems.

With kind regards,
Andreas.

[amotl]

Hi Yves,

have you been lucky running PatZilla in sandbox mode with MongoDB 5? Otherwise, please let me know if you observe further errors.

With kind regards,
Andreas.

[papoteur-mga]

Hi Andreas,
I installed a version 4, and it works. I have not yet tried the version 5, however.
I'm working on the Python3 migration. I have already committed some of the fixes on my fork.
I try to have the tests to pass.
One of them is failing because USPTO. Is configuration and/or anthentication needed?

wget https://ppubs.uspto.gov/dirsearch-public/image-conversion/convert?url=us-pgpub/US/2014/0071/638/00000002.tif
--2023-03-24 18:08:43--  https://ppubs.uspto.gov/dirsearch-public/image-conversion/convert?url=us-pgpub/US/2014/0071/638/00000002.tif
Résolution de ppubs.uspto.gov (ppubs.uspto.gov)… 18.213.5.133, 54.152.196.200
Connexion à ppubs.uspto.gov (ppubs.uspto.gov)|18.213.5.133|:443… connecté.
requête HTTP transmise, en attente de la réponse… 403 Forbidden

[amotl]

Hi Yves,

USPTO tests are failing. Is configuration and/or anthentication needed?

I've recently also recognized the problem, it is about WAF blocking, see #61 (comment). So, I've just deactivated the USPTO-related tests with 5fa5107 without further ado.

I'm working on the Python3 migration. I have already committed some of the fixes on my fork. I try to have the tests to pass.

Sweet. Many thanks. Will you already take the other branches into consideration? Maybe I should rush them in first, and then you can rebase your work on top of that incrementally, and take care about the missing gaps?

With kind regards,
Andreas.

[amotl]

Please also see ¹ when working on the Python 3 migration, you will need it. I will see what I can do to wrap this into a package on PyPI, to make integration seamless again.

Footnotes

1. https://github.com/ip-tools/patzilla/issues/27#issuecomment-1100447994 ↩

[papoteur-mga]

For the migration, I started from the last state of the main branch, then applied the patches from the python3 branch.
Thus the last commits from the branch peds are not used, as I see that the first ones was already in the main branch.
Tests are quite in a good shape. I still have problems with ModuleNotFoundError: No module named '__builtin__' in mock component when calling tests/util/test_numbers_helper.py:21

I still have a problem that the tabs Desc, ... are not displayed. This is already the case with the Python2 state.
I had a look in the browser's console, there is no error in javascript, and I can see that data are collected, but not displayed. I don't know where to look at.