What do I need to do after converting the model

[bluemoon0321]

hello guys, I am new here.
I want to do a project using hls4ml to convert a nerual network, and eventually put it on PYNQ-Z2 to accelerate, so I decide to first test on a simple example to go through the whole process, including the convert part and the board part.
I think I have managed to install hls4ml and succesfully convert the example Keras_3layer by doing:

git clone https://github.com/hls-fpga-machine-learning/hls4ml.git
cd hls4ml
pip install .
cd example-models
hls4ml convert -c keras-config.yml

and then I got the directory : my-hls-test

I suppose that now I need to transfer these by the vivado tools onto my board?
something like the image below

but I am not sure is this the right thing to do or do I need to do something else first, or even did I do something wrong above.
Can someone tell me what should I do next or is there a tutorial about these steps that I can see.
And I also want to ask that as what I see, I need to install Tensorflow, QKears, etc before I can convert. However, the only thing I did is the steps above, but I think I still finish the convert. Is it because I install all these in the pip install .?

Thank you guys so much, I have been looking for answer all these days but still find nothing.

[bo3z]

Please check out the hls4ml tutorial: https://github.com/fastmachinelearning/hls4ml-tutorial, which covers the necessary steps to convert the model and also deploy it on hardware. Relavant parts in your case would be: 1, 2, 7 and perhaps 6 if you are working with CNNs. Part 7 explains how to deploy the model on hardware and view the Vivado project.

And yes, you're correct - all of these other ones are installed because they are marked as dependencies for hls4ml. Note, also, the command-line utility has been deprecated. The preferred method to use hls4ml is from the Python interface, as indicated on the tutorial.

[bluemoon0321]

sorry bo3z, I try to install vitis 2019.2 in my VM

but when I try to ./Xilinx_Unified_2019.2_1106_2127_Lin64.bin , an error occur with :

Verifying archive integrity... All good.
Uncompressing Xilinx Installer...............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGILL (0x4) at pc=0x00007a708585f1f4, pid=23224, tid=23433
#
# JRE version: Java(TM) SE Runtime Environment (9.0+11) (build 9.0.4+11)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (9.0.4+11, mixed mode, tiered, compressed oops, g1 gc, linux-amd64)
# Problematic frame:
# v  ~StubRoutines::sha512_implCompressMB
#
# Core dump will be written. Default location: Core dumps may be processed with "/usr/share/apport/apport -p%p -s%s -c%c -d%d -P%P -u%u -g%g -- %E" (or dumping to /tmp/selfgz23109/core.23224)
#
# An error report file with more information is saved as:
# /tmp/selfgz23109/hs_err_pid23224.log
Compiled method (c1)   24677 6885       1       sun.security.provider.SHA5::lf_maj (14 bytes)
 total in heap  [0x00007a708d83a290,0x00007a708d83a540] = 688
 relocation     [0x00007a708d83a400,0x00007a708d83a420] = 32
 main code      [0x00007a708d83a420,0x00007a708d83a480] = 96
 stub code      [0x00007a708d83a480,0x00007a708d83a510] = 144
 scopes data    [0x00007a708d83a510,0x00007a708d83a518] = 8
 scopes pcs     [0x00007a708d83a518,0x00007a708d83a538] = 32
 dependencies   [0x00007a708d83a538,0x00007a708d83a540] = 8
Could not load hsdis-amd64.so; library not loadable; PrintAssembly is disabled
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
#
./xsetup: line 72: 23224 Aborted                 (core dumped) ${X_JAVA_HOME}/bin/java ${ARGS} -splash:${root}/data/images/splash.png -jar ${root}/lib/classes/xinstaller.jar

is it because my ubuntu is 24.04?
And if I want to go through the tutorial, do I need to download a new version of vitis and a 2019.2 or 2020.1 version of vivado?
thank alot!

[bo3z]

I am not sure - best to look for this error on the AMD/Xilinx forums, as this is not an hls4ml issue.

You can always try installing a newer version of Vivado/Vitis suite, for example 2023.1/2023.2/2024.1. Most of the tutorials use Vits HLS (other than 7), which is available in all version since 2021.

[bluemoon0321]

ok i'll go check on it , Thank a lot again!

[bluemoon0321]

hello I finish installing vitis, but when I try to create the envirment in the tutorial by doing
conda env create -f environment.yml
, some error appear:

File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/lib/python3.10/site-packages/jupyter_contrib_core/notebook_compat/nbextensions.py", line 6, in <module>
    from notebook.extensions import BaseExtensionApp
ModuleNotFoundError: No module named 'notebook.extensions'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/lib/python3.10/site-packages/jupyter_contrib_core/notebook_compat/nbextensions.py", line 10, in <module>
    from notebook.nbextensions import BaseNBExtensionApp
ModuleNotFoundError: No module named 'notebook.nbextensions'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/lib/python3.10/site-packages/jupyter_contrib_core/notebook_compat/nbextensions.py", line 12, in <module>
    from ._compat.nbextensions import BaseNBExtensionApp
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/lib/python3.10/site-packages/jupyter_contrib_core/notebook_compat/_compat/nbextensions.py", line 35, in <module>
    from notebook.nbextensions import (
ModuleNotFoundError: No module named 'notebook.nbextensions'

| Traceback (most recent call last):
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/lib/python3.10/site-packages/jupyter_contrib_core/notebook_compat/nbextensions.py", line 6, in <module>
    from notebook.extensions import BaseExtensionApp
ModuleNotFoundError: No module named 'notebook.extensions'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/lib/python3.10/site-packages/jupyter_contrib_core/notebook_compat/nbextensions.py", line 10, in <module>
    from notebook.nbextensions import BaseNBExtensionApp
ModuleNotFoundError: No module named 'notebook.nbextensions'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/lib/python3.10/site-packages/jupyter_contrib_core/notebook_compat/nbextensions.py", line 12, in <module>
    from ._compat.nbextensions import BaseNBExtensionApp
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/lib/python3.10/site-packages/jupyter_contrib_core/notebook_compat/_compat/nbextensions.py", line 35, in <module>
    from notebook.nbextensions import (
ModuleNotFoundError: No module named 'notebook.nbextensions'

- Traceback (most recent call last):
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/bin/jupyter-nbextensions_configurator", line 6, in <module>
    from jupyter_nbextensions_configurator.application import main
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/lib/python3.10/site-packages/jupyter_nbextensions_configurator/__init__.py", line 18, in <module>
    from notebook.base.handlers import APIHandler, IPythonHandler
ModuleNotFoundError: No module named 'notebook.base'

- Traceback (most recent call last):
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/lib/python3.10/site-packages/jupyter_contrib_core/notebook_compat/nbextensions.py", line 6, in <module>
    from notebook.extensions import BaseExtensionApp
ModuleNotFoundError: No module named 'notebook.extensions'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/lib/python3.10/site-packages/jupyter_contrib_core/notebook_compat/nbextensions.py", line 10, in <module>
    from notebook.nbextensions import BaseNBExtensionApp
ModuleNotFoundError: No module named 'notebook.nbextensions'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/bin/jupyter-contrib-nbextension", line 6, in <module>
    from jupyter_contrib_nbextensions.application import main
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/lib/python3.10/site-packages/jupyter_contrib_nbextensions/application.py", line 7, in <module>
    from jupyter_contrib_core.notebook_compat.nbextensions import ArgumentConflict
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/lib/python3.10/site-packages/jupyter_contrib_core/notebook_compat/nbextensions.py", line 12, in <module>
    from ._compat.nbextensions import BaseNBExtensionApp
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/lib/python3.10/site-packages/jupyter_contrib_core/notebook_compat/_compat/nbextensions.py", line 35, in <module>
    from notebook.nbextensions import (
ModuleNotFoundError: No module named 'notebook.nbextensions'

done
ERROR conda.core.link:_execute(938): An error occurred while installing package 'conda-forge::jupyter_highlight_selected_word-0.2.0-py310hff52083_1005'.
Rolling back transaction: done

LinkError: post-link script failed for package conda-forge::jupyter_highlight_selected_word-0.2.0-py310hff52083_1005
location of failed script: /home/Bluemoon/miniconda3/envs/hls4ml-tutorial/bin/.jupyter_highlight_selected_word-post-link.sh
==> script messages <==
Traceback (most recent call last):
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/lib/python3.10/site-packages/jupyter_contrib_core/notebook_compat/nbextensions.py", line 6, in <module>
    from notebook.extensions import BaseExtensionApp
ModuleNotFoundError: No module named 'notebook.extensions'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/lib/python3.10/site-packages/jupyter_contrib_core/notebook_compat/nbextensions.py", line 10, in <module>
    from notebook.nbextensions import BaseNBExtensionApp
ModuleNotFoundError: No module named 'notebook.nbextensions'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/lib/python3.10/site-packages/jupyter_contrib_core/notebook_compat/nbextensions.py", line 12, in <module>
    from ._compat.nbextensions import BaseNBExtensionApp
  File "/home/Bluemoon/miniconda3/envs/hls4ml-tutorial/lib/python3.10/site-packages/jupyter_contrib_core/notebook_compat/_compat/nbextensions.py", line 35, in <module>
    from notebook.nbextensions import (
ModuleNotFoundError: No module named 'notebook.nbextensions'

==> script output <==
stdout:
stderr:
return code: 1

()

it seems like it is all because of not founding 'notebook.nbextensions' and 'notebook.base', if i try to just go on by
conda activate hls4ml-tutorial
source /path/to/your/installtion/Xilinx/Vitis_HLS/2024.2/settings64.sh
jupyter notebook
it will also appear wrong.
Did I need to do something else before creating the env?

[bo3z]

You could try installing/upgrading the pip package notebooks once inside the conda environment; that should do the trick
pip install --upgrade notebook