Skip to content

Manual Package Testing Protocol

Marc edited this page Feb 14, 2024 · 9 revisions

The following checklists describe the manual tests for the Khiops packages to execute upon release. Each step has variants specified as sub-bullets.

The result of each step should be report as

  • OK
  • Ok with warning:
    • It works but there is a strange behavior or popup
      • We should think of a warning to put in the installation guide or troubleshooting section
  • KO
    • Give the maximum context information to the developers to reproduce the problem

Windows

The checklist below should be performed on the following system combinations:

Versions:

  • Windows 10
  • Windows 11

Machine Types:

  • Personal/Home Machine
  • Orange IT's machines

Checklist

  • Check that the download link in https://khiops.org works correctly
    • with Chrome
    • with Edge
    • with Firefox
  • Execute the installer
    • by right clicking the installer and selecting "Execute as administrator"
    • by double clicking the installer exe (not equivalent when done with a normal user)
      • check that it is signed by Orange and not "Unknown Publisher"/"Editeur Inconnu"
  • Select the installation directory
    • the default C:\Program Files\khiops
    • one within the user home directory (ex: C:\Users\<USERNAME>\khiops)
    • another directory (ex: C:\Temp\khiops, C:\Applications\khiops)
  • Launch the Khiops applications
    • From the start menu
    • From the desktop icon
    • From the shortcut of the installation directory
  • Check the version and year date (ex: 2024) of the tool and in the documentation
    • From the application menu Help/About Khiops...
    • In the text documents available in the installation directory: LICENSE.txt, README.txt, WHATSNEW.txt
    • In the pdf documents available in doc sub-directory of the installation directory: guides and tutorial
  • Check in the application:
    • That the menu "Open Dictionary File..." opens in C:\Users\Public\khiops_data\samples
    • That Adult supervised analysis works fine
    • That the resulting AllReports.khj work fine with the Khiops Visualization
  • Uninstall the application
    • From the start menu
    • From the "Apps & Features"/"Applications et Fonctionnalités" pane in the settings
  • Check that the files were removed
    • The installation dir
    • The C:\Users\Public\khiops_data\samples directory
      • But that any user generated files in the above Adult analysis have not been removed
  • Install/Reinstall
    • Uninstall everything if necessary
    • Install once with whatever method
    • Install again
      • in the same directory
      • in another directory
    • Check that:
      • a popup saying that "Khiops is already installed" appears and accept.
      • when installing another directory the old was removed.

Linux

The checklist below should be performed on the following system combinations:

OS:

  • Ubuntu 20.04
  • Ubuntu 22.04
  • Rocky Linux 8
  • Rocky Linux 9

Checklist

  • Install with the proper method in each OS
  • Launch the Khiops applications
    • From the start menu
    • From the desktop icon (?)
  • Check in the application:
    • That the menu "Open Dictionary File..." opens in /usr/bin (?)
    • That Adult supervised analysis works fine
    • That the resulting AllReports.khj work fine with the Khiops Visualization
  • Uninstall the application
  • Check that the files were removed
    • MODL* khiops and khiops-env khiops-coclustering from /usr/bin
    • norm.jar, khiops.jar from TBD
Clone this wiki locally