LTP test on LTS kernel

Current result

	CentOS-8.3	ubuntu-2004
5.4	Total tests 3886, Skipped 233, Failures 79	Total tests 3554, Skipped 223, Failures 106
5.10	Total tests 3887, Skipped 275, Failures 158

Skipped test cases

LTP has over 3800 test cases. Some test cases are not suitable for testing LTS kernel on Ampere platform, e.g:

• Test cases depending on architectures other than aarch64
• Not useful for server system

All test groups in ltp/runtest are added to ltp_cmdfile by default.

$ ls /opt/ltp/runtest/
can          cpuhotplug          fcntl-locktests  fsx             io_cd             ltp-aiodio.part3      net.features   net.rpc_tests          net_stress.ipsec_icmp  net.tcp_cmds                      pty               smoketest
cap_bounds   crashme             filecaps         hugetlb         io_floppy         ltp-aiodio.part4      net.ipv6       net.sctp               net_stress.ipsec_sctp  net.tirpc_tests                   s390x_tests       syscalls
commands     crypto              fs               hyperthreading  ipc               ltp-aio-stress.part1  net.ipv6_lib   net_stress.appl        net_stress.ipsec_tcp   nptl                              sched             syscalls-ipc
connectors   cve                 fs_bind          ima             kernel_misc       ltp-aio-stress.part2  net.multicast  net_stress.broken_ip   net_stress.ipsec_udp   numa                              scsi_debug.part1  tpm_tools
containers   dio                 fs_perms_simple  input           ltp-aiodio.part1  math                  net.nfs        net_stress.interface   net_stress.multicast   power_management_tests            securebits        tracing
controllers  dma_thread_diotest  fs_readonly      io              ltp-aiodio.part2  mm                    net.rpc        net_stress.ipsec_dccp  net_stress.route       power_management_tests_exclusive  smack             uevent

1. To skip individual test case:

Use https://github.com/AmpereComputing/ampere-lts-kernel/blob/main/tests/lkft/ltp/skipfile-lkft.yaml to control:

2. Skipped at ltp runtime

E.g: due to missing configurations, ltp test framework does not run the test. These test cases are counted in the LTP test result as Skipped, e.g: "Total tests 3554, Skipped 223, Failures 106"

3. Reason of skip tests

Test set	Why skipped	Comments
io_cd	Need cd media
io_floppy	Need floppy disk

Failed test cases

The cause for the failure is listed in: https://docs.google.com/spreadsheets/d/1kNXjuFW_OxsNXR1kxfbeIOhodwRRf8S8xdy0YSKD2l8/edit#gid=2004818483

To run the test

$ wget https://github.com/AmpereComputing/ampere-lts-kernel/archive/refs/heads/main.zip
$ unzip main.zip; cd ampere-lts-kernel-main/tests/
$ ./runall.sh <--- this will run both kernel-selftest and ltp. You can edit this script to run ltp only.