Skip to content

Releases: linux-test-project/ltp

20250930

30 Sep 12:13
20250930
d2550ff

Choose a tag to compare

Good news everyone,

the Linux Test Project test suite stable release for September 2025 has been
released.

Since the last release 221 patches by 25 authors were merged.

Patch review is what most of the projects struggle with and LTP is no
different. If you can spare some effort helping with the patch review is more
than welcomed.

NOTABLE CHANGES

  • New tests

    • CVE-2025-21756 regression test for fcdd2242c023 ('vsock: Keep the binding until socket destruction')

    • CVE-2025-38236 regression test for 32ca245464e1 ('af_unix: Don't leave consecutive consumed OOB skbs')

    • file_attr[01-04] tests for file_getattr() and file_setattr() syscalls

    • clock_settime04 Tests that changing the CLOCK_REALTIME clock has no effect
      on a relative/absolute clock_nanosleep()

    • statmount09 that verifies that statmount() is correctly reading the mount
      ID for the current namespace

    • listxattr04 regression test for 8b0ba61df5a1 ('fs/xattr.c: fix simple_xattr_list to always include security.* xattrs')

    • ioctl_pidfd[01-06] tests for PIDFD_GET_INFO ioctl() and PIDFD_INFO_EXIT flag

    • mount08 regression test for d80b065bb172 ('proc: restrict overmounting of ephemeral entities')

    • unshare05 tests that unshare(CLONE_NEWPID) assign pid 1 to the first child

    • ioctl10 test for PROCMAP_QUERY ioctl()

    • landlock02 test for landlock ABI v6

    • landlock09 test for unix socket landlock sandboxing

    • landlock10 test for signal sandboxing

    • epoll_pwait06 regression test for d9ec73301099 ('fs/eventpoll: fix endless busy loop after timeout has expired')

    • lsm_get_self_attr[01-03] tests for lst_get_self_attr() syscall

    • lsm_list_modules[01-02] tests for lsm_list_modules() syscall

    • lsm_set_self_attr01 test for lsm_set_self_attr() syscall

  • Increased coverage

    • open13 now checks that more operations are failing with EBADF on O_PATH fd
      and also verifies that dup() preserves O_PATH flag
  • Rewritten and updated tests

    • open posix aio_cancel_7-1 was rewritten to trigger the tested condition reliably

    • mmap22 now uses mincore() to test MAP_DROPPABLE flag

    • open posix pthread_rwlock_rdlock now use PTHREAD_RWLOCK_PREFER_WRITER_NONRECURSIVE_NP
      on glibc to force POSIX mandated behavior

    • ioctl_loop01 and ioctl09 tests now use loop device instead of the backing
      úfile for partitioning

    • sched_football thread synchronization at the start was rewritten to make sure
      threads are started in the right order

  • Removed tests

    • eject command test

    • kdump testsuite which was unmaintained for nearly two decades

  • General smaller improvements

    • LTP kernel modules can now be build separately with 'make modules'

    • The new shell test library now support setup() and cleanup() functions

    • The concept of min_runtime was added to the test library, now tests that run
      for longer time can define min_runtime in order to make sure that the test
      actually runs for a reasonable runtime when test runtime is scaled down.

      For details see:
      81ba405 ('tst_test: Add min_runtime to control lower bound of scaled runtime')

    • Test library now properly translates MS_RDONLY flag for FUSE based mounts

    • The test metadata parser now correctly handles designed initializers

      Details in:
      375286f ('metaparse: Map arrays with designated initializers to JSON objects')

    • New LTP_QUIET environment variable was introduced, if set TINFO, TDEBUG and
      TCONF messages are suppresed. This can be combined with the previously
      introduced LTP_REPRODUCIBLE_OUTPUT to create shorter logs that are easier to
      compare between runs.

  • Kirk and ltx has been fixed and now works well together

    This marks a milestone in new LTP test runner development as we are nearing
    the vision we had for years. The ltx, which is minimalistic daemon that
    communicates over byte oriented connection, can be started on the system
    under test and kirk can connect to ltx from a machine that drives the testing
    and run tests in parallel using ltx.

    The documentation is sparse at the moment and kirk qemu SUT does not start
    ltx automatically. However if you want to feel adventurous and try ltx in a
    qemu virtual machine with communication over virtio with these steps:

    Manually start qemu virtual machine on a host:

    mkfifo ltx-io.in
    mkfifo ltx-io.out
    qemu- ... -chardev pipe,id=ltx-io,path=ltx-io -device virtserialport,chardev=ltx-io,name=ltx-io
    

    Start ltx inside of the guest:

    /opt/ltp/ltx -s /dev/virtio-ports/ltx-io
    

    And on a host use kirk to talk to ltx via the virtio serial:

    ./kirk --run-suite syscalls --sut ltx:infile=ltx-io.in:outfile=ltx-io.out
    

    Parallel run can be started by passing number of workers (-w N) to kirk.

    Similarily you can run ltx and kirk over real serial null modem between two
    machines.

    Next step that is already in queue is separation of communication channel and
    SUT definition in kirk. That will allow us to select different ways how kirk connects
    to SUT e.g. qemu while the SUT module will handle the power e.g. reboot.
    Hopefully that will happen in the next release and we will be finally removing the
    old and deprecated runltp next year.

  • Testers guide to the Linux Test Project was added into documentation:
    https://linux-test-project.readthedocs.io/en/latest/users/testers_guide.html

  • Documentation was written for test macros:
    https://linux-test-project.readthedocs.io/en/latest/developers/api_c_tests.html#test-macros

  • 52 testcases were converted to the new test library

  • The usual amount of fixes and cleanups

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20250930

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/test_case_tutorial.html

And our library API documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/api_c_tests.html

Patches, new tests, bugs, comments or questions should go to to our mailing
list at [email protected].

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20250530..

50  Andrea Cervesato <[email protected]>
50  Petr Vorel <[email protected]>
33  Ricardo B. Marlière <[email protected]>
16  Cyril Hrubis <[email protected]>
15  Li Wang <[email protected]>
14  Martin Doucha <[email protected]>
13  Wei Gao <[email protected]>
 5  Avinesh Kumar <[email protected]>
 4  Tiezhu Yang <[email protected]>
 3  Florian Schmaus <[email protected]>
 2  Amir Goldstein <[email protected]>
 2  Jack Morgan <[email protected]>
 2  Martin Cermak <[email protected]>
 1  Ben Copeland <[email protected]>
 1  Charles Shi <[email protected]>
 1  Jan Kara <[email protected]>
 1  Jan Polensky <[email protected]>
 1  Jan Stancek <[email protected]>
 1  Liheng Chen <[email protected]>
 1  Mark Wielaard <[email protected]>
 1  Mike Tipton via ltp <[email protected]>
 1  Tengda Wu <[email protected]>
 1  Xiao Yang <[email protected]>
 1  lufei <[email protected]>
 1  yang.zhang <[email protected]>

And also thanks to patch reviewers:

git log 20250530.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

97 Cyril Hrubis <[email protected]>
54 Petr Vorel <[email protected]>
48 Li Wang <[email protected]>
38 Andrea Cervesato <[email protected]>
11 Avinesh Kumar <[email protected]>
10 Wei Gao <[email protected]>
 4 Ricardo B. Marlière <[email protected]>
 3 Jan Stancek <[email protected]>
 2 Mimi Zohar <[email protected]>
 1 Pedro Falcato <[email protected]>
 1 Martin Doucha <[email protected]>
 1 Jan Kara <[email protected]>

20250530

30 May 08:12
20250530
14331e1

Choose a tag to compare

Good news everyone,

the Linux Test Project test suite stable release for May 2025 has been
released.

Since the last release 282 patches by 33 authors were merged.

Patch review is what most of the projects struggle with and LTP is no
different. If you can spare some effort helping with the patch review is more
than welcomed.

NOTABLE CHANGES

  • New tests

    • kvm_vmx01 test for emulated VMREAD/VMWRITE instructions
    • kvm_vmx02 test for Intel VMX virtualized APIC
    • flock07 test for EINTR error
    • move_mount03 test for mount beneath top mount
    • fanotify24 test for FAN_PRE_ACCESS and FAN_DENY_ERRNO
    • unshare03 check for EMFILE when unsharing fd would hit the limits
    • fcntl40 test fcntl F_CREATED_QUERY
    • ioctl_fiemap01 functionality test for fiemap ioctl()
    • unshare04 tests that unshare(CLONE_NEWNS) unshares CWD
    • mmap22 test for new MAP_DROPPABLE flag
  • Increased coverage

    • fanotify13 test case for FAN_DELETE_SELF
    • fanotify05 test reporting overflow event with FAN_REPORT_FD_ERROR
    • fanotify21 test reporting event with RDWR fd on RO mount
    • fanotify21 test reporting fd open errors with FAN_REPORT_FD_ERROR
    • flock02 test for EWOULDBLOCK errno
    • fchownat03 more tests for invalid inputs
    • fanotify14 test invalid init flags with permission and pre-content events
    • fanotify03 test cases for permission events on children
    • pause01 tests now for more signals not just EINTR
    • setrlimit06 test resource limit64 for process
  • Removed tests

    • The test_controllers.sh is now disabled when v2 hierarchy is present
    • A few old and broken tests were removed from test_controllers.sh
  • kirk was updated to version 2.1 see the release notes at:
    https://github.com/linux-test-project/kirk/releases

  • New test catalogue generated from test metadata is live at:
    https://linux-test-project.readthedocs.io/en/latest/users/test_catalog.html

  • We have a new metadata extractor for a shell and first test that is parsed:
    https://linux-test-project.readthedocs.io/en/latest/users/test_catalog.html#vma05-sh

  • A few tests have been fixed not to be miscompiled by gcc-15

    • we had problems with changes in structure zero initializations where
      suddenly anonymous unions were not zero initialized anymore
    • and also with optimzer changes that now remove malloc() + free() pairs
      if the memmory is no touched between the calls
  • The tst_brk() behavior has finally been clarified and fixed, for details see
    LTP commit a1f8270 ("lib/tst_test.c: Fix tst_brk() handling").

  • New library test now have reproducible output that leaves out data that
    change between runs from the output, it's enabled with setting env variable
    LTP_REPRODUCIBLE_OUTPUT=1

  • Our github CI is now connected to patchwork and runs LTP
    compilation tests for patches:

    https://patchwork.ozlabs.org/project/ltp/list/

  • The LTP_SINGLE_FS_TYPE now honors test specific filesystem skiplists and thus
    can be used for general testing. There is new variable
    TST_FORCE_SINGLE_FS_TYPE that ignores skiplists and is supposed to be used
    for test development (which was previously the case for LTP_SINGLE_FS_TYPE).

  • The ipc runtest file that cointained only pipeio test was merged into
    syscalls runtest file

  • The horrible mess in testcases/kernel/mem/lib/ library was untangled into
    smaller pieces

  • 43 testcases were converted to the new test library

  • The usual amount of fixes and cleanups

NOTABLE CHANGES IN IMA TESTS

brought to you by Petr Vorel

  • Add support to load predefined example IMA policy with LTP_IMA_LOAD_POLICY=1
    environment variable.

    This allows to run tests which are otherwise skipped due required policy not
    being loaded. SUT should be rebooted after each IMA tests (unless
    CONFIG_IMA_WRITE_POLICY=y` the policy can be written only once or policies
    can influence each other).

  • Added additional ToMToU and open-writer violation tests (new in kernel v6.14)

  • IMA: Allow to disable LSM warnings and use it for IMA (avoid misleading warnings)

  • Add some example IMA policies

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20250530

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/test_case_tutorial.html

And our library API documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/api_c_tests.html

Patches, new tests, bugs, comments or questions should go to to our mailing
list at [email protected].

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20250130..

80  Petr Vorel <[email protected]>
25  Cyril Hrubis <[email protected]>
24  Ricardo B. Marlière <[email protected]>
22  Martin Doucha <[email protected]>
21  Andrea Cervesato <[email protected]>
17  Ma Xinjian via ltp <[email protected]>
14  Li Wang <[email protected]>
13  Amir Goldstein <[email protected]>
11  Xinjian Ma (Fujitsu) <[email protected]>
10  Jan Stancek <[email protected]>
10  Wei Gao <[email protected]>
 5  Mimi Zohar <[email protected]>
 4  Shiyang Ruan <[email protected]>
 3  Avinesh Kumar <[email protected]>
 3  Jeff Moyer <[email protected]>
 2  Edward Liaw <[email protected]>
 2  lufei <[email protected]>
 1  Ajay Kaher <[email protected]>
 1  Binh Hoang <[email protected]>
 1  Dan Carpenter <[email protected]>
 1  Jan Polensky <[email protected]>
 1  Jin Guojie <[email protected]>
 1  John Morin <[email protected]>
 1  Li Xiaosong <[email protected]>
 1  Luiz Capitulino <[email protected]>
 1  Ross Burton <[email protected]>
 1  Siddhesh Poyarekar <[email protected]>
 1  Stuart R. Anderson <[email protected]>
 1  T.J. Mercier <[email protected]>
 1  Xiao Liang <[email protected]>
 1  Zhao Mengmeng <[email protected]>
 1  dy455990 <[email protected]>
 1  wangxuewen <[email protected]>

And also thanks to patch reviewers:

git log 20250130.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

108 Petr Vorel <[email protected]>
 71 Andrea Cervesato <[email protected]>
 62 Cyril Hrubis <[email protected]>
 53 Li Wang <[email protected]>
 11 Mimi Zohar <[email protected]>
  9 Martin Doucha <[email protected]>
  7 Jan Stancek <[email protected]>
  7 Ricardo B. Marlière <[email protected]>
  6 Jan Kara <[email protected]>
  5 Avinesh Kumar <[email protected]>

LTP 20250130

30 Jan 19:14
20250130
a7c31df

Choose a tag to compare

NOTABLE CHANGES

  • New tests

    • madvise12 Tests that MADV_GUARD_INSTALL is causing SIGSEGV on access.
    • fsplough A test that checks data integrity between reads and writes for a file.
    • landlock08 Test for landlock bind()/connect().
    • hugemmap34 Tests that kernel handles properly when stack grows into a
      hugepage segment.
    • rt_sigqueueinfo02 Tests for rt_sigqueueinfo() errors.
    • listmount04 Tests for listmout() errors.
    • listmount03 Test for EPERM on inaccesible mount point.
    • listmount02 Test for group mount IDs.
    • listmount01 Test for LSMT_ROOT.
    • statmount08 Test for EPERM on inaccesible mount point.
    • statmount07 Tests for statmount() errors.
    • statmount06 Test for STATMOUNT_FS_TYPE.
    • statmount05 Test for STATMOUNT_VFS_ROOT and STATMOUNT_MNT_POINT.
    • statmount04 Test for STATMOUNT_PROPAGATE_FROM.
    • statmount03 Test for STATMOUNT_MNT_BASIC.
    • statmount02 Test for STATMOUNT_MNT_BASIC.
    • statmount01 Test for statmount() without any flags.
    • ioctl_ficlone01 Basic test for FICLONE ioctl().
    • ioctl_ficlone02 Test for EOPNOTSUPP for usupported FS.
    • ioctl_ficlone03 Tests for FICLONE errors.
    • ioctl_ficlonerange01 Basic test for FICLONERANGE ioctl().
    • ioctl_ficlonerange02 Tests for FICLONERANGE errors.
  • Increased coverage

    • getrandom05 Tests the getrandom() syscall along with the VDSO implementation.
    • landlock02 Adds landlock network coverage.
  • The failure hits (possible missing kernel patches) are now disabled until the
    test library finishes intialization. This is because if we fail to set up the
    test environment we haven't had a chance to reproduce the bug.

  • The test library now supports per filesystem mkfs options, mount flags and
    min_kver. This is immediatelly used by FICLONE and FICLONERANGE tests since
    the support for different filesystems was added into different kernel versions.

  • Rewritten tests

    • both pty01 and ptem01 test were cleaned up and split into several tests
    • vma05.sh is a first test rewritten to the new shell test library
    • process_madvise01 now runs in memory cgroup, where we can properly control
      memory pressure.
    • fanotify10 Now drops cache three times to make sure inode is evicted, if
      the test stil fails in certain setups, please let us know.
  • Removed tests

    • logrotate_tests.sh Since logrotate has it's own testsuite it's pointless to
      keep the broken LTP test.
  • Changes in test runtime and timeout handling

    • the runtime and timeout values are now tracked separately
    • runtime is now the time limit for a loop in the main test function
    • timeout is now an safety upper limit for the test execution
    • both values are per test iteration (e.g. for a single filesystem)
    • the LTP_TIMEOUT_MUL now multiplies the safety limit
    • the LTP_RUNTIME_MUL now multiplies for how long certain test will run
    • selected (debug) kernel CONFIG_ options, if enabled now, multiply the
      test timeouts
    • many testcases that run >= 1s on a slow reference hardware (RPi zero) were
      annotated with a proper timeout
    • generally the timeout handling should just work fine (tm) without any
      user adjustenments
  • Couple of fixes were applied to the test metadata extractor
    so the data in ltp.json file are now more useful

  • The syscall number fallback definitions are now automatically generated from
    kernel sources.

  • 20 testcases were converted to the new test library

  • The usual amount of fixes and cleanups

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • New nfs10.sh test data integrity over NFS (uses fsplough)
  • Removed old ftp01.sh

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20250130

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/test_case_tutorial.html

And our library API documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/api_c_tests.html

Patches, new tests, bugs, comments or questions should go to to our mailing
list at [email protected].

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20240930..

61  Petr Vorel <[email protected]>
59  Andrea Cervesato <[email protected]>
29  Cyril Hrubis <[email protected]>
18  Xinjian Ma (Fujitsu) <[email protected]>
12  Li Wang <[email protected]>
11  Martin Doucha <[email protected]>
 8  Jan Stancek <[email protected]>
 6  Ricardo B. Marliere <[email protected]>
 5  Wei Gao <[email protected]>
 3  Attila Fazekas <[email protected]>
 3  David Hildenbrand <[email protected]>
 3  lufei <[email protected]>
 2  Avinesh Kumar <[email protected]>
 2  Edward Liaw <[email protected]>
 2  Li Zhijian <[email protected]>
 2  Ma Xinjian via ltp <[email protected]>
 2  Po-Hsu Lin <[email protected]>
 1  Alessandro Carminati <[email protected]>
 1  Ian Whitfield <[email protected]>
 1  Khem Raj <[email protected]>
 1  Nathaniel Manista <[email protected]>
 1  Samir Mulani <[email protected]>
 1  Sven Schnelle <[email protected]>
 1  Xiubo Li <[email protected]>
 1  Zizhi Wo <[email protected]>

And also thanks to patch reviewers:

git log 20240930.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

107 Petr Vorel <[email protected]>
 86 Cyril Hrubis <[email protected]>
 31 Li Wang <[email protected]>
 12 Andrea Cervesato <[email protected]>
 11 Wei Gao <[email protected]>
  9 Jan Stancek <[email protected]>
  7 Avinesh Kumar <[email protected]>
  3 Po-Hsu Lin <[email protected]>
  2 Martin Doucha <[email protected]>
  2 Jan Kara <[email protected]>
  1 Mimi Zohar <[email protected]>
  1 Chuck Lever <[email protected]>

LTP 20240930

30 Sep 10:48
20240930
60f8141

Choose a tag to compare

NOTABLE CHANGES

  • New tests

    • chown09 regression test for 5d1f903f75a8 ("attr: block mode changes of symlinks")
    • request_key06 Negative tests for request_key() syscall
    • signalfd02 Negative tests for signalfd() syscall
    • mseal02 Negative tests for mseal() syscall
    • hugeshmget06 A hugepage shm test
    • landlock07 Landlock Houdini reproducer aka CVE-2024-42318
    • getcpu02 Negative tests for getcpu() syscall
    • landlock06 Tests for LANDLOCK_ACCESS_FS_IOCTL_DEV
    • landlock05 Tests for LONDLOCK_ACCESS_FS_REFER
    • landlock04 Tests that syscalls are enabled/disable accordingly to the ruleset
    • landlock03 Negative tests for landlock_restrict_self() syscall
    • landlock02 Negative tests for landlock_add_rule() syscall
    • landlock01 Negative tests for landlock_create_ruleset() syscall
    • mseal01 Tests that memory is protected from being changed after it's sealed
    • fchmodat2_02 Negative tests for fchmodat2()
    • fchmodat2_01 Tests for AT_SYMLINK_NOFOLLOW for fchmodat2()
    • cachestat04 Checks that cachestat() syscall either reports EBADF or zeroed
      statistics on all kinds of unsupported fds
    • cachestat03 Negative tests for cachestat() syscall
    • cachestat02 Basic cachestat tests with fd pointing to shared memory
    • cachestat01 Basic cachestat tests for regular files
    • shutdown01 Basic shutdown tests
    • shutdown02 Negative tests for shutdown() sycall
  • The symlink01 mess is being split into separate testcases

    • open15 A test that open() syscall works correctly with symlinks
    • lstat03 A basic lstat() test.
    • rename15 Tests that rename works correctly with symlinks
    • chmod08 Tests that chmod() works correctly with symlinks
  • Increased coverage

    • readdir and getdents tests were enabled to run on all supported filesystems
      after we found that bcachefs had sublty broken implementation
    • gedent02 Adds more negative tests
    • timer_settime01 Now checks for premature timer expiration as well
    • pkey01 Now includes tests for PKEY_DISABLE_EXECUTE
    • request_key01 Added more negative tests
    • acct02 Added more negative tests
    • prctl04 has been renamed to seccomp01 and now covers also the seccomp()
      syscall along with the older prctl(PR_SET_SECCOMP) calls
    • msync04 now uses direct I/O to verify that data have been written to disk
  • Rewritten tests

    • fork05 was rewritten and correctly reports TCONF on non i386 hardware
    • fcnt14 a file locking test was rewriten to generate subtests at runtime
    • sched_starvation now autocallibrates expected runtime based on CPU speed
    • sched_footbal was rewritten and is now executed as part of the sched
      runtest file
  • The test library now supports specifying mkfs and mount options per a
    filesystem

  • Bunch of checks for kernels older than 4.4 were removed from the tests since
    the currently minimal kernel version LTP supports is 4.4

  • We have a new shell test library that:

    • makes shell code seamlessly interoperable with C
    • reuses most of the C test library
    • makes use shared memory to report test results
    • there are currently no tests using this library, we will start rewriting
      existing tests after the release
  • 3 testcases were converted to the new test library

  • The usual amount of fixes and cleanups

REMOVED SCRIPTS AND FILES

  • Removed old and outdated man pages.

  • Removed ltpmenu an legacy script that was unmaintained for a decade.

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • nfsstat02.sh new test for per-NS NFS client statistics
    (checks that /proc/net/rpc/nfs exists in nested network namespaces)

  • nfsstat01.sh read client stats from netns rhost
    (fix for kernel 6.9, backported up to 5.10 so far)

  • nfs02.sh Added subtest for O_DIRECT

KIRK

  • Kirk has been update to 1.4
  • Kirk can now be installed from pypi

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20240930

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/test_case_tutorial.html

And our library API documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/api_c_tests.html

Patches, new tests, bugs, comments or questions should go to to our mailing
list at [email protected].

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20240524..

93  Petr Vorel <[email protected]>
58  Andrea Cervesato <[email protected]>
22  Xinjian Ma (Fujitsu) <[email protected]>
17  Martin Doucha <[email protected]>
15  Cyril Hrubis <[email protected]>
15  Li Wang <[email protected]>
 7  Wei Gao <[email protected]>
 6  John Stultz <[email protected]>
 3  Andreas Schwab <[email protected]>
 3  Edward Liaw <[email protected]>
 3  Jan Stancek <[email protected]>
 3  Xiao Yang <[email protected]>
 2  Jiwei Sun <[email protected]>
 2  Po-Hsu Lin <[email protected]>
 1  Ajay Kaher <[email protected]>
 1  Avinesh Kumar <[email protected]>
 1  Chen Haonan <[email protected]>
 1  Chuck Lever <[email protected]>
 1  Haifeng Xu <[email protected]>
 1  Jingyi Song <[email protected]>
 1  Kuan-Ying Lee <[email protected]>
 1  Li Xiaosong <[email protected]>
 1  Madadi Vineeth Reddy <[email protected]>
 1  Nirjhar Roy <[email protected]>
 1  Remi Peuvergne <[email protected]>
 1  Sachin P Bappalige <[email protected]>
 1  Shizhao Chen <[email protected]>
 1  Yiwei Lin <[email protected]>
 1  Zizhi Wo <[email protected]>
 1  lufei <[email protected]>

And also thanks to patch reviewers:

git log 20240524.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

 87 Petr Vorel <[email protected]>
 87 Cyril Hrubis <[email protected]>
 77 Li Wang <[email protected]>
 28 Avinesh Kumar <[email protected]>
 13 Andrea Cervesato <[email protected]>
  4 Martin Doucha <[email protected]>
  3 Wei Gao <[email protected]>
  3 Richard Palethorpe <[email protected]>
  3 Jan Stancek <[email protected]>
  3 Jan Kara <[email protected]>
  2 Adrian Huang <[email protected]>
  1 Po-Hsu Lin <[email protected]>
  1 Amir Goldstein <[email protected]>

LTP 20240524

24 May 12:08
20240524
8f21ebb

Choose a tag to compare

NOTABLE CHANGES

  • New tests

    • mlock05 Test for pre-faulting locked memory
    • kvm_svm04 Functional test for VMSAVE/VMLOAD instructions
    • arch_prctl01 Test for ARCH_SET_CPUID and ARCH_GET_CPUID
    • kallsyms A test to check that it's impossible to read kernel memory from userspace
    • unlink09 Negative tests for unlink()
    • getrandom05 Negative tests for getrandom()
    • gethostname02 Negative tests for gethostname()
    • splice08 Test for splicing from /dev/zero and /dev/full
    • splice09 Test for splicing to /dev/zero and /dev/null
    • shmat04 A regression test for fc0c8f9089c2
      ("mm, mmap: fix vma_merge() case 7 with vma_ops->close")
    • aslr01 Tests that hugepages, that cause addesses to be aligned to higher
      order of 2, are not used for libraries when ASLR is enabled.
  • Increased coverage

    • getsockname01 More negative testcases
    • getsockopt01 More negative testcases
    • bind01 More negative testcases
    • swapon01 Runs on all supported filesystems now
    • waitpid01 Tests all deadly signals now
    • fanotify01 Tests setting two marks on different filesystems
  • Rewritten tests

    • msgstress testcases were rewritten into a single msgstress01 test
      this should finally fix the test to scale well from small embedded boards
      towards big servers

    • symlink01 has been split into several testcases, previously several different
      testcases were build from the source based on different messy ifdefs

  • UCLINUX support was completely removed from LTP

    It was unmaintained and partially broken and nobody stepped up to maintain
    the support.

  • Small runtest files cleanup

    • runtest/io was merged into ltp-aiodio.part4
    • runtest/cap_bounds and runtest/filecaps were merged into single runtest file
  • 32 testcases were converted to the new test library

  • The usual amount of fixes and cleanups

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • New tests

    • nfs09 Regression test for file truncation on NFS.
  • Increased coverage

    • nfsstat01.sh: Add support for NFSv4*
  • Removed tests

    • clockdiff01.sh Testing clockdiff is not relevant nowadays.
    • telnet01.sh Testing telnet not make sense nowadays, remove it.
    • xinetd_tests.sh Testing xinetd is not relevant nowadays.
    • host01.sh The test does not work in all cases since testing host require
      proper DNS setup or internet connection. Rather than fixing this
      it makes sense to remove the test.

New documentation

We have finally started working on a comprehensive documentation for LTP and
it's test library, the current state can be seen at:

https://linux-test-project.readthedocs.io/en/latest/

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20240524

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/test_case_tutorial.html

And our library API documentation at:

https://linux-test-project.readthedocs.io/en/latest/developers/api_c_tests.html

Patches, new tests, bugs, comments or questions should go to to our mailing
list at [email protected].

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20240129..

140  Petr Vorel <[email protected]>
22  Martin Doucha <[email protected]>
25  Yang Xu <[email protected]>
21  Li Wang <[email protected]>
16  Andrea Cervesato <[email protected]>
15  Andrea Manzini <[email protected]>
14  Wei Gao <[email protected]>
10  Cyril Hrubis <[email protected]>
 5  Avinesh Kumar <[email protected]>
 2  Detlef Riekenberg <[email protected]>
 2  Edward Liaw <[email protected]>
 4  Hui Min Mina Chou <[email protected]>
 2  lufei <[email protected]>
 1  Amir Goldstein <[email protected]>
 1  Dennis Brendel <[email protected]>
 1  Filippo Storniolo <[email protected]>
 1  Jan Stancek <[email protected]>
 1  Khem Raj <[email protected]>
 1  Mete Durlu <[email protected]>
 1  Murphy Zhou <[email protected]>
 1  Samasth Norway Ananda <[email protected]>
 1  Sebastian Chlad <[email protected]>
 1  Sergey Ulanov via ltp <[email protected]>
 1  Shiyang Ruan <[email protected]>
 1  Wenjie Xu <[email protected]>

And also thanks to patch reviewers:

git log 20240129.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

125 Petr Vorel <[email protected]>
  94 Cyril Hrubis <[email protected]>
  31 Li Wang <[email protected]>
  15 Andrea Cervesato <[email protected]>
  12 Martin Doucha <[email protected]>
  11 Avinesh Kumar <[email protected]>
   7 Jan Stancek <[email protected]>
   3 Marius Kittler <[email protected]>
   3 Jan Kara <[email protected]>
   2 Amir Goldstein <[email protected]>
   1 Wei Gao <[email protected]>
   1 Vlastimil Babka <[email protected]>
   1 Richard Palethorpe <[email protected]>
   1 Matt Bobrowski <[email protected]>
   1 Kent Overstreet <[email protected]>
   1 Joerg Vehlow <[email protected]>

LTP 20240129

29 Jan 17:20
20240129
68737d2

Choose a tag to compare

NOTABLE CHANGES

  • New tests

  • Increased coverage

    • ioctl02 cover more modern termios ioctls() as well.

    • fanotify13 More test coverage for overlayfs.

    • input* test now check UI_GET_NAME ioctl() too.

  • Removed tests

    • fork12 Which was a naive fork bomb test, we do have other tests
      (setrlimit01.c, ...) that better cover this scenario.

    • mongo test framework

      Which was test reiser, ext2 and jfs unmaintained for a decade.

    • simple_tracer.c Tracing test from 2009 that does not compile anymore.

    • runtest/fsx-linux This is consolidation of runtest files, since these test
      duplicated in ltp-aiodio.part3.

    • testscripts/autofs{1,4}.sh, testscripts/sysfs.sh,
      testscripts/ltp-scsi_debug.sh, testscripts/ltpdmmapper.sh

      These were unmaintained and unused scripts.

    • scsi/* A testsuite with a custom kernel module for kernel 2.5 that didn't
      compile cleanly for decades.

    • load_stress_all_kernel_modules.sh Broken for quite some time.

  • The LTP library now has a functions to iterate over different
    file descriptors. That allows us to easily implement more comprehensive tests
    that feed various syscalls all possible file descriptors and check that the
    syscall fails properly with invalid combinations. Most notable use of this
    library is the newly introduced splice07.c test.

  • The minimal size of the device for a few filesystem tests was increased to
    1GB because modern filesystems, most notably Btrfs does not work properly on
    smaller devices.

  • LTP now tests bcachefs if kernel support and bcache.mkfs is present

  • 30 testcases were converted to the new test library

  • The usual amount of fixes and cleanups

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

The performance tests in net.features can be now skipped by setting
LTP_NET_FEATURES_IGNORE_PERFORMANCE_FAILURE=1 which is useful when testing is
executed on VMs on a overloaded host or if we are running tests with a
background load.

KIRK (previously RUNLTP-NG)

Kirk was updated to v1.2

This version brings the following updates:

  • show both stdout and stderr when executing tests on host
  • support for external commands on different SUTs
  • warning message when SUT doesn't support parallel execution
  • more stable epoll() communication with LTX
  • minor fixes
  • updated documentation

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20240129

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines

https://github.com/linux-test-project/ltp/wiki/C-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API

https://github.com/linux-test-project/ltp/wiki/Shell-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial

https://github.com/linux-test-project/ltp/wiki/Build-System

Patches, new tests, bugs, comments or questions should go to to our mailing
list at [email protected].

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20230929..

147  Petr Vorel <[email protected]>
25  Yang Xu <[email protected]>
21  Andrea Cervesato <[email protected]>
18  Martin Doucha <[email protected]>
12  Cyril Hrubis <[email protected]>
11  Marius Kittler <[email protected]>
 8  Wei Gao <[email protected]>
 7  Amir Goldstein <[email protected]>
 7  Richard Palethorpe <[email protected]>
 6  Avinesh Kumar <[email protected]>
 6  Edward Liaw <[email protected]>
 6  Jan Kara <[email protected]>
 5  Jan Stancek <[email protected]>
 4  Hongchen Zhang <[email protected]>
 4  Kevin Brodsky <[email protected]>
 4  Xiao Yang <[email protected]>
 3  Shiyang Ruan <[email protected]>
 2  Li Wang <[email protected]>
 2  Li Zhijian <[email protected]>
 2  Pengfei Xu <[email protected]>
 2  Stefan Roesch <[email protected]>
 1  Alexander Kanavin <[email protected]>
 1  Brennan Ashton <[email protected]>
 1  Korobeynikov Gleb <[email protected]>
 1  Marcos Paulo de Souza <[email protected]>
 1  Mengchi Cheng <[email protected]>
 1  Murphy Zhou <[email protected]>
 1  Shizhao Chen <[email protected]>
 1  Shoukui Zhang <[email protected]>
 1  Subramanya Swamy <[email protected]>
 1  haopengxiang <[email protected]>
 1  nietingting <[email protected]>
 1  wangxuewen <[email protected]>
 1  ybonatakis <[email protected]>

And also thanks to patch reviewers:

git log 20230929.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

111 Petr Vorel <[email protected]>
 70 Cyril Hrubis <[email protected]>
 47 Li Wang <[email protected]>
 35 Richard Palethorpe <[email protected]>
 14 Martin Doucha <[email protected]>
  8 Amir Goldstein <[email protected]>
  7 Xiao Yang <[email protected]>
  7 Marius Kittler <[email protected]>
  6 Jan Kara <[email protected]>
  4 Avinesh Kumar <[email protected]>
  3 Andrea Cervesato <[email protected]>
  3 Jan Stancek <[email protected]>
  2 Yang Xu <[email protected]>
  1 Petr Vorel <[email protected]>
  1 Christian Brauner <[email protected]>

LTP 20230929

29 Sep 09:20
20230929
110d3be

Choose a tag to compare

NOTABLE CHANGES

  • New tests

    • epoll_wait07 for EPOLLONESHOT
    • epoll_wait06 for EPOLLET
    • epoll_wait05 for EPOLLRDHUP
    • process_madvise01 for MADV_PAGEOUT
    • faccessat201 basic faccessat2() test
    • faccessat202 checks that the syscall fails correctly
    • tcindex01 aka CVE-2023-1829
    • mremap06 reproducer for 7e7757876f25 ("mm/mremap: fix vm_pgoff in vma_merge() case 3")
    • starvation a simple test case for sched starvation https://lwn.net/ml/linux-kernel/[email protected]/
    • pipe14 for end-of-file (read() returns 0) in a case the write end is closed
    • statx12 basic test for STATX_ATTR_MOUNT_ROOT
    • kvm_svm03 KVM test for CPU lockup through malicous SVM guest
    • kvm_svm02 test that KVM correctly intercepts VMSAVE and VMLOAD instructions
      in a nested virtual machine aka CVE-2021-3656
    • statx11 a basic test for STATX_DIOALIGN on block device
    • statx10 a basic test for STATX_DIOALIGN on regular file
  • Increased coverage

    • fanotify13 added test variant for overalfs upper fs
    • mmap05 increased coverage for EINVAL
    • mmap06 increased coverage for EACCES
    • bind03 now includes regression test for
      c0c3b8d380a8 ("unix_bind_bsd(): unlink if we fail after successful mknod")
    • stack_clash added test for mmap() minding gap
  • ebizzy benchmark counter increment races and overflows were fixed

  • A few more testcases were converted to guarded buffers
    that is data passed by pointer to kernel are immediatelly
    following a PROT_NONE page and followed by canaries
    to catch off-by-one errors

  • Tests that modprobe kernel modules are now skipped when secure boot is
    enabled on x86 and ppc64le

  • ioprio tests now use IOPRIO_PRIO_NUM instead of hardcoded value
    to check for prio range

  • 35 testcases were converted to the new test library

    • we finally got rid of the old and messy libclone library
  • The usual amount of fixes and cleanups

KIRK (previously RUNLTP-NG)

  • The new runltp-ng version is now called kirk

  • There is now experimental LTX support implemented

    • Beware this is VERY EXPERIMENTAL at the moment
    • LTX is tiny binary that runs on system under test
    • LTX communicates with kirk over serial using messages packed in msgpack
    • LTX is going to be locked in memory and executed with realtime priority
    • LTX allows advanced features such as running tests in parallel
    • https://github.com/linux-test-project/ltx

REMOVED TESTS

  • mmap07 (included in mmap06)
  • setgroups04 (included in setgroups03)

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/YYYYMMDD

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines

https://github.com/linux-test-project/ltp/wiki/C-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API

https://github.com/linux-test-project/ltp/wiki/Shell-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial

https://github.com/linux-test-project/ltp/wiki/Build-System

Patches, new tests, bugs, comments or questions should go to to our mailing
list at [email protected].

CREDITS

Many thanks to the people contributing to this release:

$ git shortlog -s -e -n 20230516..
    71	Petr Vorel <[email protected]>
    32	Yang Xu <[email protected]>
    26	Avinesh Kumar <[email protected]>
    22	Andrea Cervesato <[email protected]>
    22	Martin Doucha <[email protected]>
    13	Cyril Hrubis <[email protected]>
    13	Li Wang <[email protected]>
     6	Wei Gao <[email protected]>
     5	Souta Kawahara <[email protected]>
     4	Amir Goldstein <[email protected]>
     4	Marius Kittler <[email protected]>
     3	Richard Palethorpe <[email protected]>
     3	Ci Zhou <[email protected]>
     2	Damien Le Moal <[email protected]>
     2	Jan Kara <[email protected]>
     2	Konstantin Khorenko <[email protected]>
     2	Min Li <[email protected]>
     2	Murphy Zhou <[email protected]>
     2	Vishal Chourasia <[email protected]>
     1	Ashwin Dayanand Kamat <[email protected]>
     1	Duncan.chu <[email protected]>
     1	Dylan Jhong <[email protected]>
     1	Edward Liaw <[email protected]>
     1	Hongchen Zhang <[email protected]>
     1	Jeff Layton <[email protected]>
     1	Leo Yu-Chi Liang <[email protected]>
     1	Nageswara R Sastry <[email protected]>
     1	Randolph <[email protected]>
     1	Rick Edgecombe <[email protected]>
     1	Shizhao Chen <[email protected]>
     1	Takuya Wakazono <[email protected]>
     1	Zachary Leaf <[email protected]>
     1	Li Qiang <[email protected]>
     1	Ioannis Bonatakis <[email protected]>

And also thanks to patch reviewers:

$ git log 20230516.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r
    104 Cyril Hrubis <[email protected]>
     66 Petr Vorel <[email protected]>
     46 Li Wang <[email protected]>
     15 Martin Doucha <[email protected]>
     14 Avinesh Kumar <[email protected]>
     14 Richard Palethorpe <[email protected]>
      8 Xiao Yang <[email protected]>
      3 Niklas Cassel <[email protected]>
      3 Marius Kittler <[email protected]>
      3 Damien Le Moal <[email protected]>
      2 Srikar Dronamraju <[email protected]>
      2 Shrikanth Hegde <[email protected]>
      2 Linus Walleij <[email protected]>
      2 Amir Goldstein <[email protected]>
      1 Yang Xu <[email protected]>
      1 Vlastimil Babka <[email protected]>
      1 Murphy Zhou <[email protected]>
      1 Jeff Moyer <[email protected]>
      1 Andrea Cervesato <[email protected]>

LTP 20230516

16 May 05:27
20230516
3ebc2df

Choose a tag to compare

NOTABLE CHANGES

  • New tests

    • kvm_svm01 aka CVE-2021-3653
    • cgroup_core03 test case for the cgroup kill
    • hugetlb32 regression test for:
      • ba9c1201beaa (mm/hugetlb: clear compound_nr before freeing gigantic pages)
      • a01f43901cfb (hugetlb: be sure to free demoted CMA pages to CMA)
    • mmap20 test for mmap() with MAP_SHARED_VALIDATE
    • mqnotify03 aka CVE-2021-38604
    • mprotect05 regression test for:
      • 2fcd07b7ccd5 (mm/mprotect: Fix successful vma_merge() of next in do_mprotect_pkey())
    • fsconfig03 aka CVE-2022-0185
    • madvise11 regression test for:
      • d4ae9916ea29 (mm: soft-offline: close the race against page allocation)
    • mount07 test case for MS_NOSYMFOLLOW
  • Increased coverage

    • NFS tests now run on btrfs, ext4 and xfs
    • setpgid were rewritten and increased coverage in a few corner cases
    • ioctl01 added more termios coverage
  • fs_fill test was fixed on 256+ CPUs

  • loongarch support was added

  • The usual amount of fixes and cleanups

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • NFS tests now run on btrfs, ext4, xfs
    (might be extended to more filesystems later)
  • nfs08.sh a new test for NFS cache invalidation

RUNLTP-NG

REMOVED TESTS

  • tomoyo testsuite which is maintained elsewhere by tomoyo devs

  • execltp script which was unmaintained for years

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20230516

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines

https://github.com/linux-test-project/ltp/wiki/C-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API

https://github.com/linux-test-project/ltp/wiki/Shell-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial

https://github.com/linux-test-project/ltp/wiki/Build-System

Patches, new tests, bugs, comments or questions should go to to our mailing
list at [email protected].

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20230127..

58  Petr Vorel <[email protected]>
20  Andrea Cervesato via ltp <[email protected]>
19  Yang Xu <[email protected]>
15  Martin Doucha <[email protected]>
11  Andrea Cervesato <[email protected]>
11  Edward Liaw <[email protected]>
10  Wei Gao <[email protected]>
 8  Avinesh Kumar <[email protected]>
 5  Cyril Hrubis <[email protected]>
 5  Teo Couprie Diaz <[email protected]>
 4  Li Wang <[email protected]>
 3  Hao Ge <[email protected]>
 3  Ping Fang <[email protected]>
 3  Richard Palethorpe <[email protected]>
 3  Tarun Sahu <[email protected]>
 2  Hao Zeng <[email protected]>
 2  Leo Yu-Chi Liang <[email protected]>
 2  Sowmya Indranna <[email protected]>
 1  Andrei Gherzan <[email protected]>
 1  Ashwin Dayanand Kamat via ltp <[email protected]>
 1  David Hildenbrand <[email protected]>
 1  Enze Li <[email protected]>
 1  Fabrice Fontaine <[email protected]>
 1  Frank He <[email protected]>
 1  Hui Min Mina Chou <[email protected]>
 1  Jan Stancek <[email protected]>
 1  Liam R. Howlett <[email protected]>
 1  Mahesh Kumar G <[email protected]>
 1  Nikita Yushchenko <[email protected]>
 1  Paulson Raja L <[email protected]>
 1  Seth Forshee (DigitalOcean) <[email protected]>
 1  Vignesh Raman <[email protected]>
 1  William Roche <[email protected]>

And also thanks to patch reviewers:

git log 20230127.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

 68 Cyril Hrubis <[email protected]>
 60 Petr Vorel <[email protected]>
 36 Richard Palethorpe <[email protected]>
 35 Li Wang <[email protected]>
  7 Jan Stancek <[email protected]>
  4 Avinesh Kumar <[email protected]>
  3 Yang Xu <[email protected]>
  2 Andrea Cervesato <[email protected]>
  1 Tetsuo Handa <[email protected]>

LTP 20230127

27 Jan 14:50
20230127
dd2d61a

Choose a tag to compare

NOTABLE CHANGES

  • New tests

    • 31 hugetlb tests were cleaned up and ported from libhugetlbfs
    • test for cve-2022-4378 /proc/sys/ files overflow on writing
    • cgroup_core02 regression test for e57457641613 aka CVE-2021-4197
    • dirtyc0w_shmem aka CVE-2022-2590
    • openat04 regression test for ac6800e279a2
    • nice05 basic functional test for nice()
    • madvise03 new test for MADV_DONTNEED
    • prctl10 basic test for PR_SET/GET_TSC
  • Increased coverage

    • mount03 add tests for MS_STRICTATIME, MS_NODIRATIME validate f_flags
    • getitimer01 add check for nonzero timer
    • setitimer01 add interval timer test
    • getitimer02 add ITIMER_VIRTUAL timer error check
    • madvise01 add tests for MADV_COLD and MADV_PAGEOUT
  • The minimal supported kernel version was raised to 3.10

    • LTP is no longer tested on older kernels
    • various checks for old kernels were removed from the test code
  • The AIO test cleanup was finished with rewrite of aiocp and aio-stress

  • LTP is now compiled with explicit -std=gnu99 which forces reasonably
    modern C even on oldest distributions we still have to support

  • LTP build system now forces LC_{COLLATE, NUMERIC}=C in order to have
    reproducible builds

  • 31 tests were cleaned up and converted for the new test API

  • The usual amount of fixes and cleanups

RUNLTP-NG

REMOVED TESTS

  • fs-bench which was broken beyond repair and not worth of keeping

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux
and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20230127

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer
documentation at:

https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines

https://github.com/linux-test-project/ltp/wiki/C-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API

https://github.com/linux-test-project/ltp/wiki/Shell-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial

https://github.com/linux-test-project/ltp/wiki/BuildSystem

Patches, new tests, bugs, comments or questions should go to to our mailing
list at [email protected].

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20220930..

50  Petr Vorel <[email protected]>
34  Yang Xu <[email protected]>
33  Tarun Sahu <[email protected]>
28  Avinesh Kumar <[email protected]>
21  Richard Palethorpe <[email protected]>
13  Martin Doucha <[email protected]>
15  Andrea Cervesato <[email protected]>
 9  Li Wang <[email protected]>
 9  Zhao Gongyi <[email protected]>
 6  Akihiko Odaki <[email protected]>
 6  David Hildenbrand <[email protected]>
 6  Jan Stancek <[email protected]>
 6  Tudor Cretu <[email protected]>
 6  Luo xiaoyu <[email protected]>
 4  Wei Gao <[email protected]>
 3  Edward Liaw via ltp <[email protected]>
 3  Jan Kara <[email protected]>
 2  Alessandro Carminati <[email protected]>
 2  Alex <[email protected]>
 2  Cyril Hrubis <[email protected]>
 2  Pengfei Xu <[email protected]>
 2  Rong Tao <[email protected]>
 2  Teo Couprie Diaz <[email protected]>     1  He Zhe <[email protected]>
 1  Huangjie Liao <[email protected]>
 1  Ilya Kurdyukov <[email protected]>
 1  Jie2x Zhou <[email protected]>
 1  Joerg Vehlow <[email protected]>
 1  Khem Raj <[email protected]>
 1  Murphy Zhou <[email protected]>
 1  Nikolaus Voss <[email protected]>
 1  Randolph <[email protected]>
 1  Sven Schnelle <[email protected]>
 1  Vitaly Chikunov <[email protected]>
 1  [email protected] <[email protected]>
 1  wangkaiyuan <[email protected]>
 1  zijunzhao <[email protected]>

And also thanks to patch reviewers:

git log 20220930.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

106 Richard Palethorpe <[email protected]>
 70 Petr Vorel <[email protected]>
 47 Cyril Hrubis <[email protected]>
 45 Li Wang <[email protected]>
 14 Yang Xu <[email protected]>
  7 Jan Stancek <[email protected]>
  8 Martin Doucha <[email protected]>
  3 Avinesh Kumar <[email protected]>
  2 Pengfei Xu <[email protected]>
  1 Richard Purdie <[email protected]>
  1 Khem Raj <[email protected]>
  1 Christian Brauner (Microsoft) <[email protected]>
  1 Chang S. Bae <[email protected]>
  1 Andrea Cervesato <[email protected]>
  1 Akihiko Odaki <[email protected]>

LTP 20220930

30 Sep 14:50
20220930
b763f81

Choose a tag to compare

NOTABLE CHANGES

  • New tests

  • Increased coverage

    • creat09 added test for another variant of the CVE-2018-13405
    • fanotify10 test for FAN_MARK_IGNORE with FAN_ONDIR
    • fanotify10 test for FAN_MARK_IGNORE with FAN_EVENT_ON_CHILD
    • fanotify09, fanotify14 add test cases for FAN_MARK_IGNORE
    • fanotify14 add test cases for events not allowed on non-dir
    • fanotify09 add test cases for merge of ignore mask
    • fanotify23 test for FAN_MARK_EVICTABLE
    • fanotify12 test for inotify mask flags IN_ONESHOT and IN_EXCL_UNLINK
    • futex_waitv01 test for EAGIN/ETIMEDOUT
    • mount_setattr01 basic functional test
  • Minimal filesystem size was increased from 256MB to 300MB in order to be able to format it with XFS (mkfs.xfs 5.19)

  • More testcaseses were made runtime aware + runtime fixes

  • Improvements in the shell test library

    • filesystem detection have been improved
    • added $TST_SKIP_FILESYSTEMS support to match C API
    • added $TST_ALL_FILESYSTEMS support to match C API
  • Improvements in open posix testsuite build and installation

  • Shell cgroup testcases were rewritten and cleaned up

  • 46 tests were rewritten to the new library

  • The usual amount of fixes and cleanups

WHAT IS IN THE QUEUE

  • Tracking of minimal device sizes per filesystem, which will allow to run test with smaller device sizes for a subset of filesystems

NOTABLE CHANGES IN NETWORK TESTS

brought to you by Petr Vorel

  • Removed old RPC tests: rup01.sh, rusers01.sh
  • Moved rpc01.sh and rpcinfo01.sh to runtest/net.rpc_tests and deleted runtest/net.rpc
  • The tst_net.sh library was fixed for cases when IPv6 was disabled
  • netns tests were rewritten to use tst_net.sh

DOWNLOAD AND LINKS

The latest version of the test-suite contains 3000+ tests for the Linux and can be downloaded at:

https://github.com/linux-test-project/ltp/releases/tag/20220930

The project pages as well as GIT repository are hosted on GitHub:

https://github.com/linux-test-project/ltp
http://linux-test-project.github.io/

If you ever wondered how to write a LTP testcase, don't miss our developer documentation at:

https://github.com/linux-test-project/ltp/wiki/Test-Writing-Guidelines

https://github.com/linux-test-project/ltp/wiki/C-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Network-API

https://github.com/linux-test-project/ltp/wiki/Shell-Test-API

https://github.com/linux-test-project/ltp/wiki/C-Test-Case-Tutorial

https://github.com/linux-test-project/ltp/wiki/BuildSystem

Patches, new tests, bugs, comments or questions should go to to our mailing list at [email protected].

CREDITS

Many thanks to the people contributing to this release:

git shortlog -s -e -n 20220527..

97  Petr Vorel <[email protected]>
50  Avinesh Kumar <[email protected]>
26  Martin Doucha <[email protected]>
22  Amir Goldstein <[email protected]>
19  Luke Nowakowski-Krijger <[email protected]>
12  Cyril Hrubis <[email protected]>
12  Yang Xu <[email protected]>
10  Andrea Cervesato <[email protected]>
10  Li Wang <[email protected]>
 9  Richard Palethorpe <[email protected]>
 7  Jan Stancek <[email protected]>
 6  Andrea Cervesato via ltp <[email protected]>
 6  Edward Liaw <[email protected]>
 5  Joerg Vehlow <[email protected]>
 5  Tudor Cretu <[email protected]>
 5  Zhao Gongyi <[email protected]>
 3  Dylan Jhong <[email protected]>
 2  Andrea Cervesato <[email protected]>
 2  Chen Hanxiao <[email protected]>
 2  Hongchen Zhang <[email protected]>
 2  Rong Tao <[email protected]>
 1  Bogdan Lezhepekov <[email protected]>
 1  Cristian Marussi <[email protected]>
 1  Huangjie Liao <[email protected]>
 1  Jan Kara <[email protected]>
 1  Jun Huang <[email protected]>
 1  Khem Raj <[email protected]>
 1  Leo Yu-Chi Liang <[email protected]>
 1  Luo xiaoyu <[email protected]>
 1  Ross Burton <[email protected]>
 1  Sharan Turlapati <[email protected]>
 1  Xiao Liang <[email protected]>
 1  Xiao Yang <[email protected]>
 1  Zhao Gongyi via ltp <[email protected]>

And also thanks to patch reviewers:

git log 20220527.. | grep -Ei '(reviewed|acked)-by:' | sed 's/.*by: //' | sort | uniq -c | sort -n -r

118 Petr Vorel <[email protected]>
114 Cyril Hrubis <[email protected]>
 77 Li Wang <[email protected]>
 65 Richard Palethorpe <[email protected]>
 18 Jan Kara <[email protected]>
 13 Martin Doucha <[email protected]>
  6 Yang Xu <[email protected]>
  5 Matthew Bobrowski <[email protected]>
  4 Amir Goldstein <[email protected]>
  2 Jan Stancek <[email protected]>
  1 Thomas Petazzoni <[email protected]>
  1 Joerg Vehlow <[email protected]>
  1 Christian Brauner (Microsoft) <[email protected]>
  1 Avinesh Kumar <[email protected]>