Skip to content

I am facing some issues installing naluwind with cuda support. #1384

@arasuadrian

Description

@arasuadrian

i am intalling naluwind on my Ubuntu workstation which has NVIDIA RTX 5090 GPU in it. When I try to install using the command "spack install nalu-wind@master +cuda cuda_arch=120 build_type=Release ^cuda@12.9 ^trilinos@master", it fails at installation of the Trilinos master. The error is as follows:
"==> Installing trilinos-master-nxtxya3t35qsnnycs3yht2yed5pevolc [51/52]
==> No patches needed for trilinos
==> trilinos: Executing phase: 'cmake'
==> trilinos: Executing phase: 'build'
==> Error: ProcessError: Command exited with status 2:
'/home/adrin/spack/opt/spack/linux-skylake/gmake-4.4.1-da2mzpdvbvnzxvuamfyinavkfiug6vb6/bin/make' '-j16'

13 errors found in build log:
6514 instantiation of class "fmt::v11::basic_string_view [with Char=char]" at line 1930
6515 instantiation of "auto fmt::v11::basic_format_args::get_id(fmt::v11::basic_string_view) const->int [with Context=fmt::v11::context, Char=char]" at li
ne 1970
6516
6517 Remark: The warnings can be suppressed with "-diag-suppress "
6518
6519 ld: ../../libraries/aprepro_lib/libaprepro_lib.a(apr_getline.cc.o): in function `(anonymous namespace)::gl_char_init()':

6520 tmpxft_00004cd6_00000000-6_apr_getline.cudafe1.cpp:(.text+0x82): undefined reference to tcgetattr' 6521 ld: ../../libraries/aprepro_lib/libaprepro_lib.a(apr_getline.cc.o): in function (anonymous namespace)::gl_error(char const*)':
6522 tmpxft_00004cd6_00000000-6_apr_getline.cudafe1.cpp:(.text+0x26b): undefined reference to tcsetattr' 6523 ld: ../../libraries/aprepro_lib/libaprepro_lib.a(apr_getline.cc.o): in function (anonymous namespace)::gl_init()':
6524 tmpxft_00004cd6_00000000-6_apr_getline.cudafe1.cpp:(.text+0x2e1): undefined reference to tcgetattr' 6525 ld: tmpxft_00004cd6_00000000-6_apr_getline.cudafe1.cpp:(.text+0x357): undefined reference to tcsetattr'
6526 ld: ../../libraries/aprepro_lib/libaprepro_lib.a(apr_getline.cc.o): in function (anonymous namespace)::gl_cleanup()': 6527 tmpxft_00004cd6_00000000-6_apr_getline.cudafe1.cpp:(.text+0x420): undefined reference to tcsetattr'
6528 ld: ../../libraries/aprepro_lib/libaprepro_lib.a(apr_getline.cc.o): in function SEAMS::getline_int(char const*)': 6529 tmpxft_00004cd6_00000000-6_apr_getline.cudafe1.cpp:(.text+0x29fc): undefined reference to tcsetattr'
6530 ld: tmpxft_00004cd6_00000000-6_apr_getline.cudafe1.cpp:(.text+0x2a11): undefined reference to tcsetattr' 6531 ld: tmpxft_00004cd6_00000000-6_apr_getline.cudafe1.cpp:(.text+0x2b28): undefined reference to tcsetattr'
6532 ld: ../../libraries/aprepro_lib/libaprepro_lib.a(apr_getline.cc.o):tmpxft_00004cd6_00000000-6_apr_getline.cudafe1.cpp:(.text+0xfc): more undefined references to tcsetattr' fol low 6533 ld: aprepro: hidden symbol tcgetattr' isn't defined
6534 ld: final link failed: bad value
6535 collect2: error: ld returned 1 exit status
6536 /home/adrin/spack/opt/spack/linux-skylake/openmpi-5.0.8-gp5jphbf6kel4lribwx7b33maxe4ubsf/bin/mpic++ -pedantic -Wall -Wno-long-long -Wwrite-strings -Wshadow -Woverloaded-virtua
l -Wno-inline -Wno-deprecated-declarations -O3 -DNDEBUG -Wl,--dependency-file=CMakeFiles/aprepro.dir/link.d CMakeFiles/aprepro.dir/aprepro.C.o -o aprepro -Wl,-rpath,/home/a
drin/spack/opt/spack/linux-skylake/netcdf-c-4.9.3-lbi5lqlwwu2db4w7a4uhuh4xh25lu3jf/lib:/home/adrin/spack/opt/spack/linux-skylake/hdf5-1.14.6-vkjizmn66jczuneep6dlbifkrky5hfbp/li
b:/home/adrin/spack/opt/spack/linux-skylake/parallel-netcdf-1.14.1-s6h3mrekmjr2bea75vixxhfr36oj5tfg/lib:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: ../../libraries/aprepro_lib/libaprepro_lib.a ../../libra
ries/exodus/libexodus.a /home/adrin/spack/opt/spack/linux-skylake/netcdf-c-4.9.3-lbi5lqlwwu2db4w7a4uhuh4xh25lu3jf/lib/libnetcdf.so /home/adrin/spack/opt/spack/linux-skylake/hdf
5-1.14.6-vkjizmn66jczuneep6dlbifkrky5hfbp/lib/libhdf5.so /home/adrin/spack/opt/spack/linux-skylake/parallel-netcdf-1.14.1-s6h3mrekmjr2bea75vixxhfr36oj5tfg/lib/libpnetcdf.so
6537 make[2]: *** [packages/seacas/applications/aprepro/CMakeFiles/aprepro.dir/build.make:109: packages/seacas/applications/aprepro/aprepro] Error 1
6538 make[2]: Leaving directory '/tmp/adrin/spack-stage/spack-stage-trilinos-master-nxtxya3t35qsnnycs3yht2yed5pevolc/spack-build-nxtxya3'
6539 make[1]: *** [CMakeFiles/Makefile2:9640: packages/seacas/applications/aprepro/CMakeFiles/aprepro.dir/all] Error 2
6540 make[1]: *** Waiting for unfinished jobs....
6541 [ 44%] Building CXX object packages/stk/stk_util/stk_util/util/CMakeFiles/stk_util_util.dir/CSet.cpp.o
6542 cd /tmp/adrin/spack-stage/spack-stage-trilinos-master-nxtxya3t35qsnnycs3yht2yed5pevolc/spack-build-nxtxya3/packages/stk/stk_util/stk_util/util && /home/adrin/spack/opt/spack/li
nux-skylake/openmpi-5.0.8-gp5jphbf6kel4lribwx7b33maxe4ubsf/bin/mpic++ -DKOKKOS_DEPENDENCE -I/tmp/adrin/spack-stage/spack-stage-trilinos-master-nxtxya3t35qsnnycs3yht2yed5pevolc/
spack-build-nxtxya3 -I/tmp/adrin/spack-stage/spack-stage-trilinos-master-nxtxya3t35qsnnycs3yht2yed5pevolc/spack-build-nxtxya3/packages/stk -I/tmp/adrin/spack-stage/spack-stage-
trilinos-master-nxtxya3t35qsnnycs3yht2yed5pevolc/spack-src/packages/stk/stk_util -I/tmp/adrin/spack-stage/spack-stage-trilinos-master-nxtxya3t35qsnnycs3yht2yed5pevolc/spack-src
/packages/seacas/libraries/aprepro_lib -I/tmp/adrin/spack-stage/spack-stage-trilinos-master-nxtxya3t35qsnnycs3yht2yed5pevolc/spack-src/packages/seacas/libraries/exodus/include
-I/tmp/adrin/spack-stage/spack-stage-trilinos-master-nxtxya3t35qsnnycs3yht2yed5pevolc/spack-build-nxtxya3/packages/seacas/libraries/exodus -isystem /home/adrin/spack/opt/spack/
linux-skylake/kokkos-4.6.02-io367k4gv5qvcvp7sr2nkydxrasphqhc/include -isystem /home/adrin/spack/opt/spack/linux-skylake/netcdf-c-4.9.3-lbi5lqlwwu2db4w7a4uhuh4xh25lu3jf/include
-isystem /home/adrin/spack/opt/spack/linux-skylake/hdf5-1.14.6-vkjizmn66jczuneep6dlbifkrky5hfbp/include -isystem /home/adrin/spack/opt/spack/linux-skylake/parallel-netcdf-1.14.
1-s6h3mrekmjr2bea75vixxhfr36oj5tfg/include -pedantic -Wall -Wno-long-long -Wwrite-strings -Wno-inline -Wno-deprecated-declarations -O3 -DNDEBUG -std=c++17 -march=skylake -mt
une=skylake --relocatable-device-code=true -extended-lambda -Wext-lambda-captures-this -arch=sm_120 -MD -MT packages/stk/stk_util/stk_util/util/CMakeFiles/stk_util_util.dir/CSe
t.cpp.o -MF CMakeFiles/stk_util_util.dir/CSet.cpp.o.d -o CMakeFiles/stk_util_util.dir/CSet.cpp.o -c /tmp/adrin/spack-stage/spack-stage-trilinos-master-nxtxya3t35qsnnycs3yht2yed
5pevolc/spack-src/packages/stk/stk_util/stk_util/util/CSet.cpp
6543 /tmp/adrin/spack-stage/spack-stage-trilinos-master-nxtxya3t35qsnnycs3yht2yed5pevolc/spack-src/packages/seacas/libraries/ioss/src/private_copy_fmt/fmt/base.h(472): warning #128-
D: loop is not reachable
6544 for (; n != 0; ++s1, ++s2, --n) {
6545 ^

 ...

 7447    cd /tmp/adrin/spack-stage/spack-stage-trilinos-master-nxtxya3t35qsnnycs3yht2yed5pevolc/spack-build-nxtxya3/packages/seacas/libraries/ioss/src && /home/adrin/spack/opt/spack/lin
         ux-skylake/cmake-3.31.8-bz47qqgn7bdbfl23fwars6olelgvx4ix/bin/cmake -E cmake_link_script CMakeFiles/Ioss.dir/link.txt --verbose=1
 7448    /usr/bin/ar qc libIoss.a CMakeFiles/Ioss.dir/Ioss_Assembly.C.o CMakeFiles/Ioss.dir/Ioss_Blob.C.o CMakeFiles/Ioss.dir/Ioss_ChainGenerator.C.o CMakeFiles/Ioss.dir/Ioss_ChangeSet.
         C.o CMakeFiles/Ioss.dir/Ioss_ChangeSetFactory.C.o CMakeFiles/Ioss.dir/Ioss_CommSet.C.o CMakeFiles/Ioss.dir/Ioss_Compare.C.o CMakeFiles/Ioss.dir/Ioss_ComposedVariableType.C.o CM
         akeFiles/Ioss.dir/Ioss_CompositeVariableType.C.o CMakeFiles/Ioss.dir/Ioss_ConcreteVariableType.C.o CMakeFiles/Ioss.dir/Ioss_ConstructedVariableType.C.o CMakeFiles/Ioss.dir/Ioss
         _CoordinateFrame.C.o CMakeFiles/Ioss.dir/Ioss_CopyDatabase.C.o CMakeFiles/Ioss.dir/Ioss_DatabaseIO.C.o CMakeFiles/Ioss.dir/Ioss_Decomposition.C.o CMakeFiles/Ioss.dir/Ioss_Decom
         positionUtils.C.o CMakeFiles/Ioss.dir/Ioss_DynamicTopologyBroker.C.o CMakeFiles/Ioss.dir/Ioss_DynamicTopologyFileControl.C.o CMakeFiles/Ioss.dir/Ioss_DynamicTopologyNotifier.C.
         o CMakeFiles/Ioss.dir/Ioss_DynamicTopologyObserver.C.o CMakeFiles/Ioss.dir/Ioss_DynamicTopologyStateLocator.C.o CMakeFiles/Ioss.dir/Ioss_EdgeBlock.C.o CMakeFiles/Ioss.dir/Ioss_
         EdgeSet.C.o CMakeFiles/Ioss.dir/Ioss_ElementBlock.C.o CMakeFiles/Ioss.dir/Ioss_ElementPermutation.C.o CMakeFiles/Ioss.dir/Ioss_ElementSet.C.o CMakeFiles/Ioss.dir/Ioss_ElementTo
         pology.C.o CMakeFiles/Ioss.dir/Ioss_EntityBlock.C.o CMakeFiles/Ioss.dir/Ioss_EntitySet.C.o CMakeFiles/Ioss.dir/Ioss_FaceBlock.C.o CMakeFiles/Ioss.dir/Ioss_FaceGenerator.C.o CMa
         keFiles/Ioss.dir/Ioss_FaceSet.C.o CMakeFiles/Ioss.dir/Ioss_Field.C.o CMakeFiles/Ioss.dir/Ioss_FieldManager.C.o CMakeFiles/Ioss.dir/Ioss_FileInfo.C.o CMakeFiles/Ioss.dir/Ioss_Ge
         tLongOpt.C.o CMakeFiles/Ioss.dir/Ioss_Getline.C.o CMakeFiles/Ioss.dir/Ioss_Glob.C.o CMakeFiles/Ioss.dir/Ioss_GroupingEntity.C.o CMakeFiles/Ioss.dir/Ioss_IOFactory.C.o CMakeFile
         s/Ioss.dir/Ioss_Initializer.C.o CMakeFiles/Ioss.dir/Ioss_Map.C.o CMakeFiles/Ioss.dir/Ioss_MemoryUtils.C.o CMakeFiles/Ioss.dir/Ioss_NodeBlock.C.o CMakeFiles/Ioss.dir/Ioss_NodeSe
         t.C.o CMakeFiles/Ioss.dir/Ioss_NullEntity.C.o CMakeFiles/Ioss.dir/Ioss_ParallelUtils.C.o CMakeFiles/Ioss.dir/Ioss_Property.C.o CMakeFiles/Ioss.dir/Ioss_PropertyManager.C.o CMak
         eFiles/Ioss.dir/Ioss_Region.C.o CMakeFiles/Ioss.dir/Ioss_SerializeIO.C.o CMakeFiles/Ioss.dir/Ioss_SideBlock.C.o CMakeFiles/Ioss.dir/Ioss_SideSet.C.o CMakeFiles/Ioss.dir/Ioss_Sm
         artAssert.C.o CMakeFiles/Ioss.dir/Ioss_StructuredBlock.C.o CMakeFiles/Ioss.dir/Ioss_Tracer.C.o CMakeFiles/Ioss.dir/Ioss_Transform.C.o CMakeFiles/Ioss.dir/Ioss_TransformFactory.
         C.o CMakeFiles/Ioss.dir/Ioss_Utils.C.o CMakeFiles/Ioss.dir/Ioss_VariableType.C.o CMakeFiles/Ioss.dir/Ioss_ZoneConnectivity.C.o CMakeFiles/Ioss.dir/tokenize.C.o CMakeFiles/Ioss.
         dir/elements/Ioss_Beam2.C.o CMakeFiles/Ioss.dir/elements/Ioss_Beam3.C.o CMakeFiles/Ioss.dir/elements/Ioss_Beam4.C.o CMakeFiles/Ioss.dir/elements/Ioss_Edge2.C.o CMakeFiles/Ioss.
         dir/elements/Ioss_Edge2D2.C.o CMakeFiles/Ioss.dir/elements/Ioss_Edge2D3.C.o CMakeFiles/Ioss.dir/elements/Ioss_Edge3.C.o CMakeFiles/Ioss.dir/elements/Ioss_Edge4.C.o CMakeFiles/I
         oss.dir/elements/Ioss_Hex16.C.o CMakeFiles/Ioss.dir/elements/Ioss_Hex20.C.o CMakeFiles/Ioss.dir/elements/Ioss_Hex27.C.o CMakeFiles/Ioss.dir/elements/Ioss_Hex32.C.o CMakeFiles/I
         oss.dir/elements/Ioss_Hex64.C.o CMakeFiles/Ioss.dir/elements/Ioss_Hex8.C.o CMakeFiles/Ioss.dir/elements/Ioss_Hex9.C.o CMakeFiles/Ioss.dir/elements/Ioss_Node.C.o CMakeFiles/Ioss
         .dir/elements/Ioss_Pyramid13.C.o CMakeFiles/Ioss.dir/elements/Ioss_Pyramid14.C.o CMakeFiles/Ioss.dir/elements/Ioss_Pyramid18.C.o CMakeFiles/Ioss.dir/elements/Ioss_Pyramid19.C.o
          CMakeFiles/Ioss.dir/elements/Ioss_Pyramid5.C.o CMakeFiles/Ioss.dir/elements/Ioss_Quad12.C.o CMakeFiles/Ioss.dir/elements/Ioss_Quad16.C.o CMakeFiles/Ioss.dir/elements/Ioss_Quad
         4.C.o CMakeFiles/Ioss.dir/elements/Ioss_Quad6.C.o CMakeFiles/Ioss.dir/elements/Ioss_Quad8.C.o CMakeFiles/Ioss.dir/elements/Ioss_Quad9.C.o CMakeFiles/Ioss.dir/elements/Ioss_Shel
         l4.C.o CMakeFiles/Ioss.dir/elements/Ioss_Shell8.C.o CMakeFiles/Ioss.dir/elements/Ioss_Shell9.C.o CMakeFiles/Ioss.dir/elements/Ioss_ShellLine2D2.C.o CMakeFiles/Ioss.dir/elements
         /Ioss_ShellLine2D3.C.o CMakeFiles/Ioss.dir/elements/Ioss_Sphere.C.o CMakeFiles/Ioss.dir/elements/Ioss_Spring2.C.o CMakeFiles/Ioss.dir/elements/Ioss_Spring3.C.o CMakeFiles/Ioss.
         dir/elements/Ioss_Super.C.o CMakeFiles/Ioss.dir/elements/Ioss_Tet10.C.o CMakeFiles/Ioss.dir/elements/Ioss_Tet11.C.o CMakeFiles/Ioss.dir/elements/Ioss_Tet14.C.o CMakeFiles/Ioss.
         dir/elements/Ioss_Tet15.C.o CMakeFiles/Ioss.dir/elements/Ioss_Tet16.C.o CMakeFiles/Ioss.dir/elements/Ioss_Tet4.C.o CMakeFiles/Ioss.dir/elements/Ioss_Tet40.C.o CMakeFiles/Ioss.d
         ir/elements/Ioss_Tet7.C.o CMakeFiles/Ioss.dir/elements/Ioss_Tet8.C.o CMakeFiles/Ioss.dir/elements/Ioss_Tri13.C.o CMakeFiles/Ioss.dir/elements/Ioss_Tri3.C.o CMakeFiles/Ioss.dir/
         elements/Ioss_Tri4.C.o CMakeFiles/Ioss.dir/elements/Ioss_Tri4a.C.o CMakeFiles/Ioss.dir/elements/Ioss_Tri6.C.o CMakeFiles/Ioss.dir/elements/Ioss_Tri7.C.o CMakeFiles/Ioss.dir/ele
         ments/Ioss_Tri9.C.o CMakeFiles/Ioss.dir/elements/Ioss_TriShell3.C.o CMakeFiles/Ioss.dir/elements/Ioss_TriShell4.C.o CMakeFiles/Ioss.dir/elements/Ioss_TriShell6.C.o CMakeFiles/I
         oss.dir/elements/Ioss_TriShell7.C.o CMakeFiles/Ioss.dir/elements/Ioss_Unknown.C.o CMakeFiles/Ioss.dir/elements/Ioss_Wedge12.C.o CMakeFiles/Ioss.dir/elements/Ioss_Wedge15.C.o CM
         akeFiles/Ioss.dir/elements/Ioss_Wedge16.C.o CMakeFiles/Ioss.dir/elements/Ioss_Wedge18.C.o CMakeFiles/Ioss.dir/elements/Ioss_Wedge20.C.o CMakeFiles/Ioss.dir/elements/Ioss_Wedge2
         1.C.o CMakeFiles/Ioss.dir/elements/Ioss_Wedge24.C.o CMakeFiles/Ioss.dir/elements/Ioss_Wedge52.C.o CMakeFiles/Ioss.dir/elements/Ioss_Wedge6.C.o
 7449    /usr/bin/ranlib libIoss.a
 7450    make[2]: Leaving directory '/tmp/adrin/spack-stage/spack-stage-trilinos-master-nxtxya3t35qsnnycs3yht2yed5pevolc/spack-build-nxtxya3'
 7451    [ 49%] Built target Ioss
 7452    make[1]: Leaving directory '/tmp/adrin/spack-stage/spack-stage-trilinos-master-nxtxya3t35qsnnycs3yht2yed5pevolc/spack-build-nxtxya3'

7453 make: *** [Makefile:169: all] Error 2

See build log for details:
/tmp/adrin/spack-stage/spack-stage-trilinos-master-nxtxya3t35qsnnycs3yht2yed5pevolc/spack-build-out.txt

==> Warning: Skipping build of nalu-wind-master-stdpgs6jaqc4yxxyaxvhpztsflxqy6d7 since trilinos-master-nxtxya3t35qsnnycs3yht2yed5pevolc failed
==> Error: nalu-wind-master-stdpgs6jaqc4yxxyaxvhpztsflxqy6d7: Package was not installed
==> Error: Installation request failed. Refer to reported errors for failing package(s).
"

can someone suggest what could be done to succesfully install naluwind on my workstation?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions