basic_idl_DIR=$(realpath ..) pip install . - MacOS (Error)

[Danny875]

Hi,

I have tried given the real path to the "basic_output" directory, as you indicated, but it still doesn't work. After I typed the following command:

basic_idl_DIR=/Users/dannyguest/Downloads/pyopendds/tests/basic_test/build/basic_output pip install .

The error that I'm getting is the following:

Processing /Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_output
  DEPRECATION: A future pip version will change local packages to be built in-place without first copying to a temporary directory. We recommend you use --use-feature=in-tree-build to test your packages with this new behavior before it becomes the default.
   pip 21.3 will remove support for this functionality. You can find discussion regarding this at https://github.com/pypa/pip/issues/7555.
Requirement already satisfied: pyopendds in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from pybasic==0.0.0) (0.1.0)
Requirement already satisfied: jinja2 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from pyopendds->pybasic==0.0.0) (3.0.2)
Requirement already satisfied: MarkupSafe>=2.0 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from jinja2->pyopendds->pybasic==0.0.0) (2.0.1)
Building wheels for collected packages: pybasic
  Building wheel for pybasic (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: /Library/Frameworks/Python.framework/Versions/3.10/bin/python3.10 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-q0r5nh6_/setup.py'"'"'; __file__='"'"'/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-q0r5nh6_/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-wheel-pgva0ptj
       cwd: /private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-q0r5nh6_/
  Complete output (38 lines):
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.macosx-10.9-universal2-3.10
  creating build/lib.macosx-10.9-universal2-3.10/pybasic
  copying pybasic/__init__.py -> build/lib.macosx-10.9-universal2-3.10/pybasic
  creating build/lib.macosx-10.9-universal2-3.10/pybasic/basic
  copying pybasic/basic/__init__.py -> build/lib.macosx-10.9-universal2-3.10/pybasic/basic
  running build_ext
  -- The CXX compiler identification is AppleClang 13.0.0.13000029
  -- Detecting CXX compiler ABI info
  -- Detecting CXX compiler ABI info - done
  -- Check for working CXX compiler: /Library/Developer/CommandLineTools/usr/bin/c++ - skipped
  -- Detecting CXX compile features
  -- Detecting CXX compile features - done
  -- Found Python3: /Library/Frameworks/Python.framework/Versions/3.10/include/python3.10 (found suitable exact version "3.10.0") found components: Development Development.Module Development.Embed
  CMake Error at CMakeLists.txt:10 (find_package):
    By not providing "FindOpenDDS.cmake" in CMAKE_MODULE_PATH this project has
    asked CMake to find a package configuration file provided by "OpenDDS", but
    CMake did not find one.
  
    Could not find a package configuration file provided by "OpenDDS" with any
    of the following names:
  
      OpenDDSConfig.cmake
      opendds-config.cmake
  
    Add the installation prefix of "OpenDDS" to CMAKE_PREFIX_PATH or set
    "OpenDDS_DIR" to a directory containing one of the above files.  If
    "OpenDDS" provides a separate development package or SDK, be sure it has
    been installed.
  
  
  -- Configuring incomplete, errors occurred!
  See also "/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-q0r5nh6_/build/temp.macosx-10.9-universal2-3.10/CMakeFiles/CMakeOutput.log".
  See also "/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-q0r5nh6_/build/temp.macosx-10.9-universal2-3.10/CMakeFiles/CMakeError.log".
  error: "cmake /private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-q0r5nh6_ -DCMAKE_BUILD_TYPE=Debug -DCMAKE_LIBRARY_OUTPUT_DIRECTORY_DEBUG=/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-q0r5nh6_/build/lib.macosx-10.9-universal2-3.10 -DCMAKE_ARCHIVE_OUTPUT_DIRECTORY_DEBUG=build/temp.macosx-10.9-universal2-3.10 -DPYOPENDDS_PYTHON_VERSION=3.10.0 -DPYOPENDDS_INCLUDE=/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pyopendds/dev/include" returned non-zero result: 1
  ----------------------------------------
  ERROR: Failed building wheel for pybasic
  Running setup.py clean for pybasic
Failed to build pybasic
Installing collected packages: pybasic
    Running setup.py install for pybasic ... error
    ERROR: Command errored out with exit status 1:
     command: /Library/Frameworks/Python.framework/Versions/3.10/bin/python3.10 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-q0r5nh6_/setup.py'"'"'; __file__='"'"'/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-q0r5nh6_/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-record-zbf3oepc/install-record.txt --single-version-externally-managed --compile --install-headers /Library/Frameworks/Python.framework/Versions/3.10/include/python3.10/pybasic
         cwd: /private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-q0r5nh6_/
    Complete output (38 lines):
    running install
    running build
    running build_py
    creating build
    creating build/lib.macosx-10.9-universal2-3.10
    creating build/lib.macosx-10.9-universal2-3.10/pybasic
    copying pybasic/__init__.py -> build/lib.macosx-10.9-universal2-3.10/pybasic
    creating build/lib.macosx-10.9-universal2-3.10/pybasic/basic
    copying pybasic/basic/__init__.py -> build/lib.macosx-10.9-universal2-3.10/pybasic/basic
    running build_ext
    -- The CXX compiler identification is AppleClang 13.0.0.13000029
    -- Detecting CXX compiler ABI info
    -- Detecting CXX compiler ABI info - done
    -- Check for working CXX compiler: /Library/Developer/CommandLineTools/usr/bin/c++ - skipped
    -- Detecting CXX compile features
    -- Detecting CXX compile features - done
    -- Found Python3: /Library/Frameworks/Python.framework/Versions/3.10/include/python3.10 (found suitable exact version "3.10.0") found components: Development Development.Module Development.Embed
    CMake Error at CMakeLists.txt:10 (find_package):
      By not providing "FindOpenDDS.cmake" in CMAKE_MODULE_PATH this project has
      asked CMake to find a package configuration file provided by "OpenDDS", but
      CMake did not find one.
    
      Could not find a package configuration file provided by "OpenDDS" with any
      of the following names:
    
        OpenDDSConfig.cmake
        opendds-config.cmake
    
      Add the installation prefix of "OpenDDS" to CMAKE_PREFIX_PATH or set
      "OpenDDS_DIR" to a directory containing one of the above files.  If
      "OpenDDS" provides a separate development package or SDK, be sure it has
      been installed.
    
    
    -- Configuring incomplete, errors occurred!
    See also "/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-q0r5nh6_/build/temp.macosx-10.9-universal2-3.10/CMakeFiles/CMakeOutput.log".
    See also "/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-q0r5nh6_/build/temp.macosx-10.9-universal2-3.10/CMakeFiles/CMakeError.log".
    error: "cmake /private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-q0r5nh6_ -DCMAKE_BUILD_TYPE=Debug -DCMAKE_LIBRARY_OUTPUT_DIRECTORY_DEBUG=/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-q0r5nh6_/build/lib.macosx-10.9-universal2-3.10 -DCMAKE_ARCHIVE_OUTPUT_DIRECTORY_DEBUG=build/temp.macosx-10.9-universal2-3.10 -DPYOPENDDS_PYTHON_VERSION=3.10.0 -DPYOPENDDS_INCLUDE=/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pyopendds/dev/include" returned non-zero result: 1
    ----------------------------------------
ERROR: Command errored out with exit status 1: /Library/Frameworks/Python.framework/Versions/3.10/bin/python3.10 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-q0r5nh6_/setup.py'"'"'; __file__='"'"'/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-q0r5nh6_/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-record-zbf3oepc/install-record.txt --single-version-externally-managed --compile --install-headers /Library/Frameworks/Python.framework/Versions/3.10/include/python3.10/pybasic Check the logs for full command output.

Is there any fix for this issue?

Thank you very much!

[iguessthislldo]

I think I told you the wrong thing in #27. I meant to say "replace $(realpath ..) in the command with the path to build" since that is the .. from basic_output. So try: basic_idl_DIR=/Users/dannyguest/Downloads/pyopendds/tests/basic_test/build pip install .

[Danny875]

I have just tried it and unfortunately I'm still getting an error:

145-2-173-42:basic_output dannydragoi$ basic_idl_DIR=/Users/dannyguest/Downloads/pyopendds/tests/basic_test/build pip install .
Processing /Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_output
  DEPRECATION: A future pip version will change local packages to be built in-place without first copying to a temporary directory. We recommend you use --use-feature=in-tree-build to test your packages with this new behavior before it becomes the default.
   pip 21.3 will remove support for this functionality. You can find discussion regarding this at https://github.com/pypa/pip/issues/7555.
Requirement already satisfied: pyopendds in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from pybasic==0.0.0) (0.1.0)
Requirement already satisfied: jinja2 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from pyopendds->pybasic==0.0.0) (3.0.2)
Requirement already satisfied: MarkupSafe>=2.0 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from jinja2->pyopendds->pybasic==0.0.0) (2.0.1)
Building wheels for collected packages: pybasic
  Building wheel for pybasic (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: /Library/Frameworks/Python.framework/Versions/3.10/bin/python3.10 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-429yfnvg/setup.py'"'"'; __file__='"'"'/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-429yfnvg/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-wheel-5wqg0k1o
       cwd: /private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-429yfnvg/
  Complete output (43 lines):
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.macosx-10.9-universal2-3.10
  creating build/lib.macosx-10.9-universal2-3.10/pybasic
  copying pybasic/__init__.py -> build/lib.macosx-10.9-universal2-3.10/pybasic
  creating build/lib.macosx-10.9-universal2-3.10/pybasic/basic
  copying pybasic/basic/__init__.py -> build/lib.macosx-10.9-universal2-3.10/pybasic/basic
  running build_ext
  -- The CXX compiler identification is AppleClang 13.0.0.13000029
  -- Detecting CXX compiler ABI info
  -- Detecting CXX compiler ABI info - done
  -- Check for working CXX compiler: /Library/Developer/CommandLineTools/usr/bin/c++ - skipped
  -- Detecting CXX compile features
  -- Detecting CXX compile features - done
  -- Found Python3: /Library/Frameworks/Python.framework/Versions/3.10/include/python3.10 (found suitable exact version "3.10.0") found components: Development Development.Module Development.Embed
  -- Looking for C++ include pthread.h
  -- Looking for C++ include pthread.h - found
  -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
  -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
  -- Found Threads: TRUE
  CMake Error at CMakeLists.txt:11 (find_package):
    By not providing "Findbasic_idl.cmake" in CMAKE_MODULE_PATH this project
    has asked CMake to find a package configuration file provided by
    "basic_idl", but CMake did not find one.
  
    Could not find a package configuration file provided by "basic_idl" with
    any of the following names:
  
      basic_idlConfig.cmake
      basic_idl-config.cmake
  
    Add the installation prefix of "basic_idl" to CMAKE_PREFIX_PATH or set
    "basic_idl_DIR" to a directory containing one of the above files.  If
    "basic_idl" provides a separate development package or SDK, be sure it has
    been installed.
  
  
  -- Configuring incomplete, errors occurred!
  See also "/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-429yfnvg/build/temp.macosx-10.9-universal2-3.10/CMakeFiles/CMakeOutput.log".
  See also "/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-429yfnvg/build/temp.macosx-10.9-universal2-3.10/CMakeFiles/CMakeError.log".
  error: "cmake /private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-429yfnvg -DCMAKE_BUILD_TYPE=Debug -DCMAKE_LIBRARY_OUTPUT_DIRECTORY_DEBUG=/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-429yfnvg/build/lib.macosx-10.9-universal2-3.10 -DCMAKE_ARCHIVE_OUTPUT_DIRECTORY_DEBUG=build/temp.macosx-10.9-universal2-3.10 -DPYOPENDDS_PYTHON_VERSION=3.10.0 -DPYOPENDDS_INCLUDE=/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pyopendds/dev/include" returned non-zero result: 1
  ----------------------------------------
  ERROR: Failed building wheel for pybasic
  Running setup.py clean for pybasic
Failed to build pybasic
Installing collected packages: pybasic
    Running setup.py install for pybasic ... error
    ERROR: Command errored out with exit status 1:
     command: /Library/Frameworks/Python.framework/Versions/3.10/bin/python3.10 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-429yfnvg/setup.py'"'"'; __file__='"'"'/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-429yfnvg/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-record-ees_dbjv/install-record.txt --single-version-externally-managed --compile --install-headers /Library/Frameworks/Python.framework/Versions/3.10/include/python3.10/pybasic
         cwd: /private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-429yfnvg/
    Complete output (43 lines):
    running install
    running build
    running build_py
    creating build
    creating build/lib.macosx-10.9-universal2-3.10
    creating build/lib.macosx-10.9-universal2-3.10/pybasic
    copying pybasic/__init__.py -> build/lib.macosx-10.9-universal2-3.10/pybasic
    creating build/lib.macosx-10.9-universal2-3.10/pybasic/basic
    copying pybasic/basic/__init__.py -> build/lib.macosx-10.9-universal2-3.10/pybasic/basic
    running build_ext
    -- The CXX compiler identification is AppleClang 13.0.0.13000029
    -- Detecting CXX compiler ABI info
    -- Detecting CXX compiler ABI info - done
    -- Check for working CXX compiler: /Library/Developer/CommandLineTools/usr/bin/c++ - skipped
    -- Detecting CXX compile features
    -- Detecting CXX compile features - done
    -- Found Python3: /Library/Frameworks/Python.framework/Versions/3.10/include/python3.10 (found suitable exact version "3.10.0") found components: Development Development.Module Development.Embed
    -- Looking for C++ include pthread.h
    -- Looking for C++ include pthread.h - found
    -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
    -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
    -- Found Threads: TRUE
    CMake Error at CMakeLists.txt:11 (find_package):
      By not providing "Findbasic_idl.cmake" in CMAKE_MODULE_PATH this project
      has asked CMake to find a package configuration file provided by
      "basic_idl", but CMake did not find one.
    
      Could not find a package configuration file provided by "basic_idl" with
      any of the following names:
    
        basic_idlConfig.cmake
        basic_idl-config.cmake
    
      Add the installation prefix of "basic_idl" to CMAKE_PREFIX_PATH or set
      "basic_idl_DIR" to a directory containing one of the above files.  If
      "basic_idl" provides a separate development package or SDK, be sure it has
      been installed.
    
    
    -- Configuring incomplete, errors occurred!
    See also "/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-429yfnvg/build/temp.macosx-10.9-universal2-3.10/CMakeFiles/CMakeOutput.log".
    See also "/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-429yfnvg/build/temp.macosx-10.9-universal2-3.10/CMakeFiles/CMakeError.log".
    error: "cmake /private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-429yfnvg -DCMAKE_BUILD_TYPE=Debug -DCMAKE_LIBRARY_OUTPUT_DIRECTORY_DEBUG=/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-429yfnvg/build/lib.macosx-10.9-universal2-3.10 -DCMAKE_ARCHIVE_OUTPUT_DIRECTORY_DEBUG=build/temp.macosx-10.9-universal2-3.10 -DPYOPENDDS_PYTHON_VERSION=3.10.0 -DPYOPENDDS_INCLUDE=/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pyopendds/dev/include" returned non-zero result: 1
    ----------------------------------------
ERROR: Command errored out with exit status 1: /Library/Frameworks/Python.framework/Versions/3.10/bin/python3.10 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-429yfnvg/setup.py'"'"'; __file__='"'"'/private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-req-build-429yfnvg/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-record-ees_dbjv/install-record.txt --single-version-externally-managed --compile --install-headers /Library/Frameworks/Python.framework/Versions/3.10/include/python3.10/pybasic Check the logs for full command output.

[Danny875]

Hi Fred,

Do you have any updates?

Thank you in advance!

[iguessthislldo]

I don't see anything wrong with the command, so does basic_idlConfig.cmake exist in the build directory? It lists two that it's looking for, but basic_idlConfig.cmake is apparently the one that should be created when CMake is ran.

[Danny875]

Yes, the basic_idlConfig.cmakeexists in the build directory. Instead, I tried executing this command without pip install basic_idl_DIR=/Users/dannyguest/Downloads/pyopendds/tests/basic_test/build and there were no errors, but when I tried to execute the next two command to test the example, I encountered the following error:

145-2-173-31:~ dannydragoi$ cd /Users/dannydragoi/Downloads/OpenDDS-3.18 
145-2-173-31:OpenDDS-3.18 dannydragoi$ source setenv.sh
145-2-173-31:OpenDDS-3.18 dannydragoi$ cd /Users/dannydragoi/Downloads/pyopendds-master 
145-2-173-31:pyopendds-master dannydragoi$ cd tests/basic_test
145-2-173-31:basic_test dannydragoi$ 
145-2-173-31:basic_test dannydragoi$ mkdir build
mkdir: build: File exists
145-2-173-31:basic_test dannydragoi$ cd build
145-2-173-31:build dannydragoi$ cmake ..
-- Configuring done
-- Generating done
-- Build files have been written to: /Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build
145-2-173-31:build dannydragoi$ make
Consolidate compiler generated dependencies of target basic_idl
[ 77%] Built target basic_idl
Consolidate compiler generated dependencies of target publisher
[100%] Built target publisher
145-2-173-31:build dannydragoi$ itl2py -o basic_output basic_idl basic.itl
145-2-173-31:build dannydragoi$ cd basic_output
145-2-173-31:basic_output dannydragoi$ basic_idl_DIR=/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build 
145-2-173-31:basic_output dannydragoi$ cd ../..
145-2-173-31:basic_test dannydragoi$ bash run_test.sh
Traceback (most recent call last):
  File "/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/subscriber.py", line 6, in <module>
    from pybasic.basic import Reading
ModuleNotFoundError: No module named 'pybasic'
Wating for Subscriber...
Error: Timedout waiting for subscriber
Publisher exited with status 1
Subscriber exited with status 1

What could be the issue?

[iguessthislldo]

Running pip install on the result of itl2py is what is supposed to make pybasic available to Python, so if skipping that caused it to complain about pybasic being missing, then it isn't surprising to me. I can't recreate this because it doesn't do this on my Linux machine and I don't have access to macOS at the moment to try it there.

This is a guess, but maybe can't see it basic_idl_DIR environment variable? I can't see how else this would be happening. I couldn't find anything in the find_package CMake documentation that said it acts any different under macOS. Since I can't recreate this, I'd like you to try these steps so I can get some more info:

1. Add these lines after project(_pybasic CXX) and before the find_package lines in basic_output/CmakeLists.txt. This will tell use what things look like from CMake's perspective.

message("HEY! basic_idl_DIR environment variables is $ENV{basic_idl_DIR}")
message("HEY! basic_idl_DIR cmake variables is ${basic_idl_DIR}")

2. Completely replace setup.py in basic_output with the following lines. This will tell some info about things from the python script and has a possible workaround I will explain in step 4.

from setuptools import setup, find_packages
from pathlib import Path
import os

from pyopendds.dev.cmake import \
    CMakeWrapperExtension, CMakeWrapperBuild, get_include_path

extra_vars={
    'PYOPENDDS_INCLUDE': get_include_path(),
}

def file_status(what, method, path):
  print('HEY! {} (from {}) is {}: it does {}exist'.format(
    what, method, repr(str(path)), '' if path.exists() else 'NOT '))
  return path if path.exists() else None

def method_status(method, basic_idl_dir):
  if basic_idl_dir is None:
    print('HEY! basic_idl_dir from', method, 'is None')
    return
  basic_idl_dir = Path(basic_idl_dir)
  d = file_status('basic_idl_dir', method, basic_idl_dir)
  if d is not None:
    basic_idl_config = basic_idl_dir / 'basic_idlConfig.cmake'
    if file_status('basic_idl_config', method, basic_idl_config) is not None:
      return d
  return None
  
method_status("environment", os.environ.get('basic_idl_DIR', None))
cmake_var = method_status("__file__", Path(__file__).resolve().parent.parent)
if cmake_var is not None:
    extra_vars['basic_idl_DIR'] = str(cmake_var)

setup(
    name='pybasic',
    packages=find_packages(),
    ext_modules=[CMakeWrapperExtension(
        name='_pybasic',
        cmakelists_dir='.',
        extra_vars=extra_vars,
    )],
    cmdclass={'build_ext': CMakeWrapperBuild},
    install_requires=[
        'pyopendds',
    ],
)

3. Run the same basic_idl_DIR=.../build pip install . command in basic_output as before and post the result. This should tell us if CMake is actually getting the basic_idl_DIR environment variable.

4. If the first basic_idl_DIR message from CMake is blank, then there might be a workaround that I put in setup.py that I mentioned before. Try running python3 setup.py and post what it prints to the screen. This is what pip actually runs internally but this makes sure it's run in place so it can see the contents of the build directory. So we don't have to pass that information manually and in addition to that it passes it more directly to CMake.

[Danny875]

The errors encountered after making the changes mentioned in step 1 and step 2 and after executing step 3 are shown below:

145-2-173-31:basic_output dannydragoi$ basic_idl_DIR=/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build pip install . 
Processing /Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_output
  Preparing metadata (setup.py) ... done
Requirement already satisfied: pyopendds in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from pybasic==0.0.0) (0.1.0)
Requirement already satisfied: jinja2 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from pyopendds->pybasic==0.0.0) (3.0.2)
Requirement already satisfied: MarkupSafe>=2.0 in /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages (from jinja2->pyopendds->pybasic==0.0.0) (2.0.1)
Building wheels for collected packages: pybasic
  Building wheel for pybasic (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: /Library/Frameworks/Python.framework/Versions/3.10/bin/python3.10 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_output/setup.py'"'"'; __file__='"'"'/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_output/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-wheel-o1xljpg3
       cwd: /Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_output/
  Complete output (33 lines):
  HEY! basic_idl_dir (from environment) is '/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build': it does exist
  HEY! basic_idl_config (from environment) is '/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_idlConfig.cmake': it does exist
  HEY! basic_idl_dir (from __file__) is '/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build': it does exist
  HEY! basic_idl_config (from __file__) is '/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_idlConfig.cmake': it does exist
  running bdist_wheel
  running build
  running build_py
  running build_ext
  HEY! basic_idl_DIR environment variables is /Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build
  HEY! basic_idl_DIR cmake variables is /Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build
  -- Configuring done
  -- Generating done
  -- Build files have been written to: /Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_output/build/temp.macosx-10.9-universal2-3.10
  Consolidate compiler generated dependencies of target _pybasic
  [ 50%] Building CXX object CMakeFiles/_pybasic.dir/_pybasic.cpp.o
  In file included from /Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_output/_pybasic.cpp:1:
  /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pyopendds/dev/include/pyopendds/user.hpp:33:12: error: '_typeobject' is not polymorphic
      return dynamic_cast<PyObject*>(&PyLong_Type);
             ^                       ~~~~~~~~~~~~
  /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pyopendds/dev/include/pyopendds/user.hpp:93:12: error: '_typeobject' is not polymorphic
      return dynamic_cast<PyObject*>(&PyUnicode_Type);
             ^                       ~~~~~~~~~~~~~~~
  /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pyopendds/dev/include/pyopendds/user.hpp:245:5: error: 'topic_types_' is a private member of 'pyopendds::TopicTypeBase'
      topic_types_.insert(TopicTypes::value_type(Type<IdlType>::get_python_class(), type));
      ^
  /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pyopendds/dev/include/pyopendds/user.hpp:144:21: note: declared private here
    static TopicTypes topic_types_;
                      ^
  3 errors generated.
  make[2]: *** [CMakeFiles/_pybasic.dir/_pybasic.cpp.o] Error 1
  make[1]: *** [CMakeFiles/_pybasic.dir/all] Error 2
  make: *** [all] Error 2
  error: "cmake --build . --config Debug" returned non-zero result: 2
  ----------------------------------------
  ERROR: Failed building wheel for pybasic
  Running setup.py clean for pybasic
Failed to build pybasic
Installing collected packages: pybasic
  Attempting uninstall: pybasic
    Found existing installation: pybasic 0.31.dev0
    Uninstalling pybasic-0.31.dev0:
      Successfully uninstalled pybasic-0.31.dev0
    Running setup.py install for pybasic ... error
    ERROR: Command errored out with exit status 1:
     command: /Library/Frameworks/Python.framework/Versions/3.10/bin/python3.10 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_output/setup.py'"'"'; __file__='"'"'/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_output/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-record-smbunaf9/install-record.txt --single-version-externally-managed --compile --install-headers /Library/Frameworks/Python.framework/Versions/3.10/include/python3.10/pybasic
         cwd: /Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_output/
    Complete output (50 lines):
    HEY! basic_idl_dir (from environment) is '/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build': it does exist
    HEY! basic_idl_config (from environment) is '/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_idlConfig.cmake': it does exist
    HEY! basic_idl_dir (from __file__) is '/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build': it does exist
    HEY! basic_idl_config (from __file__) is '/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_idlConfig.cmake': it does exist
    running install
    running build
    running build_py
    creating build
    creating build/lib.macosx-10.9-universal2-3.10
    creating build/lib.macosx-10.9-universal2-3.10/pybasic
    copying pybasic/__init__.py -> build/lib.macosx-10.9-universal2-3.10/pybasic
    creating build/lib.macosx-10.9-universal2-3.10/pybasic/basic
    copying pybasic/basic/__init__.py -> build/lib.macosx-10.9-universal2-3.10/pybasic/basic
    running build_ext
    -- The CXX compiler identification is AppleClang 13.0.0.13000029
    -- Detecting CXX compiler ABI info
    -- Detecting CXX compiler ABI info - done
    -- Check for working CXX compiler: /Library/Developer/CommandLineTools/usr/bin/c++ - skipped
    -- Detecting CXX compile features
    -- Detecting CXX compile features - done
    HEY! basic_idl_DIR environment variables is /Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build
    HEY! basic_idl_DIR cmake variables is /Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build
    -- Found Python3: /Library/Frameworks/Python.framework/Versions/3.10/include/python3.10 (found suitable exact version "3.10.0") found components: Development Development.Module Development.Embed
    -- Looking for C++ include pthread.h
    -- Looking for C++ include pthread.h - found
    -- Performing Test CMAKE_HAVE_LIBC_PTHREAD
    -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
    -- Found Threads: TRUE
    -- Configuring done
    -- Generating done
    -- Build files have been written to: /Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_output/build/temp.macosx-10.9-universal2-3.10
    [ 50%] Building CXX object CMakeFiles/_pybasic.dir/_pybasic.cpp.o
    In file included from /Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_output/_pybasic.cpp:1:
    /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pyopendds/dev/include/pyopendds/user.hpp:33:12: error: '_typeobject' is not polymorphic
        return dynamic_cast<PyObject*>(&PyLong_Type);
               ^                       ~~~~~~~~~~~~
    /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pyopendds/dev/include/pyopendds/user.hpp:93:12: error: '_typeobject' is not polymorphic
        return dynamic_cast<PyObject*>(&PyUnicode_Type);
               ^                       ~~~~~~~~~~~~~~~
    /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pyopendds/dev/include/pyopendds/user.hpp:245:5: error: 'topic_types_' is a private member of 'pyopendds::TopicTypeBase'
        topic_types_.insert(TopicTypes::value_type(Type<IdlType>::get_python_class(), type));
        ^
    /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pyopendds/dev/include/pyopendds/user.hpp:144:21: note: declared private here
      static TopicTypes topic_types_;
                        ^
    3 errors generated.
    make[2]: *** [CMakeFiles/_pybasic.dir/_pybasic.cpp.o] Error 1
    make[1]: *** [CMakeFiles/_pybasic.dir/all] Error 2
    make: *** [all] Error 2
    error: "cmake --build . --config Debug" returned non-zero result: 2
    ----------------------------------------
  Rolling back uninstall of pybasic
  Moving to /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pybasic-0.31.dev0.dist-info/
   from /Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/~ybasic-0.31.dev0.dist-info
ERROR: Command errored out with exit status 1: /Library/Frameworks/Python.framework/Versions/3.10/bin/python3.10 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_output/setup.py'"'"'; __file__='"'"'/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_output/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /private/var/folders/8h/gxjssfgj3d35hmpjt9mq2v6r0000gn/T/pip-record-smbunaf9/install-record.txt --single-version-externally-managed --compile --install-headers /Library/Frameworks/Python.framework/Versions/3.10/include/python3.10/pybasic Check the logs for full command output.

After executing python3 setup.py command from step 4, the following error was shown:

145-2-173-31:basic_output dannydragoi$ python3 setup.py
HEY! basic_idl_dir from environment is None
HEY! basic_idl_dir (from __file__) is '/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build': it does exist
HEY! basic_idl_config (from __file__) is '/Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build/basic_idlConfig.cmake': it does exist
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
   or: setup.py --help [cmd1 cmd2 ...]
   or: setup.py --help-commands
   or: setup.py cmd --help

error: no commands supplied

What I noticed is that after executing itl2py -o basic_output basic_idl basic.itl, both setup.py and CMakeLists.txt have been modified to the initial content. So what I did was to add the changes you mentioned after running this command, so that it doesn't get modified.

[iguessthislldo]

After executing python3 setup.py command from step 4, the following error was shown:

Sorry, I made a mistake with telling you what command to run again. It should have been python3 setup.py install, but since the pip command got further this time for some reason, I think we can focus on the errors it made.

So I haven't compiled PyOpenDDS with clang before today. I was able to reproduce them locally and I have pushed a fix for them.

Also in this comit I made changes to itl2py so it will try to take care of the basic_idl_DIR automatically, so it doesn't have to be passed in anymore.

If you get the latest changes in the repo, reinstall pyopendds from that, and regenerate basic_output, then it should work this time (hopefully).

[Danny875]

I tested it again with the new version and I had no errors until I run the last command: bash run_test.sh, which generated the following error:

Dannys-MacBook-Pro:basic_test dannydragoi$ bash run_test.sh
Wating for Subscriber...
(1511|4585045504) TransportRegistry::create_inst: transport_type=rtps_udp is not registered.
(1511|4585045504) NOTICE: not using file configuration - no configuration file specified.
(1511|4585045504) NOTICE: Service_Participant::get_domain_participant_factory - This is OpenDDS 3.18.0 using ACE 7.0.3
(1511|4585045504) NOTICE: Service_Participant::intializeScheduling() - no scheduling policy specified, not setting policy.
(1511|4585045504) ERROR: Service_Participant::load_discovery_configuration(): Unable to load libraries for rtps_discovery
(1511|4585045504) ERROR: Service_Participant::get_Discovery failed attempt to load default RTPS discovery for domain 34.
(1511|4585045504) ERROR: DomainParticipantImpl::enable, no discovery found for domain id: 34.
(1511|4585045504) ERROR: DomainParticipantFactoryImpl::create_participant, unable to enable DomainParticipant.
Failed to Create Participant
Exception ignored in: <function DomainParticipant.__del__ at 0x10d321480>
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/pyopendds/DomainParticipant.py", line 22, in __del__
    participant_cleanup(self)
TypeError: Python object does not have a valid capsule pointer
(1511|4585045504) DomainParticipantFactoryImpl::~DomainParticipantFactoryImpl()
(1511|4585045504) Service_Participant::~Service_Participant()
Error: Timedout waiting for subscriber
Publisher exited with status 1
Subscriber exited with status 1

[iguessthislldo]

Alright, this is progress. The actual problem is this because the rest of the errors in the log would be caused by it:

(1511|4585045504) TransportRegistry::create_inst: transport_type=rtps_udp is not registered.

So this means the OpenDDS core library couldn't find or load the rtps_udp library for some reason. This could happen because the libOpenDDS_Rtps_Udp library is missing or if OpenDDS was configured with --static, which PyOpenDDS could be changed to handle, but doesn't at the moment.

If you didn't pass --static to configure, I'd check to make sure the libOpenDDS_Rtps_Udp was built. It should be in $DDS_ROOT/lib/libOpenDDS_Rtps_Udp.dylib (or something like that). If it's not, then there might have been an error while building OpenDDS that you missed.

[Danny875]

I have tried to configure again OpenDDS with and without the --static and the same error appeared. I also checked if libOpenDDS_Rtps_Udp.dylib is present in the directory you mentioned and it is indeed there in both cases.

What could be wrong?

[iguessthislldo]

In basic_test/build, can you run the C++ publisher without issue?

./publisher -DCPSConfigFile ../rtps.ini -DCPSDebugLevel 1

[Danny875]

Yes, it seems that there are no issues listed when running ./publisher -DCPSConfigFile ../rtps.ini -DCPSDebugLevel 1 in basic_test/build.

This is the output:

145-2-173-224:~ dannydragoi$ cd /Users/dannydragoi/Downloads/OpenDDS-3.18 
145-2-173-224:OpenDDS-3.18 dannydragoi$ source setenv.sh
145-2-173-224:OpenDDS-3.18 dannydragoi$ cd /Users/dannydragoi/Downloads/pyopendds-master 
145-2-173-224:pyopendds-master dannydragoi$ cd tests/basic_test
145-2-173-224:basic_test dannydragoi$ mkdir build
mkdir: build: File exists
145-2-173-224:basic_test dannydragoi$ cd build
145-2-173-224:build dannydragoi$ cmake ..
-- Configuring done
-- Generating done
-- Build files have been written to: /Users/dannydragoi/Downloads/pyopendds-master/tests/basic_test/build
145-2-173-224:build dannydragoi$ make
Consolidate compiler generated dependencies of target basic_idl
[ 77%] Built target basic_idl
Consolidate compiler generated dependencies of target publisher
[100%] Built target publisher
145-2-173-224:build dannydragoi$ ./publisher -DCPSConfigFile ../rtps.ini -DCPSDebugLevel 1
(3898|4545121792) NOTICE: using DCPSDebugLevel value from command option (overrides value if it's in config file)
(3898|4545121792) NOTICE: Service_Participant::load_domain_ranges(): config does not have a [DomainRange] section.
(3898|4545121792) NOTICE: TransportRegistry::load_transport_templates(): config does not have a [transport_template] section.
(3898|4545121792) NOTICE: Service_Participant::load_domain_configuration(): failed to open [domain] section - using code default.
(3898|4545121792) NOTICE: StaticDiscovery::parse_topics no [topic] sections.
(3898|4545121792) NOTICE: StaticDiscovery::parse_datawriterqos no [datawriterqos] sections.
(3898|4545121792) NOTICE: StaticDiscovery::parse_datareaderqos no [datareaderqos] sections.
(3898|4545121792) NOTICE: StaticDiscovery::parse_publisherqos no [publisherqos] sections.
(3898|4545121792) NOTICE: StaticDiscovery::parse_subscriberqos no [subscriberqos] sections.
(3898|4545121792) NOTICE: StaticDiscovery::parse_endpoints no [endpoint] sections.
(3898|4545121792) NOTICE: Service_Participant::get_domain_participant_factory - This is OpenDDS 3.18.0 using ACE 7.0.3
(3898|4545121792) NOTICE: Service_Participant::intializeScheduling() - no scheduling policy specified, not setting policy.
(3898|4545121792) Service_Participant::network_config_monitor(). Creating NetworkConfigModifier
(3898|4545121792) NetworkConfigModifier::open() enumerating interfaces.
Wating for Subscriber...
Error: Timedout waiting for subscriber
(3898|4545121792) DomainParticipantFactoryImpl::~DomainParticipantFactoryImpl()
(3898|4545121792) NetworkConfigModifier::close()
(3898|4545121792) Service_Participant::~Service_Participant()

[Danny875]

Hi Fred,

Do you have some updates?