Many tests fail with errors: AttributeError: 'Namespace' object has no attribute 'save'

[yurivict]

Describe the bug
Hundreds of plot-related tests fail with errors like these:

_______________________________________________________________ ERROR at setup of test_plot_ts[kwargs8] _______________________________________________________________

self = <_pytest.config.Config object at 0x3b47e314190>, name = 'save', default = <NOTSET>, skip = False

    def getoption(self, name: str, default=notset, skip: bool = False):
        """Return command line option value.
    
        :param name: Name of the option.  You may also specify
            the literal ``--OPT`` option instead of the "dest" option name.
        :param default: Default value if no option of that name exists.
        :param skip: If True, raise pytest.skip if option does not exists
            or has a None value.
        """
        name = self._opt2dest.get(name, name)
        try:
>           val = getattr(self.option, name)
E           AttributeError: 'Namespace' object has no attribute 'save'

/usr/local/lib/python3.11/site-packages/_pytest/config/__init__.py:1689: AttributeError

The above exception was the direct cause of the following exception:

request = <SubRequest 'save_figs' for <Function test_plot_density_float[kwargs0]>>

    @pytest.fixture(scope="session")
    def save_figs(request):
        """Enable command line switch for saving generation figures upon testing."""
>       fig_dir = request.config.getoption("--save")
E       ValueError: no option named 'save'

arviz/tests/conftest.py:26: ValueError
__________________________________________________________ ERROR at setup of test_plot_ts_multidim[kwargs0] ___________________________________________________________

self = <_pytest.config.Config object at 0x3b47e314190>, name = 'save', default = <NOTSET>, skip = False

    def getoption(self, name: str, default=notset, skip: bool = False):
        """Return command line option value.
    
        :param name: Name of the option.  You may also specify
            the literal ``--OPT`` option instead of the "dest" option name.
        :param default: Default value if no option of that name exists.
        :param skip: If True, raise pytest.skip if option does not exists
            or has a None value.
        """
        name = self._opt2dest.get(name, name)
        try:
>           val = getattr(self.option, name)
E           AttributeError: 'Namespace' object has no attribute 'save'

/usr/local/lib/python3.11/site-packages/_pytest/config/__init__.py:1689: AttributeError

The above exception was the direct cause of the following exception:

request = <SubRequest 'save_figs' for <Function test_plot_density_float[kwargs0]>>

    @pytest.fixture(scope="session")
    def save_figs(request):
        """Enable command line switch for saving generation figures upon testing."""
>       fig_dir = request.config.getoption("--save")
E       ValueError: no option named 'save'

arviz/tests/conftest.py:26: ValueError
__________________________________________________________ ERROR at setup of test_plot_ts_multidim[kwargs1] ___________________________________________________________

self = <_pytest.config.Config object at 0x3b47e314190>, name = 'save', default = <NOTSET>, skip = False

    def getoption(self, name: str, default=notset, skip: bool = False):
        """Return command line option value.
    
        :param name: Name of the option.  You may also specify
            the literal ``--OPT`` option instead of the "dest" option name.
        :param default: Default value if no option of that name exists.
        :param skip: If True, raise pytest.skip if option does not exists
            or has a None value.
        """
        name = self._opt2dest.get(name, name)
        try:
>           val = getattr(self.option, name)
E           AttributeError: 'Namespace' object has no attribute 'save'

/usr/local/lib/python3.11/site-packages/_pytest/config/__init__.py:1689: AttributeError

The above exception was the direct cause of the following exception:

request = <SubRequest 'save_figs' for <Function test_plot_density_float[kwargs0]>>

    @pytest.fixture(scope="session")
    def save_figs(request):
        """Enable command line switch for saving generation figures upon testing."""
>       fig_dir = request.config.getoption("--save")
E       ValueError: no option named 'save'

arviz/tests/conftest.py:26: ValueError
__________________________________________________________ ERROR at setup of test_plot_ts_multidim[kwargs2] ___________________________________________________________

self = <_pytest.config.Config object at 0x3b47e314190>, name = 'save', default = <NOTSET>, skip = False

    def getoption(self, name: str, default=notset, skip: bool = False):
        """Return command line option value.
    
        :param name: Name of the option.  You may also specify
            the literal ``--OPT`` option instead of the "dest" option name.
        :param default: Default value if no option of that name exists.
        :param skip: If True, raise pytest.skip if option does not exists
            or has a None value.
        """
        name = self._opt2dest.get(name, name)
        try:
>           val = getattr(self.option, name)
E           AttributeError: 'Namespace' object has no attribute 'save'

/usr/local/lib/python3.11/site-packages/_pytest/config/__init__.py:1689: AttributeError

The above exception was the direct cause of the following exception:

request = <SubRequest 'save_figs' for <Function test_plot_density_float[kwargs0]>>

    @pytest.fixture(scope="session")
    def save_figs(request):
        """Enable command line switch for saving generation figures upon testing."""
>       fig_dir = request.config.getoption("--save")
E       ValueError: no option named 'save'

arviz/tests/conftest.py:26: ValueError
_____________________________________________________ ERROR at setup of test_plot_ts_valueerror[val_err_kwargs0] ______________________________________________________

self = <_pytest.config.Config object at 0x3b47e314190>, name = 'save', default = <NOTSET>, skip = False

    def getoption(self, name: str, default=notset, skip: bool = False):
        """Return command line option value.
    
        :param name: Name of the option.  You may also specify
            the literal ``--OPT`` option instead of the "dest" option name.
        :param default: Default value if no option of that name exists.
        :param skip: If True, raise pytest.skip if option does not exists
            or has a None value.
        """
        name = self._opt2dest.get(name, name)
        try:
>           val = getattr(self.option, name)
E           AttributeError: 'Namespace' object has no attribute 'save'

/usr/local/lib/python3.11/site-packages/_pytest/config/__init__.py:1689: AttributeError

The above exception was the direct cause of the following exception:

request = <SubRequest 'save_figs' for <Function test_plot_density_float[kwargs0]>>

    @pytest.fixture(scope="session")
    def save_figs(request):
        """Enable command line switch for saving generation figures upon testing."""
>       fig_dir = request.config.getoption("--save")
E       ValueError: no option named 'save'

arviz/tests/conftest.py:26: ValueError
_____________________________________________________ ERROR at setup of test_plot_ts_valueerror[val_err_kwargs1] ______________________________________________________

self = <_pytest.config.Config object at 0x3b47e314190>, name = 'save', default = <NOTSET>, skip = False

    def getoption(self, name: str, default=notset, skip: bool = False):
        """Return command line option value.
    
        :param name: Name of the option.  You may also specify
            the literal ``--OPT`` option instead of the "dest" option name.
        :param default: Default value if no option of that name exists.
        :param skip: If True, raise pytest.skip if option does not exists
            or has a None value.
        """
        name = self._opt2dest.get(name, name)
        try:
>           val = getattr(self.option, name)
E           AttributeError: 'Namespace' object has no attribute 'save'

/usr/local/lib/python3.11/site-packages/_pytest/config/__init__.py:1689: AttributeError

The above exception was the direct cause of the following exception:

request = <SubRequest 'save_figs' for <Function test_plot_density_float[kwargs0]>>

    @pytest.fixture(scope="session")
    def save_figs(request):
        """Enable command line switch for saving generation figures upon testing."""
>       fig_dir = request.config.getoption("--save")
E       ValueError: no option named 'save'

arviz/tests/conftest.py:26: ValueError
___________________________________________________________________ ERROR at setup of test_plot_bf ____________________________________________________________________

self = <_pytest.config.Config object at 0x3b47e314190>, name = 'save', default = <NOTSET>, skip = False

    def getoption(self, name: str, default=notset, skip: bool = False):
        """Return command line option value.
    
        :param name: Name of the option.  You may also specify
            the literal ``--OPT`` option instead of the "dest" option name.
        :param default: Default value if no option of that name exists.
        :param skip: If True, raise pytest.skip if option does not exists
            or has a None value.
        """
        name = self._opt2dest.get(name, name)
        try:
>           val = getattr(self.option, name)
E           AttributeError: 'Namespace' object has no attribute 'save'

/usr/local/lib/python3.11/site-packages/_pytest/config/__init__.py:1689: AttributeError

The above exception was the direct cause of the following exception:

request = <SubRequest 'save_figs' for <Function test_plot_density_float[kwargs0]>>

    @pytest.fixture(scope="session")
    def save_figs(request):
        """Enable command line switch for saving generation figures upon testing."""
>       fig_dir = request.config.getoption("--save")
E       ValueError: no option named 'save'

arviz/tests/conftest.py:26: ValueError
____________________________________________________________ ERROR at setup of test_plot_lm[True-lines-1d] ____________________________________________________________

self = <_pytest.config.Config object at 0x3b47e314190>, name = 'save', default = <NOTSET>, skip = False

    def getoption(self, name: str, default=notset, skip: bool = False):
        """Return command line option value.
    
        :param name: Name of the option.  You may also specify
            the literal ``--OPT`` option instead of the "dest" option name.
        :param default: Default value if no option of that name exists.
        :param skip: If True, raise pytest.skip if option does not exists
            or has a None value.
        """
        name = self._opt2dest.get(name, name)
        try:
>           val = getattr(self.option, name)
E           AttributeError: 'Namespace' object has no attribute 'save'

/usr/local/lib/python3.11/site-packages/_pytest/config/__init__.py:1689: AttributeError

The above exception was the direct cause of the following exception:

request = <SubRequest 'save_figs' for <Function test_plot_density_float[kwargs0]>>

    @pytest.fixture(scope="session")
    def save_figs(request):
        """Enable command line switch for saving generation figures upon testing."""
>       fig_dir = request.config.getoption("--save")
E       ValueError: no option named 'save'

arviz/tests/conftest.py:26: ValueError
____________________________________________________________ ERROR at setup of test_plot_lm[True-lines-2d] ____________________________________________________________

self = <_pytest.config.Config object at 0x3b47e314190>, name = 'save', default = <NOTSET>, skip = False

    def getoption(self, name: str, default=notset, skip: bool = False):
        """Return command line option value.
    
        :param name: Name of the option.  You may also specify
            the literal ``--OPT`` option instead of the "dest" option name.
        :param default: Default value if no option of that name exists.
        :param skip: If True, raise pytest.skip if option does not exists
            or has a None value.
        """
        name = self._opt2dest.get(name, name)
        try:
>           val = getattr(self.option, name)
E           AttributeError: 'Namespace' object has no attribute 'save'

/usr/local/lib/python3.11/site-packages/_pytest/config/__init__.py:1689: AttributeError

The above exception was the direct cause of the following exception:

request = <SubRequest 'save_figs' for <Function test_plot_density_float[kwargs0]>>

    @pytest.fixture(scope="session")
    def save_figs(request):
        """Enable command line switch for saving generation figures upon testing."""
>       fig_dir = request.config.getoption("--save")
E       ValueError: no option named 'save'

arviz/tests/conftest.py:26: ValueError
_____________________________________________________________ ERROR at setup of test_plot_lm[True-hdi-1d] _____________________________________________________________

self = <_pytest.config.Config object at 0x3b47e314190>, name = 'save', default = <NOTSET>, skip = False

    def getoption(self, name: str, default=notset, skip: bool = False):
        """Return command line option value.
    
        :param name: Name of the option.  You may also specify
            the literal ``--OPT`` option instead of the "dest" option name.
        :param default: Default value if no option of that name exists.
        :param skip: If True, raise pytest.skip if option does not exists
            or has a None value.
        """
        name = self._opt2dest.get(name, name)
        try:
>           val = getattr(self.option, name)
E           AttributeError: 'Namespace' object has no attribute 'save'

/usr/local/lib/python3.11/site-packages/_pytest/config/__init__.py:1689: AttributeError

The above exception was the direct cause of the following exception:

request = <SubRequest 'save_figs' for <Function test_plot_density_float[kwargs0]>>

    @pytest.fixture(scope="session")
    def save_figs(request):
        """Enable command line switch for saving generation figures upon testing."""
>       fig_dir = request.config.getoption("--save")
E       ValueError: no option named 'save'

arviz/tests/conftest.py:26: ValueError
_____________________________________________________________ ERROR at setup of test_plot_lm[True-hdi-2d] _____________________________________________________________

self = <_pytest.config.Config object at 0x3b47e314190>, name = 'save', default = <NOTSET>, skip = False

    def getoption(self, name: str, default=notset, skip: bool = False):
        """Return command line option value.
    
        :param name: Name of the option.  You may also specify
            the literal ``--OPT`` option instead of the "dest" option name.
        :param default: Default value if no option of that name exists.
        :param skip: If True, raise pytest.skip if option does not exists
            or has a None value.
        """
        name = self._opt2dest.get(name, name)
        try:
>           val = getattr(self.option, name)
E           AttributeError: 'Namespace' object has no attribute 'save'

/usr/local/lib/python3.11/site-packages/_pytest/config/__init__.py:1689: AttributeError

The above exception was the direct cause of the following exception:

request = <SubRequest 'save_figs' for <Function test_plot_density_float[kwargs0]>>

    @pytest.fixture(scope="session")
    def save_figs(request):
        """Enable command line switch for saving generation figures upon testing."""
>       fig_dir = request.config.getoption("--save")
E       ValueError: no option named 'save'

arviz/tests/conftest.py:26: ValueError
___________________________________________________________ ERROR at setup of test_plot_lm[False-lines-1d] ____________________________________________________________

self = <_pytest.config.Config object at 0x3b47e314190>, name = 'save', default = <NOTSET>, skip = False

    def getoption(self, name: str, default=notset, skip: bool = False):
        """Return command line option value.
    
        :param name: Name of the option.  You may also specify
            the literal ``--OPT`` option instead of the "dest" option name.
        :param default: Default value if no option of that name exists.
        :param skip: If True, raise pytest.skip if option does not exists
            or has a None value.
        """
        name = self._opt2dest.get(name, name)
        try:
>           val = getattr(self.option, name)
E           AttributeError: 'Namespace' object has no attribute 'save'

/usr/local/lib/python3.11/site-packages/_pytest/config/__init__.py:1689: AttributeError

The above exception was the direct cause of the following exception:

request = <SubRequest 'save_figs' for <Function test_plot_density_float[kwargs0]>>

    @pytest.fixture(scope="session")
    def save_figs(request):
        """Enable command line switch for saving generation figures upon testing."""
>       fig_dir = request.config.getoption("--save")
E       ValueError: no option named 'save'

arviz/tests/conftest.py:26: ValueError
___________________________________________________________ ERROR at setup of test_plot_lm[False-lines-2d] ____________________________________________________________

self = <_pytest.config.Config object at 0x3b47e314190>, name = 'save', default = <NOTSET>, skip = False

    def getoption(self, name: str, default=notset, skip: bool = False):
        """Return command line option value.
    
        :param name: Name of the option.  You may also specify
            the literal ``--OPT`` option instead of the "dest" option name.
        :param default: Default value if no option of that name exists.
        :param skip: If True, raise pytest.skip if option does not exists
            or has a None value.
        """
        name = self._opt2dest.get(name, name)
        try:
>           val = getattr(self.option, name)
E           AttributeError: 'Namespace' object has no attribute 'save'

/usr/local/lib/python3.11/site-packages/_pytest/config/__init__.py:1689: AttributeError

The above exception was the direct cause of the following exception:

request = <SubRequest 'save_figs' for <Function test_plot_density_float[kwargs0]>>

    @pytest.fixture(scope="session")
    def save_figs(request):
        """Enable command line switch for saving generation figures upon testing."""
>       fig_dir = request.config.getoption("--save")
E       ValueError: no option named 'save'

arviz/tests/conftest.py:26: ValueError
____________________________________________________________ ERROR at setup of test_plot_lm[False-hdi-1d] _____________________________________________________________

self = <_pytest.config.Config object at 0x3b47e314190>, name = 'save', default = <NOTSET>, skip = False

    def getoption(self, name: str, default=notset, skip: bool = False):
        """Return command line option value.
    
        :param name: Name of the option.  You may also specify
            the literal ``--OPT`` option instead of the "dest" option name.
        :param default: Default value if no option of that name exists.
        :param skip: If True, raise pytest.skip if option does not exists
            or has a None value.
        """
        name = self._opt2dest.get(name, name)
        try:
>           val = getattr(self.option, name)
E           AttributeError: 'Namespace' object has no attribute 'save'

/usr/local/lib/python3.11/site-packages/_pytest/config/__init__.py:1689: AttributeError

The above exception was the direct cause of the following exception:

request = <SubRequest 'save_figs' for <Function test_plot_density_float[kwargs0]>>

    @pytest.fixture(scope="session")
    def save_figs(request):
        """Enable command line switch for saving generation figures upon testing."""
>       fig_dir = request.config.getoption("--save")
E       ValueError: no option named 'save'

arviz/tests/conftest.py:26: ValueError
____________________________________________________________ ERROR at setup of test_plot_lm[False-hdi-2d] _____________________________________________________________

self = <_pytest.config.Config object at 0x3b47e314190>, name = 'save', default = <NOTSET>, skip = False

    def getoption(self, name: str, default=notset, skip: bool = False):
        """Return command line option value.
    
        :param name: Name of the option.  You may also specify
            the literal ``--OPT`` option instead of the "dest" option name.
        :param default: Default value if no option of that name exists.
        :param skip: If True, raise pytest.skip if option does not exists
            or has a None value.
        """
        name = self._opt2dest.get(name, name)
        try:
>           val = getattr(self.option, name)
E           AttributeError: 'Namespace' object has no attribute 'save'

/usr/local/lib/python3.11/site-packages/_pytest/config/__init__.py:1689: AttributeError

The above exception was the direct cause of the following exception:

request = <SubRequest 'save_figs' for <Function test_plot_density_float[kwargs0]>>

    @pytest.fixture(scope="session")
    def save_figs(request):
        """Enable command line switch for saving generation figures upon testing."""
>       fig_dir = request.config.getoption("--save")
E       ValueError: no option named 'save'

arviz/tests/conftest.py:26: ValueError

To Reproduce
pytest

Expected behavior
n/a

Additional context
Version: 0.22.0
matplotlib-3.8.0
Python-3.11
FreeBSD 14.3

$ pkg info | grep pytest
py311-pytest-8.1.1,1           Simple powerful testing with Python
py311-pytest-cov-5.0.0_1       Pytest plugin for measuring coverage
py311-pytest-xdist-3.6.1,1     Pytest xdist plugin for distributed testing and loop-on-failing modes

[OriolAbril]

I am unable to reproduce this locally. I tried setting up a conda environment with the same dependencies. The differences is things being installed with conda and OS being ubuntu 24.

The error message says there is an error in getoption saying there is no save attribute in the namespace. We do define the save option in https://github.com/arviz-devs/arviz/blob/main/arviz/tests/conftest.py. And we haven't updated the file in 5 years. This is not necessarily a good thing, but we haven't needed to change how the test configuration is set up and none of the devs, contributors nor our CI has had any issue with that configuration either so it seems to work and serve our use-case still.

Is it possible there is something related to the way you are running the tests that modifies/changes how pytest gets configured and therefore results in this project specific command line option we add not being registered correctly? I saw you have pytest-xdist which we don't use but the closest thing I could find was pytest-dev/pytest-xdist#465 which is quite old and seems to have many other plugins involved. I am not sure what else I can do to help