Skip to content

test_retinanet onnx #6555

Closed
Closed

Description

@wyli

Describe the bug
Pytorch version: 2.0.1+cu117

[2023-05-25T02:36:28.192Z] ======================================================================
[2023-05-25T02:36:28.192Z] FAIL: test_onnx_3 (tests.test_retinanet.TestRetinaNet)
[2023-05-25T02:36:28.192Z] ----------------------------------------------------------------------
[2023-05-25T02:36:28.192Z] Traceback (most recent call last):
[2023-05-25T02:36:28.192Z]   File "/opt/conda/lib/python3.8/site-packages/parameterized/parameterized.py", line 620, in standalone_func
[2023-05-25T02:36:28.192Z]     return func(*(a + p.args), **p.kwargs, **kw)
[2023-05-25T02:36:28.192Z]   File "/home/jenkins/agent/workspace/MONAI-postmerge/monai_github/tests/test_retinanet.py", line 186, in test_onnx
[2023-05-25T02:36:28.192Z]     test_onnx_save(backbone, data, rtol=2e-3)
[2023-05-25T02:36:28.192Z]   File "/home/jenkins/agent/workspace/MONAI-postmerge/monai_github/tests/utils.py", line 760, in test_onnx_save
[2023-05-25T02:36:28.192Z]     convert_to_onnx(
[2023-05-25T02:36:28.192Z]   File "/home/jenkins/agent/workspace/MONAI-postmerge/monai_github/monai/networks/utils.py", line 700, in convert_to_onnx
[2023-05-25T02:36:28.192Z]     assert_fn(r1.cpu(), convert_to_tensor(r2, dtype=r1.dtype), rtol=rtol, atol=atol)  # type: ignore
[2023-05-25T02:36:28.192Z]   File "/opt/conda/lib/python3.8/site-packages/torch/testing/_comparison.py", line 1511, in assert_close
[2023-05-25T02:36:28.192Z]     raise error_metas[0].to_error(msg)
[2023-05-25T02:36:28.192Z] AssertionError: Tensor-likes are not close!
[2023-05-25T02:36:28.192Z] 
[2023-05-25T02:36:28.192Z] Mismatched elements: 1 / 9 (11.1%)
[2023-05-25T02:36:28.192Z] Greatest absolute difference: 4.26173210144043e-06 at index (2, 1) (up to 0.0 allowed)
[2023-05-25T02:36:28.192Z] Greatest relative difference: 0.01431574732205426 at index (2, 1) (up to 0.002 allowed)
[2023-05-25T02:36:28.192Z] 
[2023-05-25T02:36:28.192Z] ----------------------------------------------------------------------

jenkins/MONAI-postmerge/detail/MONAI-postmerge/1399/pipeline/

still an issue

[2023-06-14T00:11:03.039Z] ======================================================================
[2023-06-14T00:11:03.039Z] FAIL: test_onnx_3 (tests.test_retinanet.TestRetinaNet)
[2023-06-14T00:11:03.039Z] ----------------------------------------------------------------------
[2023-06-14T00:11:03.039Z] Traceback (most recent call last):
[2023-06-14T00:11:03.039Z]   File "/opt/conda/lib/python3.8/site-packages/parameterized/parameterized.py", line 620, in standalone_func
[2023-06-14T00:11:03.039Z]     return func(*(a + p.args), **p.kwargs, **kw)
[2023-06-14T00:11:03.039Z]   File "/home/jenkins/agent/workspace/Monai-pytorch-versions/tests/test_retinanet.py", line 186, in test_onnx
[2023-06-14T00:11:03.039Z]     test_onnx_save(backbone, data, rtol=2e-3)
[2023-06-14T00:11:03.039Z]   File "/home/jenkins/agent/workspace/Monai-pytorch-versions/tests/utils.py", line 760, in test_onnx_save
[2023-06-14T00:11:03.039Z]     convert_to_onnx(
[2023-06-14T00:11:03.039Z]   File "/home/jenkins/agent/workspace/Monai-pytorch-versions/monai/networks/utils.py", line 700, in convert_to_onnx
[2023-06-14T00:11:03.039Z]     assert_fn(r1.cpu(), convert_to_tensor(r2, dtype=r1.dtype), rtol=rtol, atol=atol)  # type: ignore
[2023-06-14T00:11:03.039Z]   File "/opt/conda/lib/python3.8/site-packages/torch/testing/_comparison.py", line 1344, in assert_close
[2023-06-14T00:11:03.039Z]     assert_equal(
[2023-06-14T00:11:03.039Z]   File "/opt/conda/lib/python3.8/site-packages/torch/testing/_comparison.py", line 1095, in assert_equal
[2023-06-14T00:11:03.039Z]     raise error_metas[0].to_error(msg)
[2023-06-14T00:11:03.039Z] AssertionError: Tensor-likes are not close!
[2023-06-14T00:11:03.039Z] 
[2023-06-14T00:11:03.039Z] Mismatched elements: 1 / 9 (11.1%)
[2023-06-14T00:11:03.039Z] Greatest absolute difference: 1.430511474609375e-06 at index (1, 0) (up to 0.0 allowed)
[2023-06-14T00:11:03.039Z] Greatest relative difference: 0.004467609828741623 at index (1, 0) (up to 0.002 allowed)
[2023-06-14T00:11:03.039Z] 
[2023-06-14T00:11:03.039Z] ----------------------------------------------------------------------

jenkins/pipelines/Monai-pytorch-versions/runs/949

Activity

  1. added a commit that references this issue on Jun 14, 2023
    a89a0af
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions