Skip to content

Slow inference #9860

Open
Open
@Daboudette

Description

@Daboudette

Prerequisites

Please answer the following questions for yourself before submitting an issue.

  • I am using the latest TensorFlow Model Garden release and TensorFlow 2.
  • I am reporting the issue to the correct repository. (Model Garden official or research directory)
  • I checked to make sure that this issue has not already been filed.

1. The entire URL of the file you are using

https://github.com/tensorflow/models/tree/master/research/object_detection/exporter_main_v2.py

2. Describe the bug

The exported model is really slow. More 20 sec to load and 5 sec to do inference in a new image.

3. Steps to reproduce

I have exported a trained model using the previous file. Now I have a model :

faster_rcnn_model/
├─ checkpoint/
├─ saved_model/
├─ label_map.pbtxt
└─ pipeline.config

4. Expected behavior

I would like to improve the speed to use it.

5. Additional context

Include any logs that would be helpful to diagnose the problem.

6. System information

  • TensorFlow version (use command below): 2.2.3
  • Python version: 3.6.8
  • CUDA/cuDNN version: 10.1.105/7.6.4.38
  • GPU model and memory:

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions