Yes, you are correct, this was adding a good amount of latency. I think I have resolved all of the major issues now. Thank you everyone for your responses! I appreciate your continued help.
I have reduced several sources of latency by doing the following:
- Using camera stream instead of image file
- setting
stream=False(misleading in docs) - setting
persist=True(unclear in docs) - setting
tracker=bytetrack.yaml(faster than botsort)
Do you have any more advice on configuring a Jetson environment for maximum performance? More specifically, using DLA, which power modes to use, how to maximize gpu utilization, etc.