Sorry I’m not familiar with TPUs only GPUs but how much VRAM do Corals have? YOL... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

janalsncm on Oct 8, 2024 | parent | context | favorite | on: Video Surveillance with YOLO+llava

Sorry I’m not familiar with TPUs only GPUs but how much VRAM do Corals have? YOLO 11x is 56M params which if it was quantized to int8 would still be 56MB. Plus you would need some for your inputs.

moandcompany on Oct 9, 2024 [–]

The Coral Edge TPU has approximately 8MB of SRAM for model weights/parameters.

https://coral.ai/docs/accelerator/datasheet/

It does not have VRAM as it is not a graphics card :)

There are examples and instructions for exporting Yolo variants to run on the Edge TPU: https://docs.ultralytics.com/guides/coral-edge-tpu-on-raspbe...

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact