@TonyGao all of them. Detection models are not as heavy as generative models. So yes, you can run them locally on any device with decent compute.
@Fibonan
I love patterns and reasoning. Probably that's why I want to teach the same.
https://www.linkedin.com/in/utsav-singhal-986812179/$0 in pending offers
Graduated from IIT Delhi with Mathematics and Computing. Worked at Eightfold AI. Built gooat.in with a childhood friend. Trying to save the faith on digital media since the world is having fun destroying it.
pending admin approval
Utsav Singhal
2 days ago
@TonyGao all of them. Detection models are not as heavy as generative models. So yes, you can run them locally on any device with decent compute.
Utsav Singhal
3 days ago
@TonyGao yes. We ran audio model on OnePlus 12 with 12 GB memory smoothly. We are still trying to optimize image/video models but it doesn't seem infeasible. We want it to smoothly run on edge wherever needed.