Tech Sketch
Model Quantization in Action: How SMEs Can Benefit From On-Device AI
AI mobile applications are becoming commonplace on smartphones but some mobile applications require models to reside on cloud servers for high accuracy and intensive inference. This is impractical for SMEs due to high model hosting and inference costs. Instead, an SME’s IT team should reduce costs by implementing edge AI using their mobile applications and model quantization.