Phi-4-Mini ONNX Chatbot (Local CPU)
Interact with the microsoft/Phi-4-mini-instruct-onnx model variant
(cpu-int4-rtn-block-32-acc-level-4) running locally using ONNX Runtime on your CPU.
Model Loading Error:
Error: Model directory not found at '/home/user/app/cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4'
Please ensure you have created the directory structure
'./cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4' relative to this script (app.py)
and downloaded ALL the required model files into it from:
https://huggingface.co/microsoft/Phi-4-mini-instruct-onnx/tree/main/cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4