gianlucamazza/SmolLM2-360M-Instruct-ort-genai-int4-cpu
Text Generation • Updated
Gianluca Mazza PRO
gianlucamazza
P(doom) 100%
AI & ML interests
LLM systems in production, agent state and recovery, evaluation, inference cost
Recent Activity
posted an update about 9 hours ago
Upstream models my open-source projects run or my articles discuss. Each note says which it is. thenlper/gte-small is real use: RAGFS embeds file chunks with it locally. The two retrieval models from my RAG article, a cross-encoder re-ranker and a bi-encoder, are examples, labelled as such, not claims of production use.
https://huggingface.co/collections/gianlucamazza/models-used-in-my-projects-6aca0b3201f38f4c264ac9bf published an article about 22 hours ago
Running a Small Language Model on an Xbox Series S liked a dataset 1 day ago
gaia-benchmark/GAIAOrganizations
