Routing in agent pipelines is another use. "Does user prompt A make sense with d... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		app13 74 days ago \| parent \| context \| favorite \| on: The path to ubiquitous AI (17k tokens/sec) Routing in agent pipelines is another use. "Does user prompt A make sense with document type A?" If yes, continue, if no, escalate. That sort of thing

mtone 73 days ago [–]

For this type of repetitive application I think it's common to "fine-tune" a model trained on your business problem to reach higher quality/reliability metrics. That might not be possible with this chip.

mike_hearn 73 days ago | [–]

They say LoRA finetunes work.

Consider applying for YC's Summer 2026 batch! Applications are open till May 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact