Today Oscowl AI launches Wiola, our first Small Language Model (SLM) built entirely from first principles. Wiola represents a deliberate departure from off-the-shelf transformer variants and large-scale model recipes; instead, we designed every component with clarity of assumptions, efficiency, and practical deployment in mind. The research paper is available now, and the model will be open-sourced on our website on Monday. Read the paper: https://lnkd.in/dXJfmy2w. Visit the project page: https://lnkd.in/dycaEERm. Why build Wiola from first principles? Reexamining assumptions: Modern LLM progress often stacks scale on top of similar architectural patterns. We asked: which design choices are essential, and which are inherited baggage? Wiola reconsiders tokenization, attention mechanics, optimization, and inference trade-offs from ground-up principles. Practical SLM needs: Not every application requires massive models. Edge deployment, privacy-preserving on-device inference, and cos...
What we have today