I think it's good etiquette to ask the user if they want to download the model or any assets larger than the average page size, in case they have limited bandwidth.
This is very good. Super snappy and gives me what I'm looking for. Great write-up too.
How much more would it cost to use a multilingual tokeniser? I realise this is somewhat pointless for an English blog, but services like Uber Eats have something like that going on (server-side of course, and they may just be translating queries).
In case some one is interested here is it : https://web-inky-ten-60.vercel.app/
How much more would it cost to use a multilingual tokeniser? I realise this is somewhat pointless for an English blog, but services like Uber Eats have something like that going on (server-side of course, and they may just be translating queries).