LocalLLaMA@sh.itjust.works•Qwen27b vs GPT 6bydivided_by_zero@lemmy.mlEnglish10 daysIsn’t it something to do with tokenisation? Like double e gets into one token or something? 7
Technology@lemmy.world•Why Is This Fingerprinting Script Creating Bioweapons?bydivided_by_zero@lemmy.mlEnglish12 daysThriller! Incredible read, and good example where llm “safeguards” prevent legitimate work 8
Isn’t it something to do with tokenisation? Like double e gets into one token or something?