Perplexity vs BPB giving opposite rankings across tokenizers : how to evaluate

Hi, I accidentally made an error in the post and can’t edit/delete anymore. Could a moderator please remove this thread?