Vechev and his team found that the large language models that power advanced chatbots can accurately infer an alarming amount of personal information about users—including their race, location, occupation, and more—from conversations that appear innocuous.
There is some hope. Mistral is pretty incredible for it’s size, and it’s a 7b model. There are finetunes on top of that which makes it even better - my favorite right now is Open Hermes 2
There’s still room for improvement, and it’s getting better and better.