• 1 Post
  • 10 Comments
Joined 1 year ago
cake
Cake day: August 27th, 2023

help-circle






  • LLMs demonstrated greater accuracy when addressing questions about ancient history, particularly between 8,000 BCE and 3,000 BCE, but struggled with more recent events, especially from 1,500 CE to the present.

    I’m not entirely surprised by this. Llms are trained on the whole internet and not just the good part. There are groups online that are very vocal about things like the confederates being in the right for example. It would make sense to assume this essentially poisons the datasets. Realistically, no one is contesting history before that time.

    Not that it isn’t a problem and doesn’t need fixing, just that it makes “sense”.