Due to the lore, I've found an interesting topic surfaced by theory. A theory that the "true Humans" do not respect, support, nor accept the Guardians as their protectors.
Update: I forgot to include that there are some forms of Information referring to Guardians such as Saint - 14, whom was actually much respected and loved by the people of The Last City, but due to his obsession with the downing of the Fallen through a long crusade, he is no longer commonly mentioned, but only as a legend now.
Nevertheless, we've gotten some pretty good feedback regarding as to why. Maybe the "living Humans" see us as something tyrannical?
-
they are tired of cleaning up our bodies at the bottom if the tower.