Why don't UC + CSU colleges consider freshman grades?

I am a freshman in high school. We had a lecture from our college career counselor who explained that grades of your soph. + junior are put into the GPA calculations for admission. I work really hard for my grades and will continue to, but why don't they count them? Is it because many freshman have trouble adapting, or what?