Your language doesn’t change your perception of color.

The primary colors being Red, Yellow, Blue. Is made up. There’s no reason those should be the three primary colors.

Magenta, Yellow, and Cyan could be the primary colors if you were taught that.

In that color wheel orange is an intermediate color. The intermediate color between green and yellow can be called chartreuse.

Did you know chartreuse as a color or did you just know it as yellow-green?

Do you not preceve the color chartreuse the same as someone that just knows that name?

You can perceve all the difference colors on this wheel without needing an official word.

As you can see “Brown” is just a darker orange.