Is it cultural appropriation to wear a Japanese headband?

It depends on the context. Wearing a Japanese headband as part of a costume or to make a fashion statement could be seen as cultural appropriation. However, if you are wearing it to honor or celebrate Japanese culture, it may not be seen as cultural appropriation.