The Warriors star was actually the topic of conversation between Sarver and then-Suns head coach Earl Watson in October 2016, when the Phoenix owner allegedly said the N-word. He was apparently upset that one Suns player received a technical foul for saying it, while Green was not punished similarly.
Per ESPN:
"'You know, why does Draymond Green get to run up the court and say [N-word],' Sarver, who is white, allegedly said, repeating the N-word several times in a row.
'You can't say that,' Watson, who is Black and Hispanic, told Sarver.